, scalable enterprise Data Private Cloud (DPC) platform. This is a hybrid role that blends container-platform development... such as Ranger, Keycloak, Spark, Iceberg, DataHub. Knowledge of S3-compatible object storage and large-scale distributed data...
to help design, build, and operate a secure, scalable enterprise Data Private Cloud (DPC) platform. This is a hybrid role... such as Spark, Iceberg, Ranger, Sparkflow, Superset, and related services Contribute to resilient, scalable architecture...
. Design and implement batch and ad-hoc data pipelines using Medallion Lakehouse architecture on modern cloud platforms... with strong analytical skills. Technical Skills (Mandatory) Python (expert level) including PySpark / Spark for data engineering. Azure...
architecture on modern cloud platforms, primarily Databricks. Build and maintain data ingestion pipelines from upstream systems... (expert level) including PySpark / Spark for data engineering. Azure Databricks with experience implementing Medallion...
and cloud-based Azure data infrastructure, including Azure Data Factory, Databricks, and Power BI, to transform and visualize... on On-Prem SQL Servers using SSIS and/or other integration processes Code and implement data pipelines in cloud-based data...
Title: Data Engineer Duration: 12 Months Location Stamford, CT Must Have Skills Strong expertise in AWS cloud... (Hadoop, Spark is a plus). Job Description: 6+years of hands-on experience in Data Engineering. Strong expertise...
environments, optimizing compute usage, and supporting mission-critical data pipelines. Preferred: Strong understanding of Spark... DevOps, GitHub Actions, or Jenkins. Working knowledge of cloud platforms (Azure/AWS/GCP), including networking concepts...
requires strong expertise in data processing, database management, and cloud technologies. Key Responsibilities: Design... with ETL tools (Informatica, Talend, SSIS, or similar). Experience with big data technologies such as Hadoop, Spark, or Kafka...
contributes to modernizing data platforms. The ideal candidate will design and build scalable, cloud-native data solutions... Responsibilities Design and build scalable data lakes and data pipelines on AWS using modern, automated, cloud-native architectures...
, not just a task executor. What You'll Do Design and build scalable data lakes and pipelines on AWS using cloud-native... with the Hadoop ecosystem (Spark, Hive, HDFS) using partitioning, bucketing, and columnar formats (Parquet, ORC). Troubleshoot...