, and cost-aware engineering;h Team / Business Context: You will join a data engineering team responsible for third party data... workloads Azure ecosystem: Azure Data Factory (ADF) (orchestration) Azure-native integrations and services exposure Data...
Location: Chicago, IL (Hybrid 3 days Work from Office) Duration: -12+ months Educational Qualifications: - Engineering...), CICD, Unit Test/Integration test automation, Code Coverage. Azure Data Factory (ADF): Build/operate ADF pipelines...
validation mechanisms. Utilize Azure services such as Azure Data Factory (ADF), Azure Synapse Analytics, Azure Databricks..., and Azure Storage. Implement CI/CD pipelines and DevOps practices for data engineering deployments. Collaborate with business...
hands-on experience designing, developing, and optimizing cloud-based data engineering solutions using Azure Databricks...-scale data pipelines using Azure Databricks, Azure Data Factory (ADF), PySpark, Spark SQL, Python, Azure Data Lake Storage...
and mentor engineering teams. Required Skills: 10+ years of Data Architecture/Data Engineering experience. Strong expertise... in Azure Data Services, Azure Databricks, Azure Data Factory (ADF), Synapse Analytics, and Spark. Proficiency in SQL...
, Azure SQL, cloud data engineering, and legacy data migration. Key Responsibilities Design, develop, and maintain Azure Data... Factory (ADF) pipelines for ingestion, orchestration, and transformation. Build scalable ETL/ELT solutions supporting...
engineering standards, and driving scalable data platform modernization initiatives. Key Responsibilities Design, develop..., and optimize large-scale ETL/ELT pipelines using Databricks, Azure Data Factory (ADF), PySpark, and Spark SQL. Architect scalable...
preferably in Computer Science, Information technology, Computer Engineering, or related IT discipline or equivalent experience... with 12+ Minimum Experience Development & Migration: Develop and maintain ADF pipelines, PySpark notebooks, and T-SQL...
in Azure Data Factory, Microsoft Fabric, Azure Synapse, Data Engineering. The candidate will have experience in designing... (ETL,ELT, data quality management, privacy/security, MDM) with hands-on experience using ADF, Data Factory, SSIS...
with strong expertise in cloud-based data engineering, ETL development, and distributed data processing. The ideal candidate... pipelines for enterprise grade analytics and reporting. 2.Key Responsibilities : Data Engineering & Pipeline Development...