can design, build, and optimize scalable data pipelines and work closely with analytics, product, and engineering teams..., reusable code and follow engineering best practices Troubleshoot issues in production data pipelines. Required Skills...
and real time data streaming using ADF, Spark and Confluent Kafka. · Develop and maintain data quality checks, monitoring...-on experience in data engineering with strong database expertise. · At least 5 years of experience in implementing operational data...
Lakehouse architecture using Microsoft Fabric. Develop and optimize data engineering pipelines for large-scale data ingestion.... Implement Medallion architecture for structured data organization. Compare and evaluate Fabric vs Databricks and Fabric vs ADF...
responsibilities also involve leading data engineering projects implementation, optimizing and troubleshooting data platforms... and engineering processes and plays a pivotal role ensuring the success of our data and AI/ML initiatives. Responsibilities...
and work closely with analytics, product, and engineering teams. Key Responsibilities: Design and build ETL/ELT pipelines...-functional teams (Data Science, BI, Product) Write clean, reusable code and follow engineering best practices Troubleshoot...
& calculated columns, and query folding. Data Engineering & Integration Validate data quality, accuracy, lineage... Experience with Azure technologies (ADLS, ADF, Databricks, Azure SQL, Synapse, Fabric). Experience with Git-based source control...