can design, build, and optimize scalable data pipelines and work closely with analytics, product, and engineering teams..., reusable code and follow engineering best practices Troubleshoot issues in production data pipelines. Required Skills...
and real time data streaming using ADF, Spark and Confluent Kafka. · Develop and maintain data quality checks, monitoring...-on experience in data engineering with strong database expertise. · At least 5 years of experience in implementing operational data...
–$100/hour Engagement Type: Contract / Consulting Key Responsibilities Lead Data Architecture and Data Engineering... patterns for promoting data and analytics assets Data Engineering Design and implement metadata-driven batch ingestion...
Engineering Manager is responsible for the development and maintenance of software solutions providing key business capabilities... Key Azure technologies such as AKS, ADF, AuthN/AuthZ Agile Development, including key software solutions such as Harness...
. Design and develop robust data pipelines. Architect AI systems, including RAG workflows and prompt engineering. Lead... proficiency in Python and SQL. Expertise in building ETL/ELT pipelines and ADF workflows. Experience architecting data...
Lakehouse architecture using Microsoft Fabric. Develop and optimize data engineering pipelines for large-scale data ingestion.... Implement Medallion architecture for structured data organization. Compare and evaluate Fabric vs Databricks and Fabric vs ADF...
Who We Are At Streamline, we are experts in Enterprise Mobility, Product Engineering, and IT Transformation. We help... ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks (using Python). Data Modeling & Storage: Develop...
reporting to the Senior Manager, Data Solutions Engineering. Position Summary The Lead Data Solutions Engineer... data governance standards (PCI, HIPAA, GDPR). Direct data engineering initiatives encompassing the design of robust...
technologies and can work as a full-stack developer & architect in complex engineering projects Required Qualifications... Movement Library Design and development of SSIS packages and knowledge of ETL tools (ADF would be plus). The job may...
data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, Microsoft Fabric etc. Azure.... Experience with ETL/ELT tools like ADF, Azure, MS Fabric etc., and data warehousing technologies like Azure Synapse, Azure SQL...