POSITION: Sr. Data Engineer CLIENT: Fortune 150 Company;Financial Services SUMMARY DESCRIPTION: The Data Engineer... dedicated to Azure Data Factory (ADF), to design, code, implement, and manage multiple parallel data pipelines. Experience...
Platforms: Hands-on experience with cloud services (AWS, Azure, or GCP) and cloud-native data tools. Big Data...., Azure Data Lake Storage, On-prem SQL Server) using service principals, SAS tokens, OAuth, or mounting techniques. Security...
(e.g., Azure Functions, App Services, Logic Apps, Cosmos DB, ADF). Drive the design of modular, reusable components... applications across web, API, and data layers. Design and implement secure, cloud-native solutions using Microsoft Azure services...
transformation, container orchestration services such as Docker and Kubernetes, and various Azure tools and services. Collaborate... and Azure Data Factory (ADF) are preferred Experience building and operating data pipelines using technologies like Apache...
cloud services (ADF, Databricks, Function Apps, SQL) Proficiency in Python for data manipulation and ETL development... Azure tools (ADF, Data Lake, SQL) and Python. Support ingestion and normalization of large, complex data sets from higher...
and experienced Senior ETL Tools Developer with deep expertise in Microsoft Azure Data Factory (ADF) and modern data integration... robust ETL pipelines using MS Azure Data Factory, MS Azure Databricks, and other Azure services. Build and manage data...
storage solutions (e.g., AWS S3, Redshift, Snowflake) with a focus on performance, reliability, and security. Implement data... and delivering within Agile environments. Hands-on experience with AWS data services (e.g., Glue, Lambda, Athena, Step Functions...
using ADF (v2) for batch and real-time data processing. Create and manage Linked Services, Datasets, Pipelines...6+ years of ADF data flows/Snowflake. if you just worked on ADF pipelines, this is not for you. An Azure Data Factory...
and Azure services such as Azure Data Factory (ADF), Synapse Analytics, Data Lake, Key Vault, and SQL Server. Governance... & Compliance: Ensure adherence to organizational data governance, security, and compliance policies within the financial services...
with any platforms such as, SQL Server, Snowflake Cloud, Databricks, DBT, ADF (Azure Data Factory) and other Azure services Advanced SQL... next gen data platforms that include Snowflake, Databricks, MS Fabric, PowerBI, DBT, Airflow, Azure data services, SQL Server...