data pipelines meet SLAs, quality standards, and security guidelines. - Manage and monitor data platform operations using..., deployment, and monitoring for data services. - Implement data validation, profiling, and quality checks. - Work with data...
hybrid data platforms using Azure services such as Azure Data Lake, ADF, Azure Databricks, Synapse, etc. Solution Design... capabilities. Exposure to Azure cloud services is a significant advantage. This is a senior/lead role responsible for shaping...
. Ensure data security, governance, and compliance standards are met. Partner with software, DevOps, and security on delivery... design, query optimization, and indexing. Cloud database services (Azure/AWS/GCP) and IaC concepts. Experience with ETL...
(storage, compute, security, governance). · Familiarity with Azure/AWS/GCP data services (e.g., S3/ADLS/GCS;Redshift/BigQuery... Skills Summary AWS Data Engineering Services (EMR/Glue,Redshift,Aurora, S3, Lambda), Spark, Python, Collibra, Snowflake...
in relation to data storage, integration, processing, and AI services. Hands-on experience in developing and optimizing... EL (Extract and Load) processes using ADF (Azure Data Factory). Perform unit, integration, and functional testing of developed...
, database development, query optimization and performance turning. Experience in Azure API Management. Azure Data Services... to date equivalent i.e. React/VUE. Design and development of REST APIs, Web services. Modern design patterns, architecture, and testing...
, or Identity Ecosystems Familiarity with Medallion Architecture (Bronze/Silver/Gold). Azure services (ADF, Azure Data Lake, Azure...). Define and enforce PII governance, privacy controls, and security best practices. Translate complex business and technical...
, or Identity Ecosystems Familiarity with Medallion Architecture (Bronze/Silver/Gold). Azure services (ADF, Azure Data Lake, Azure...). Define and enforce PII governance, privacy controls, and security best practices. Translate complex business and technical...
, Spark SQL, and Azure data services with a focus on building high-performance ETL/ELT pipelines and optimizing big data... architecture on Azure Data Lake Storage (ADLS). Build and orchestrate data workflows using Azure Data Factory (ADF) or Azure...
. Infrastructure as Code (IaC): Provision and manage Azure data services (Synapse, ADF, Data Lake, etc.) through code using tools... the performance and resource utilization of Azure data services, including monitoring and troubleshooting data pipeline...