, troubleshoot, and support production data pipelines and workflows. Ensure data quality, validation, governance, and lineage... Good understanding of: Data quality and validation Data governance and lineage Production support and operational...
scientists, domain SMEs, security, and platform engineering) to ensure solutions meet governance, lineage, performance...
including data lineage, data sharing agreements, and other metadata management Evaluate upstream system of record changes...
, reconciliation, and monitoring capabilities Driving observability and lineage for operational data Data Product Development...
reporting, analytics, and regulatory use cases. Establish data governance, metadata, lineage, and data quality controls..., validation rules, lineage, and remediation processes. Security & compliance awareness - data protection and regulatory...
and machine learning workloads Solid understanding of data governance quality lineage and compliance eg GDPR SOC2 HIPAA...
, EFS, S3, AWS Glue, DataSync Design Apache Airflow Implementation. Autosys job Dependencies and data lineage Analyze...
Create dashboards and reporting solutions using Power BI Ensure data quality, governance, lineage, and compliance standards..., and secure data communication Experience with data governance, metadata management, and data lineage Databricks Certified...
& classification Automated data lineage (ADF, Fabric, SQL, ADLS) Enforce data security and access controls: RBAC, column-level... Data Factory (ADF) SSIS / Azure-SSIS Integration Runtime ADLS Gen2 Data Lineage & Security (Microsoft Purview...
. Administer and leverage Unity Catalog for data governance, access control, and lineage tracking across all ingested datasets... management (schema evolution, VACUUM, OPTIMIZE), and Unity Catalog for governance and lineage. These are named source systems...