Lead Software Engineer - Python/PySpark/Databricks/AWS
(least privilege, PII classification, auditing, lineage/metadata, controlled sharing/consumption);optimize Spark/Delta performance...
(least privilege, PII classification, auditing, lineage/metadata, controlled sharing/consumption);optimize Spark/Delta performance...
that address data ownership, stewardship, lineage, and usage, helping the organization maintain trusted and well documented data...
, creed, national origin, ancestry, lineage or citizenship status, age, disability, gender (including pregnancy, childbirth...
, creed, national origin, ancestry, lineage or citizenship status, age, disability, gender (including pregnancy, childbirth...
structures. Oversee metastore configuration, catalog hierarchies, and data organization. Implement data lineage, auditing... governance best practices including cataloging, metadata management, and data lineage using Databricks Unity Catalog and AWS...
lineage, explainability, and auditability. Evaluate emerging AI technologies and approaches, and define adoption roadmaps...
, lineage, reliability, and service-level expectations Define and implement automated testing strategies for data pipelines...
lifecycle, including lineage, quality checks, and operational readiness. Define and monitor product metrics such as adoption...
initiatives Create and maintain Data definitions, Table definitions, Source-to-target mappings, Data lineage documentation... understanding of source-to-target mapping, data lineage, and data definitions Experience working directly with technical teams...
graphs and semantic layer models Familiarity with AI governance, data lineage, and responsible AI practices Experience...