(e.g., Informatica, on-prem data warehouses) into modern Azure-based, Python-driven data platforms. This is a hands... Responsibilities ETL Modernization (Primary Focus) Refactor and migrate legacy ETL pipelines (e.g., Informatica) into Python/PySpark...
migration programs (e.g., Informatica-to-ADF, on-prem warehouse-to-cloud), mentoring mid-level engineers, and shaping... using Delta Lake, Parquet, and structured streaming patterns. Build performant ELT workflows that leverage pushdown...
, Fivetran, Qlik, or Informatica. Familiarity with streaming technologies (ex. Kafka, Flink, Spark Streaming, Kinesis) and real... working with Iceberg, Delta, and Parquet Strong architectural expertise in data engineering to confidently present and demo...
migration programs (e.g., Informatica-to-ADF, on-prem warehouse-to-cloud), mentoring mid-level engineers, and shaping... Fabric Data Factory. Implement medallion architecture (Bronze / Silver / Gold) on Azure Data Lake Storage Gen2 using Delta...
Engineering with experience in tools such as: Big data tools: Databricks, Apache Spark, Delta Lake, etc. Relational SQL... scripting languages: PySpark/Python, Java, C++, Scala, etc. Experience working with Data Lakehouse architecture and Delta Lake...
Engineering with experience in tools such as: Big data tools: Databricks, Apache Spark, Delta Lake, etc. Relational SQL... scripting languages: PySpark/Python, Java, C++, Scala, etc. Experience working with Data Lakehouse architecture and Delta Lake...
integration design and development across Azure Data Factory, Synapse, and Informatica. · Author and maintain source to target... architectures, including legacy platforms such as Informatica. · Understanding of enterprise data governance, metadata, lineage...
-based, big data platforms. Architect solutions leveraging Databricks, Spark, Delta Lake, and related big data technologies... Spark, Delta Lake, and distributed data processing frameworks. Strong knowledge of AWS (Glue, S3, Redshift, EMR), Azure...
of metadata, lineage, data quality, and governance tooling (Collibra DQ, SALT, Informatica EDC) Hands on expertise with data lake... (Informatica), BI (MicroStrategy, Tableau, ThoughtSpot), and relational databases Programming proficiency in Python and SQL...
evolution, including Lakehouse Monitoring, Lake Designer, Delta Sharing, Mosaic AI, and Matrix. Databricks Practice Lead..., and scalable solution design. Experience with platform migrations including Snowflake, Informatica, and on-prem systems. Ability...