Databricks Data Engineer (Contract)
building and optimising complex Spark SQL transformations. Strong Databricks experience developing scalable ELT pipelines...
building and optimising complex Spark SQL transformations. Strong Databricks experience developing scalable ELT pipelines...
solutions within Google Cloud Platform (GCP). Develop and maintain scalable ETL/ELT pipelines, data models, and integration...
platform solutions (e.g. data warehousing, data lakes, ETL/ELT pipelines, BI, or real-time streaming) - Experience delivering...
models, testing, documentation, and data lineage management. Experience designing and delivering ETL/ELT data pipelines...
scientists, and application teams to deliver trusted datasets, performant ETL/ELT pipelines, and well-governed data products... fundamentals: data modeling, ETL/ELT patterns, reliability, observability, and performance tuning. Hands-on experience using...
on schema design, indexing strategies, and query performance tuning. ETL/ELT Pipelines: Develop and maintain pipelines... processing frameworks like Spark. Data Engineering Knowledge: - Proven experience building ETL/ELT pipelines and using...
, scalable, and future-proof end-to-end data solutions. Design and implement efficient ETL and ELT pipelines, ensuring... SQL to manage and process large datasets. Expertise in Building ETL and ELT Pipelines: You are skilled in building...
data model. Pipelines & Governance: Define ETL/ELT pipelines and establish data governance standards - ownership, data...
along with proficiency in SQL. Extensive experience working with ETL and ELT frameworks and orchestration tools such as Airflow and dbt...
using AWS EMR: ingestion patterns, schema evolution, ETL/ELT, microservices data integration. - Multi-cloud integration...