is needed to direct quality assurance activities for the enterprise data lake platform. This position involves developing thorough testing... Technical Skills: Programming: Python, node.js, SQL Data Technologies: Apache Spark, Kafka, Delta Lake, Databricks, Looker...
, including data lake architectures Familiarity with: Airflow for orchestration Databricks CI/CD pipelines (e.g., GitHub...
the comprehensive Lakehouse pipeline architecture across the Bronze, Silver, and Gold layers. Delta Lake Optimization...: Expertise in applying advanced Delta Lake features such as Z-Ordering, liquid clustering, vacuuming, and partitioning techniques...
and maintain conceptual, logical, and physical data models Build scalable models in Databricks (Delta Lake architecture...
Career’s Page: Keywords: Azure Databricks, PySpark, Python, SQL, Data Warehouse, ETL, Data Lake, Azure Cloud, Data...
while driving innovation in our data engineering practices. What will you do: Design, develop and engineer data lake by data... with data governance, cataloguing and discovery tools such as AWS Glue and Lake formation. Exposure to data lake architectures...
with Databricks (clusters, notebooks, Delta Lake). Strong Python (required) and SQL skills. Experience with AI parsing/extraction...
Lake Optimization: Expertise in applying advanced Delta Lake features such as Z-Ordering, liquid clustering, vacuuming...
approaches, Big Data and Data Lake technologies, and OpenSource technologies, including the Apache ecosystem. Data...
approaches, Big Data and Data Lake technologies, and OpenSource technologies, including the Apache ecosystem. Data...