Job Description: Senior Data Engineer (Azure Databricks) Lead II - Data Engineering Who We Are: Born digital... Databricks) with 5+ years building batch and/or streaming pipelines with Spark. The opportunity: · Python packaging, code...
pipelines (Azure, AWS) & data platforms (Databricks & Snowflake) · Work with large-scale structured and unstructured datasets...
development, and Databricks exposure, while enhancing technical and problem solving skills. The intern will learn how to architect... from various formats Integrate agentic LLMs, prompt management systems, and Databricks Agent Bricks into a unified solution...
. Responsibilities Build and maintain ETL pipelines in Databricks using Python Script ADF Data Loads Optimize Spark jobs, work... with client personnel Exhibit a professional, business-like demeanor Computer Skills: SQL, Python, Databricks Environment, ADF...
with platforms like Databricks, Power BI and Tableau. · You are a self-starter, independent, hard worker, with a high degree... solutions (examples: SAP, MS Dynamics, Customer’s · Experience Platform and similar marketing tools, ADLS/Hadoop/Databricks...
Platforms (ex. Azure Synapse, Databricks, Microsoft/Azure SQL), Containerization (ex. Docker, Kubernetes), Knowledge of Backup...
architectures centered on Azure Databricks, Snowflake on Azure, dbt, and Azure Data Factory (ADF) with supporting services... Azure Databricks (Delta Lake/Unity Catalog), Snowflake on Azure, dbt (Core/Cloud), and ADLS Gen2 following medallion...
deep architectural knowledge of Azure Data Lake and Databricks, a solid understanding of security concepts within Azure... Data Lake and Databricks. Define and enforce best practices for data ingestion, storage, processing, and retrieval...
-on experience with cloud platforms, especially AWS and Amazon Athena. · Familiarity with Databricks and collaborative data...
will have deep hands-on experience with Databricks, Spark, modern data lakehouse architectures, data modelling, and both batch... scalable data platforms and pipelines on Azure and Databricks. · Build and optimize data ingestion, transformation...