Job Description: Senior Data Engineer (Azure Databricks) Lead II - Data Engineering Who We Are: Born digital... Databricks) with 5+ years building batch and/or streaming pipelines with Spark. The opportunity: · Python packaging, code...
, or Databricks. Support dashboards and reporting (e.g., Power BI) that provide quick performance insights to engineering... Must Have Skills: Python, Shell Scripts, PySpark, Databricks, PowerBI , CI/CD Preferred / Nice to Have: Experience with CPU...
Ingest and transform data by IICS & DataBricks to implement data model Create Power BI visualization for business use...
pipelines (Azure, AWS) & data platforms (Databricks & Snowflake) · Work with large-scale structured and unstructured datasets...
development, and Databricks exposure, while enhancing technical and problem solving skills. The intern will learn how to architect... from various formats Integrate agentic LLMs, prompt management systems, and Databricks Agent Bricks into a unified solution...
. Responsibilities Build and maintain ETL pipelines in Databricks using Python Script ADF Data Loads Optimize Spark jobs, work... with client personnel Exhibit a professional, business-like demeanor Computer Skills: SQL, Python, Databricks Environment, ADF...
with platforms like Databricks, Power BI and Tableau. · You are a self-starter, independent, hard worker, with a high degree... solutions (examples: SAP, MS Dynamics, Customer’s · Experience Platform and similar marketing tools, ADLS/Hadoop/Databricks...
Platforms (ex. Azure Synapse, Databricks, Microsoft/Azure SQL), Containerization (ex. Docker, Kubernetes), Knowledge of Backup...
architectures centered on Azure Databricks, Snowflake on Azure, dbt, and Azure Data Factory (ADF) with supporting services... Azure Databricks (Delta Lake/Unity Catalog), Snowflake on Azure, dbt (Core/Cloud), and ADLS Gen2 following medallion...
deep architectural knowledge of Azure Data Lake and Databricks, a solid understanding of security concepts within Azure... Data Lake and Databricks. Define and enforce best practices for data ingestion, storage, processing, and retrieval...