Azure and Databricks technologies. This role involves building robust data pipelines, optimizing data workflows... and workflows in Azure and Databricks, including Data Lake and SQL Database integrations. Implement scalable ETL/ELT frameworks...
platforms using Azure services such as Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Data Lake Storage... Strong proficiency in Azure services: Data Factory, Synapse, Databricks, Data Lake, Power BI. Experience with data modeling, ETL design...
-on experience with PySpark, Databricks, and Azure and the ability to lead end-to-end model development and deployment. Experience...
(excludes employer match) Here’s how you’ll make an impact on the team: Setup and maintain production scale Databricks... and Maintenance: Langchain Setup and Operation: Databricks SQL Server & SSAS Airflow Azure Kubernetes Service or Elastic...
in at least one of the following areas: Amazon Web Services (AWS), Apache Spark, Big Data, Databricks, or Oracle. Strong proficiency...
proficiency in SQL, Excel/Sheets, Databricks, and other data visualization tools (Looker, Tableau, Power BI...
modern Python APIs (FastAPI/Django), GraphQL for efficient data access, and Databricks on the cloud for analytics and ETL... ) , with a focus on scalability and performance. Develop ETL processes, Delta tables, Orchestration layer using Databricks notebook...
, and similar) In-depth understanding of modern data management platforms including data lakes, big data engines (Databricks...
engineering tools and platforms such as SQL, Spark, Databricks, and Airflow Familiarity with cloud environments (AWS or Azure...
(Redshift, BigQuery, Databricks) Experience developing secure data ingestion pipelines, APIs, and data distribution frameworks...