Experience with API testing, Prompt Engineering Experience with Azure Databricks/DevOps Knowledge of Data Lake, Data Lakehouse...
pipelines and ETL processes using Microsoft Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks, Azure... Databricks, Azure Blob Storage and Azure Data Lake Gen 2. Experience utilizing SQL DML to query modern RDBMS in an efficient...
Qualifications Experience with data engineering tools such as Apache Spark, Databricks, or Airflow. Knowledge of modern data...
, Databricks notebooks (Python), and ETL pipelines Implement and consume RESTful APIs Collaborate with other developers, data... Experience with Spark, Databricks, and ETL pipelines Knowledge of AWS services (S3, Lambda, RDS, etc.) Experience with SST...
warehouses (e.g., Snowflake, Databricks) Understanding of CDP data modeling and identity stitching Basic knowledge...
in mining, energy, or heavy industry projects. Familiarity with Azure, Databricks, or Power BI from a functional standpoint...
. Responsibilities Developing and optimizing ETL/ELT pipelines using Databricks, Spark, and Delta Lake Implementing performance tuning..., data scientists, and engineers to meet business needs Requirements 2–4 years of core Databricks experience (Spark...
systems. Nice to Have Knowledge of scikit-learn, TensorFlow, PyTorch. Hands-on experience with Spark, Databricks...
, and maintain data ingestion, transformation, and delivery pipelines using Azure Data Factory, Databricks, or equivalent frameworks... in cloud-based enterprise environments Strong hands-on experience with Azure Data Factory, Azure Synapse, Databricks...
, and maintain data ingestion, transformation, and delivery pipelines using Azure Data Factory, Databricks, or equivalent frameworks... in cloud-based enterprise environments Strong hands-on experience with Azure Data Factory, Azure Synapse, Databricks...