Senior Data Engineer
experience: Azure AWS Google Cloud Containerization: Docker Infrastructure as Code (IaC) Databricks experience...
experience: Azure AWS Google Cloud Containerization: Docker Infrastructure as Code (IaC) Databricks experience...
with Cloud platforms: Azure data factory, Azure functions, and Databricks. Real-time and batch data processing, streaming...
, Talend, SSIS, Snowflake, Databricks, Airflow, AWS Glue, Azure Data Factory, etc. Experience working with API-based...
Manager Preferred qualifications, capabilities, and skills Familiarity of PySpark, DataBricks, Lake House architecture...
. Our team leveraged Azure Databricks for advanced data transformation, Azure Front Door for global load balancing, and Microsoft...-time intelligence solution built on Microsoft Fabric. The previous setup—based on Databricks and Snowflake—struggled...
-on experience with ELT processes in Databricks. If you are passionate about data engineering, have strong analytical skills... engineering pipelines using Databricks Feature Store, Delta Lake, or vectorization techniques. Assist in deploying...
, Databricks and data integration methods is a plus. Data Mastering Ability to analyze large datasets, detect discrepancies...
. Storm, Spark-Streaming, Pulsar, Flink, etc.) Data Warehouse design (Databricks, Snowflake, Delta Lake, Lake formation...
, and similar) In-depth understanding of modern data management platforms including data lakes, big data engines (Databricks...
Azure and Databricks technologies. This role involves building robust data pipelines, optimizing data workflows... and workflows in Azure and Databricks, including Data Lake and SQL Database integrations. Implement scalable ETL/ELT frameworks...