Data Engineer supports technical solutions implemented in the data lake, as defined by the Data Analyst and validated... by the Data Architect. Responsibilities Build the implementation of technical solutions in the data lake, as defined by the...
Data factory. - Experience in SQL writing in SQL Server SQL Azure Data Warehouse, Azure Data Lake- Experience...
Delta Lake tables and Databricks workloadsManage the Hive Metastore and Unity CatalogIngest data from SAP source systems... on AzureStrong hands-on experience with Databricks, Delta Lake, and the lakehouse pattern (Bronze/Silver/Gold)Proficiency with Spark...
, and AI/ML workloads. Define scalable lakehouse patterns using core Databricks capabilities such as Apache Spark, Delta Lake.... Proven experience designing and delivering enterprise data solutions using Delta Lake and lakehouse architecture principles...
, and manage enterprise data platforms leveraging Azure Data Lake Storage (ADLS), Azure SQL, and Azure DatabricksLead platform... Databricks Lakehouse architecture, including Delta Lake design patterns and implementation standardsEstablish and enforce data...
transformed data** into a target database, data warehouse, or data lake, making it accessible for querying and analysis...
, in support of data lake houses (e.g. AWS, Databricks, Snowflake), data virtualization solutions (e.g. Starburst), modern data... platform and lake(house) (i.e. medallion architecture), and data mesh and virtualization tools (e.g., Starburst, Denodo...
strategies, and partitioning. Exposure to Microsoft Azure Data technologies (Azure Data Factory, Azure Data lake) Work in Agile...
standards for data engineering workflows. Architect, implement, and manage enterprise data platforms leveraging Azure Data Lake..., observability, and operational excellence. Own and evolve the enterprise Databricks Lakehouse architecture, including Delta Lake...
The Data Engineer executes the work of implementing the technical solutions implemented in the data lake, as defined... solutions implemented in the data lake, as defined by the Data Analyst and validated by the Data Architect. Build new...