Senior Data Engineer
with big data technologies such as Databricks and/or Synapse Analytics, using PySpark. Solution design experience across end...
with big data technologies such as Databricks and/or Synapse Analytics, using PySpark. Solution design experience across end...
, Databricks). Proven Python software engineering skills (e.g. an understanding of concepts such as decorators, generators...
, PostgreSQL;MongoDB and cloud-based platforms (e.g. Snowflake, Databricks, Redshift). Semantic Layer: Design and implementation...
intervention. Data management and visualization skills/tools in one or more of the following: Databricks, SQL, KNIME, Tableau...
of code and system architecture. Your expertise in TypeScript, Azure, Databricks, and DevOps, combined with insurance industry... on Containers and App Services / Functions Leverage Databricks for advanced data modelling, transformation, and analytics...
and reporting models (including Databricks tables) to improve operational insight and cost efficiency. Monitor and report...
and disciplined documentation Nice to Have Experience with Snowflake, Databricks or Azure Exposure to LLMs, NLP or retrieval...
Pulls from ER data using Azure MSSQL, Databricks, and Salesforce based on stakeholder or vendor requirements. Extract..., transform, and load (ETL) data from vendor sources such as SFTP or portals into Azure MSSQL and subsequently into Databricks...
to Have Microsoft Fabric Azure Databricks Azure Synapse Analytics Familiarity with AI coding tools - GitHub Copilot, Claude Code... AI, Cognitive Services Master Data Management / MDS Certifications Microsoft Azure Certifications Databricks Certified...
: Build and manage pipelines using Azure Data Factory, Databricks, CI/CD, and Terraform. Optimisation of ETL processes... technologies and identify areas for enhancement. Databricks (Unity Catalog, DLT), Data Factory, Synapse, Data Lake, Stream...