-to for pipeline and cloud topics. Your Skills and Experience Essential Experience with data solution BAU processes (ETL, table... refresh etc.) Experience in Big Data data integration technologies such as Spark, Kafka Experience in programming language...
by applying deep technical expertise across software engineering, cloud platforms, and operational best practices. They act... seamless integration from data ingestion through model deployment and monitoring. Cloud Platform Delivery: Works...
. What will you be doing? Develop and optimise data ingestion pipelines and transformations within the Quantexa platform using Spark... integration of Quantexa into broader enterprise data architectures, working closely with cloud, security, and DevOps teams...
(e.g., pandas). Solid understanding of ETL concepts, data modelling, and pipeline design. Experience with Spark and cloud.... Job responsibilities Design, build, and optimize data pipelines and transformation workflows on Databricks, leveraging Python and Spark...
across cloud, data and software domains You'll work with Containers and Kubernetes, develop in Python, and use Spark for data...
collaboration and driving technical excellence. Architect and implement robust, cloud-first data solutions. Drive migration... Engineer. Hands-on experience with Databricks and PySpark/Spark SQL. Strong expertise with the Azure data platform (Data...
, leveraging modern cloud-based AI platforms. Your client impact Develop, and deploy end-to-end machine learning models... Familiarity with distributed computing frameworks (eg Spark) Knowledge of graph neural networks, reinforcement learning...
, focusing on data ingestion and processing - utilising appropriate cloud native technologies and services. Data pipeline... production ETL/ELT pipelines (batch + streaming) using a popular framework (Spark, Flink, Dataflow, etc). Streaming: Hands...
deployment of AI and Generative AI systems. Broad experience across major cloud platforms (AWS, Azure, GCP) with Generative... AI services. Cloud-agnostic experience is preferred. Strong grasp of MLOps/LLMOps principles, including CI/CD for ML, model...
processing and persisting solutions (Apache Spark, PostgreSQL, MongoDB, Redis, Kafka) Cloud platform experience (GCP preferred... deployment Build and maintain microservices, cloud workflows and data pipelines that serve both internal editorial use-cases...