(e.g., pandas). Solid understanding of ETL concepts, data modelling, and pipeline design. Experience with Spark and cloud.... Job responsibilities Design, build, and optimize data pipelines and transformation workflows on Databricks, leveraging Python and Spark...
across cloud, data and software domains You'll work with Containers and Kubernetes, develop in Python, and use Spark for data...
collaboration and driving technical excellence. Architect and implement robust, cloud-first data solutions. Drive migration... Engineer. Hands-on experience with Databricks and PySpark/Spark SQL. Strong expertise with the Azure data platform (Data...
, leveraging modern cloud-based AI platforms. Your client impact Develop, and deploy end-to-end machine learning models... Familiarity with distributed computing frameworks (eg Spark) Knowledge of graph neural networks, reinforcement learning...
, focusing on data ingestion and processing - utilising appropriate cloud native technologies and services. Data pipeline... production ETL/ELT pipelines (batch + streaming) using a popular framework (Spark, Flink, Dataflow, etc). Streaming: Hands...
deployment of AI and Generative AI systems. Broad experience across major cloud platforms (AWS, Azure, GCP) with Generative... AI services. Cloud-agnostic experience is preferred. Strong grasp of MLOps/LLMOps principles, including CI/CD for ML, model...
processing and persisting solutions (Apache Spark, PostgreSQL, MongoDB, Redis, Kafka) Cloud platform experience (GCP preferred... deployment Build and maintain microservices, cloud workflows and data pipelines that serve both internal editorial use-cases...
-based data processing frameworks such as Flink, Beam, Dataflow, Spark, etc. Devops is part of your day-to-day work... and you are used to working with cloud-based infrastructure and services, containerised applications. You have some experience working...
, or Rust Cloud platform expertise with AWS, GCP, or Azure, including AI-specific services (SageMaker, Vertex AI, Azure... Distributed computing experience with Databricks, Ray, or Spark for large-scale AI workloads AI safety & governance experience...
Highly proficient in SQL, Python and Spark (pyspark) for developing and testing data engineering pipelines and products... with low/no-code pipeline development tools such as Talend or SnapLogic. Experience developing data pipelines using cloud...