Data Engineer (Kafka, Hadoop, Spark, Python, DBT) Location: Manchester Contract: 6 months Hours: 37.5 hours... where needed. Required Skills 5+ years data engineering experience. Strong experience with Kafka, Hadoop, Spark, DBT (Python also considered...
to profile data Technical experience and knowledge in On-Premise and Public Cloud Data Services focused on: Database... of Big Data technologies (Hadoop, Spark) Able to create rich visualisations that appropriately represent the underlying...
., tuning Spark jobs, query optimisation, partitioning strategies) Ensure secure data handling and compliance with relevant..., performance, and optimisation strategies Familiarity with GCP and ecosystem knowledge: BigQuery, Composer, Dataproc, Cloud Run...
, documentation, and SLAs/SLOs Optimise cost and performance across data processing and training workflows (e.g., Spark tuning..., deployment patterns, and monitoring needs Hands-on experience with orchestration and distributed processing in a cloud...
, Spark, and Python. This position plays a key role in ensuring secure, scalable, and compliant ML workloads aligned... distributed data processing workflows using Apache Spark, AWS Glue, and related ETL frameworks. Build serverless automation...
around Snowflake performance tuning, cost optimisation, and data governance. Oversee integration of Snowflake with wider cloud.... Strong background in data modelling, Cloud Data Warehousing, and ELT frameworks. Hands-on experience with: Snowflake configuration...
& Optimisation: Rapidly understand highly complex data flows and re-engineer them into performant, scalable Spark-based pipelines... data pipelines using Python, SQL, or equivalent languages. Deep, hands-on expertise with Databricks and Apache Spark...
). Experience migrating ETL processes to cloud-based solutions. Exposure to Big Data technologies such as Kafka, Spark, NoSQL...Java Platform Engineer - Cloud | Data Platforms | Financial Services Location: Hybrid / Remote Contract Start: ASAP...
touches and delivered with care. We're not just about selling cards or gifts - we're here to spread joy, spark smiles... a place where people (and ideas) can truly thrive. If you're looking to make an impact, bring your spark and be part...
, Azure, Google Cloud). Experience with big data technologies (e.g., Hadoop, Spark, Kafka). Experience with UML/SYSML... data integration across cloud and on-premises environments. Support data governance initiatives, including metadata...