. Utilise DevOps practices and data orchestration tools (e.g., Apache Airflow) to streamline and manage workflows efficiently...
to cloud platforms (AWS), containerisation technologies (Docker, Kubernetes) and data processing solutions (Apache NiFi...
following is highly desirable; ** Microservices ** Elastic Search or Apache Kafka ** Modern Agile Experience...
frameworks (eg Terraform). Bonus points for: Apache Flink, K8s/Flux We also expect a solid understanding of modern software...
. Strong understanding of IT concepts, including security, IAM, Key Vault, and networking. Exposure to Apache Airflow and DBT...
lakehouse, o Hands-on experience of Big Data opensource technologies such as: ▪ Apache Airflow, ▪ Apache Kafka, ▪ Apache... Pekko, ▪ Apache Spark & Spark Structured Streaming, ▪ Delta Lake, ▪ AWS Athena, Trino, ▪ MongoDB, ▪ AWS S3, MinIO S3...
), containerisation technologies (Docker, Kubernetes) and data processing solutions (Apache NiFi). Experience with AI/ML systems...
and workflow management tools such as Apache Airflow. Proficiency in Git for version control. Ability to produce high-quality...
and DevOps, event-driven/message-oriented Middleware/Queues, Apache Camel, Micro-Service architecture, No-SQL, Elastic, Mongo...
sources. Hands-on experience with job automation and orchestration tools such as Apache Airflow. Proficient in Data Build...