will collaborate with Data Engineering team to deploy and orchestrate workflows in Apache Airflow and run Spark jobs on Kubernetes...) Deploying Apache Airflow on Kubernetes (AKS) using Helm ([guide here]2). Writing DAGs in Python for ETL and data processing...
in Python, Java, and Scala. Experience in working with Kubernetes and stream data processing frameworks (Flink, Apache Ignite..., we believe that innovation and growth are driven by an inclusive culture and a diverse workforce. We aim to create a global team...
information technology and applications throughout the development lifecycle using application server platforms including Apache... streaming platforms with Apache Kafka or IBM messaging queue;Implementing enterprise systems using domain-driven design...
and execution of initiatives. - Build and implement message streaming solutions for Venmo applications with AWS SQS, Apache Kafka... SQS, Apache Kafka etc Collaborate with stakeholders including the Executive, Product, Engineering and Analytics teams...
data. Three (3) years of experience in data Engineering concepts. Three (3) years of experience in Apache Spark, Scala... a few. Elevance Health operates in a Hybrid Workforce Strategy. Unless specified as primarily virtual by the hiring manager...
responsibilities, and tracking progress against defined schedules and milestones. Assist in budgeting, workforce planning, hiring... such as Apache Kafka. Deep understanding of cloud-native architectures and platform operations. Monitoring, Telemetry...
processing frameworks (e.g., Apache Spark, Flink, Hadoop). Strong expertise in message brokers and event streaming platforms... (e.g., Apache Kafka, Kinesis). End-to-end exposure to data pipeline lifecycle development, including extensive experience...
tools (Airflow/Prefect/Dagster). - Experience with big data platforms/technologies (BigQuery/Snowflake/Redshift/Apache Spark... a diverse workforce and providing a work environment that is free from discrimination and harassment based upon any legally...
Azure SQL, Databricks, Apache Spark, Python, and PySpark. Design and implement relational and dimensional data models... with Databricks, Apache Spark, or similar distributed data processing platforms required. Understanding of data warehousing concepts...
on Apache Spark. Hands-on experience with table formats and data lake technologies such as Apache Iceberg, ensuring scalability... a diverse workforce across all levels in the company....