. Spark, PySpark, Delta Lake, Parquet, Feature Extraction, MLOps, Flink, with a deep understanding of the distributed systems...
, stream processing, or ML infrastructure. - Understanding of Apache Flink internals, with hands-on experience in state...(s): - Experience in designing and optimizing Flink + Paimon architectures for unified batch/stream processing. - Familiarity...
frameworks like Spark, Flink, Kafka, and Dagster for large-scale data architectures and data processing Demonstrate ability...
on streaming lakehouse and federated query architectures using Apache Flink Apache Iceberg and Starburst Trino in a cloud... environment Key Responsibilities Build and operate real-time streaming pipelines using Apache Flink Design and manage...
and Python. Proficiency in Hadoop, Kudu, Hive, Kafka, Spark and/or Flink. Proficiency in real-time and batch data processing...
), Cloud (AWS/HCI) Streaming Frameworks: Kafka, Flink MongoDB, ArangoDB, Redis, PostgreSQL Desired Experience...
, Flink). DATA TRANSFORMATION: Strong background with using Spark for data transformation, including streaming...
and streaming systems such as Kafka and Flink is optional but considered a plus. Hands-on practical experience delivering system...
, PyTorch) and distributed computing platforms (Flink, Beam, Spark, Ray) Proven track record of architecting and delivering... is highly desirable Expertise in building real-time streaming architectures using technologies like Kafka, Flink, or Beam...
, streaming platforms (Kafka, Flink), and orchestration frameworks. Hands-on understanding of machine learning...