Lead Software Engineer
in automation and setup scheduling jobs on Hadoop like Apache Tuber or other tools Experience with kafka or flink steaming data...
in automation and setup scheduling jobs on Hadoop like Apache Tuber or other tools Experience with kafka or flink steaming data...
. Understanding of distributed computing concepts such as MapReduce, Spark RDDs, or Apache Flink data streams. Familiarity with big...
, or similar. Experience with distributed processing technologies and frameworks, such as Spark, Hadoop, Flink and distributed...
(e.g., Spark, Flink) Experience with managed platforms such as Databricks Knowledge of data quality, lineage...
and understanding of databases (Postgres, etc) Experience and understanding of pub/sub and streaming systems (RabbitMQ, Flink...
Streaming experience (Nifi, Kafka, Flink, Spark, etc.) NoSQL experience (HBase, Cassandra, MongoDB, etc.) EDW experience...
, or DevOps roles supporting production data pipelines. Tools * Apps/Platforms: NiFi, Kafka, Grafana, Prometheus, Apache Flink...
, caching, and message brokers;ClickHouse and Flink;Ad-tech;Akka;NoSQL database, Kubernetes and Kustomization;and JVM...
., Flink, Spark, Beam) Ensure alignment with security, compliance, and data governance requirements Scalability...
systems and related technologies (Hive、Flink、ClickHouse etc.)...