and ClickHouse, building real-time pipelines on Pub/Sub and Kafka with Dataflow (and where it fits, Flink/Spark), orchestrating... Processing: Dataflow (Apache Beam), with Flink/Spark where appropriate Orchestration: Airflow (Cloud Composer) Analytical store...
Airflow and data processing frameworks such as PySpark Experience with data streaming technologies like Kafka, Kinesis, Flink...
Airflow and data processing frameworks such as PySpark Experience with data streaming technologies like Kafka, Kinesis, Flink...
, Rust, C++, C#) and ODBC driver;ship first-party connectors for Kafka Connect, Apache Spark, Apache Flink, dbt, and Airbyte... ClickHouse connectors for Kafka, Flink, Spark, and others, and the broader JVM ecosystem (data ingestion tools, BI platforms...
technologies backed by battle-proven AWS technologies. Apache Kafka as our event streaming system Apache Flink (using Java...: Leverage Apache Flink to translate Data Science requirements into high-performance, real-time streams. Enable Data Scientists...
applications and streaming data processing (e.g. GCP Dataflow, Apache Beam, Apache Flink, etc.) Having worked in a scale up...
processing engine built on Apache Flink, together with the surrounding ecosystem that makes it production-ready for demanding... effectively in an asynchronous, remote environment. Preferred Qualifications: Contributions to Apache Flink or comparable...
engine performance and reliability Enhance integration with streaming engines (e.g., Flink) Engage with the open-source... and replication (Raft, Paxos, etc.) Storage engines (LSM trees, B-Trees, WAL, compaction) Streaming systems (Kafka, Pulsar, Flink...
. Kafka, Spark, Flink). Experience with maintaining/contributing to open-source software. Wir bieten Work...
frameworks (Apache Spark, Flink, Kafka Connect, Fivetran), orchestration platforms, and AI tooling. Our work directly shapes...