large-scale systems Experience with at least one distributed data processing framework (Ray, Spark, Flink, etc) Passionate...
, Scala or Python You may have experience with Data Flow, Queues and Stream Processing (Nifi, Kafka, Flink, Spark...
flows using Kafka, Flink, and Spark streaming Desired Qualifications: Proven experience using AI to auto-generate data...
how even the tools (i.e. spark, flink, kafka) are built (Nice-to-have) Extremely strong communication skills, and are a fast...
best practices for stream processing (Flink), microservices (Java/Python), API design, CI/CD, observability, and resiliency. Leads... real-time streaming and event-driven processing using technologies such as Kafka, Kinesis, and Flink Identifies...
like Databricks, dbt, or AWS Glue Knowledge of distributed systems (Spark, Flink, etc.) and streaming tools (Kafka, Kinesis...
workflows for batch and real-time processing using Spark, Airflow, Kafka, and Flink Develops data platform components including... Spark and Flink Solid understanding of data modeling techniques (star schema, snowflake) and query optimization Experience...
, Iceberg, Delta Lake), distributed query engines (Spark, Trino, Flink), and vector databases - sufficient to evaluate...
workflows for batch and real-time processing using Spark, Airflow, Kafka, and Flink Develops data platform components including...(s);Python, Java and SQL Hands-on experience with distributed data processing frameworks such as Apache Spark and Flink Solid...
Frameworks: Flink, Airflow, Spark for large scale batch & stream processing Databases: Familiarity with Vector, Lexical & Key...