Spark or Flink) Experience in financial services or regulated environments Interest in learning MLOps and AI-driven...
, Spark, Flink, or similar distributed data frameworks. Exposure to generative AI systems such as LLMs, multimodal models...
data storage and processing technologies (e.g., Kafka, Postgres, blob storage, Flink, dbt, Iceberg) Expertise in Python...
Experience in the Big Data technologies (Hadoop, M/R, Hive, Spark, Flink, Metastore, Presto, Kafka etc.) Experience...
-cardinality datasets Build and maintain real-time ingestion pipelines using Kafka, Flink, or Spark Streaming Develop and manage... systems Experience with stream processing frameworks (Kafka, Flink, or Spark) Hands-on experience with cloud platforms (AWS...
platforms (Kafka, Flink, Pulsar), and deploying distributed systems at scale on cloud platforms such as AWS, Google Cloud...
such as Scrum;(7) Batch or stream processing systems such as Apache Spark, Flink, Akka, Storm;(8) Message brokers such as Kafka...
, Flink, and more Experience with workflow management engines (i.e., Airflow, Luigi, Azure Data Factory, etc.) Experience...
(Iceberg, Parquet). DATA STREAMING: Experience developing data pipelines with streaming architectures and tools (Kafka, Flink...
Advanced in one or more programming language(s) and framework(s) (i.e., Java, Spring framework, Kafka Streams, Flink, Data Lake... qualifications, capabilities, and skills Apache Flink, Kafka and Confluent Cloud Experience working with Petabyte scale...