, builds, and maintains scalable data pipelines and ETL/ELT workflows for batch and real-time processing using Spark, Airflow... with distributed data processing frameworks such as Apache Spark and Flink Solid understanding of data modeling techniques (star...
, capabilities, and skills Experience with distributed data processing using Spark and modern data platforms (e.g., Databricks...
Life Cycle Strong hands-on data engineering stack: Apache Spark (batch optimization, partitioning, shuffle tuning...
across Java, React, Kafka, Oracle, Aurora, Airflow, and Spark. Guide deployments to both public and private cloud environments...
, checkpoint tuning) and Spark performance optimization (partitioning, join strategies, file layout). FEDERAL DEPOSIT INSURANCE...
. Experience in building data pipelines using AWS/Databricks Advanced in Java/spring/SQL/Python/Spark Proficiency in automation...
communication skills. Preferred (Nice-to-Have) Qualifications: Exposure towards Spark architecture. Exposure to Snowflake...
and tooling such as Apache Airflow, Apache Spark, ect LI-LY1 This role will require the candidate to periodically undergo...
processing high-volume data Experience developing robust, distributed systems using frameworks like Apache Spark, Apache Flink..., and system design principles Bonus Points: Expertise in tuning and managing batch processing (Spark) and/or streaming...
that make that data available to other teams and systems. Your primary toolset in your work will be Java microservices, Spark... here will remain fully remote for likely 18-24 months) What You'll Do: Write highly fault-tolerant Java code within Apache Spark...