) Advanced proficiency in SQL and Spark SQL for complex data validation, reconciliation, and root-cause analysis. 5) Hands...
memory configurations (JVM tuning). Data Integration: Design and build robust data pipelines using Kafka, Apache Spark... implementation and backend integration. Experience integrating with data streaming and big data tools (Apache Kafka, Spark). Strong...
with Spark, Hadoop, Kafka, and Airflow Experience with cloud platforms (AWS, Azure, or Google Cloud Platform) Expertise...
, SOLR, Hue, Spark, Hive, YARN, Zookeeper, and Postgres Strong technical knowledge: Unix/Linux;Database (Sybase/SQL/Oracle...
Creating/supporting Spark based processing, Kafka streaming Developing data flows using Kafka, Flink, and Spark streaming... with Hadoop and Google Cloud data solutions . Hands-on experience developing data flows using Kafka, Flink, and Spark streaming...
Understanding of Spark concepts distributed processing partitioning shuffles and their impact on data validation and test automation...
to align teams, spark ideas, and refine solutions Present and explain design decisions to stakeholders with clarity...
structures. Understanding of data warehousing concepts. Experience with big data technologies like Hadoop or Spark...
, Java, or C, Apache Spark, SQL, Snowflake, Hadoop, large-scale data processing, machine learning platforms, feature...
in SQL, Python, and Spark for data transformations and analysis. Hands on experience using Apache Kafka in ETL process...