such as AWS, Azure, or GCP - Hands-on experience with big data tools like Hadoop, Spark, or Kafka - Familiarity with AI/ML...
level **Desirable**: - Hands-on experience with Apache Beam, Spark, or other ETL tools - Familiarity with database...
and streaming - Hands-on knowledge of Big Data technology stacks such as Hadoop, Yarn, HDFS, MapReduce, Hive, Spark, Kafka...
such as AWS, Azure, or GCP - Hands-on experience with big data tools like Hadoop, Spark, or Kafka - Familiarity with AI/ML-based...
, and Spark/PySpark queries for data filtering and transformation - Work with internal tools for data search and auto-labeling...) - Python (advanced) - Spark / PySpark (advanced) - Hands-on experience with Databricks - Understanding of ML workflows...
the fine-tuning of data processing and workflow management through Apache Airflow and Apache Spark - Consistently assess... in Apache Airflow and Apache Spark, ensuring streamlined data processing and workflow management - Advanced familiarity...
methodologies - Exposure to big data frameworks like Spark or Hadoop - Certifications in relevant technologies or data-focused...
, NoSQL, Hadoop, Spark, Kafka, Kinesis) experience - 5+ Experience delivering cloud projects or cloud based solutions - Able...
or Spark - Relevant certifications in areas such as data engineering or cloud computing...
We are seeking a Senior Data DevOps Engineer to join our team supporting the migration of Spark, Flink... scalable data workflows - Optimize Spark and Flink workflows and orchestrate jobs for efficient pipeline execution...