Airflow and Apache Spark - Stay informed on industry trends and best practices, integrating them into the Data Software..., including designing and implementing scalable data solutions - Advanced knowledge of Apache Airflow and Apache Spark...
in AWS and Databricks, as well as extensive knowledge of Big Data technologies such as Spark, Python, Airflow, and Scala/Java... of AWS and Databricks - Expert-level skills in Python, Airflow and Spark - Experience working with unstructured files...
, Spark, Kafka - Programming skills in Python, Scala, or Java with background in data mining, predictive analytics...
and storage - Experience with Apache Airflow, contributing to streamlined workflow orchestration - Familiarity with Apache Spark... collaboration within an international team Nice to have - Familiarity with DataBricks and Spark, further enhancing your ability...
in Big Data platforms, including tools from the Hadoop ecosystem such as HDFS, Hive, and Spark, as well as modern streaming...
the fine-tuning of data processing and workflow management through Apache Airflow and Apache Spark - Consistently assess... in Apache Airflow and Apache Spark, ensuring streamlined data processing and workflow management - Advanced familiarity...
professional with strong expertise in Apache Spark, Microsoft Azure, and Python. You will be contributing to a high-profile project... pipelines using Apache Spark, Microsoft Azure, and Python - Ensure data pipelines are robust, scalable, and easy to maintain...
databases, advanced SQL is required - Experience with Big Data platforms such as Apache Hadoop and Apache Spark, Databricks...
. Everyone has a voice We thrive on conversations that spark curiosity and empathy. No matter how big or how small, every voice is heard...
, including Hadoop tools like HDFS, Hive, and Spark, as well as modern streaming technologies such as Kafka, Flume, or Kinesis...