, and metrics using Databricks SQL / Spark SQL. - Define clear data contracts between Silver and Gold layers. - Ensure...). - Basic knowledge of Spark. - Experience with Lakehouse architectures. - Knowledge of data governance, data quality...
methodologies - Exposure to big data frameworks like Spark or Hadoop - Certifications in relevant technologies or data-focused...
We are looking for a Lead Data DevOps Engineer to drive the migration of Spark, Flink, and additional services... - Develop, launch, and oversee Databricks infrastructure with Terraform to support scalable data operations - Enhance Spark...
- Familiarity with Big Data stacks such as Hadoop, Yarn, HDFS, MapReduce, Hive, Spark, and Kafka - Proficient in Python, Scala...
, Kafka, Spark, or similar - Experience with cloud + Dev Ops: AWS/GCP/Azure, Docker, CI/CD - Experience with analytics...
in Python, Scala, or Java with familiarity with Big Data tools like Hadoop, Spark, Hive, and Kafka - Expertise in data platform...
- Familiarity with Big Data technology stacks such as Hadoop, Yarn, HDFS, MapReduce, Hive, Spark, Kafka - Background in Python...
- Understanding of API design and integration principles - Familiarity with big data frameworks such as Hadoop or Spark...
in Big Data platforms, including tools from the Hadoop ecosystem such as HDFS, Hive, and Spark, as well as modern streaming...
and data processing with tools such as Apache Airflow and Apache Spark - Monitor industry trends and incorporate... Spark for workflow optimization and data processing - Strong proficiency with CI/CD tools such as Jenkins for efficient...