Job Description Databricks, Python, SQL, Spark Azure Data Engineering & ETL/ELT Pipelines Airflow/Luigi, Data Modeling Medallion Architecture...
massive datasets using cutting-edge technologies like Apache Spark, PySpark, and Hive within a dynamic cloud environment... & Maintenance: Design, build, and maintain highly scalable and efficient ETL/ELT data pipelines utilizing PySpark and Spark SQL...
Engineering Skilled in building scalable cloud data pipelines for high-volume manufacturing and IoT data using Spark, Kafka...
to see how you interact and what your thought process is when going through the code Must Have: Python, SQL, GCP(BQ), Spark, Airflow GCP... years of experience Python, Airflow, PySpark, Spark SQL, Spark Streaming, Scala, Relational/No SQL databases, Apache Kafka...
architecture, practical experience with cloud-based data platforms (preferably GCP with Databricks/Apache Spark... of experience with data pipeline and workflow management tools (e.G., Apache Spark(Dataproc), GCP Tools, Databricks, PySpark). 3...
with big data technologies such as Apache Spark or Hadoop. 4. Stay informed about the ethical implications of machine learning...
, Spark/H2O, GitLab, Vault, Rancher, etc. With regards Naveen | Talent Acquisition Rootshell Enterprise Technologies...
Morning Shift Availability Only 9 AM- 3 PM Be the Spark That Lights the Way - Join CMCS as an Integration...
drive Job Description Must Have Technical/Functional Skills 1. Strong experience in Kafka, Spark, Scala,SQL ,Hive...
should be on our W-2 Databricks Certified, Spark programming, Azure Data Factory, Strong SQL Skills Must Haves: 3. AI Agents & Genie... Rooms in Data Bricks 4. Azure Data Factory (ADF) --5 years 5. Strong understanding of SQL--5 years 6. Spark - 2 years...