+years Certification needed: Not mandatory Must Have Skills: Python & Spark, advanced ML/statistical modeling, scalable... advanced Data Science, Machine Learning, and Generative AI with robust Data Engineering, particularly using Spark and AWS...
components such as Spark, Iceberg, Ranger, Sparkflow, Superset, and related services. Contribute to resilient, scalable... (Nice to Have) Experience with Apache/open-source ecosystem tools such as Ranger, Keycloak, Spark, Iceberg, DataHub...
such as Ranger, Keycloak, Spark, Iceberg, DataHub. Knowledge of S3-compatible object storage and large-scale distributed data...
such as Spark, Iceberg, Ranger, Sparkflow, Superset, and related services Contribute to resilient, scalable architecture... with Apache/open-source ecosystem tools such as Ranger, Keycloak, Spark, Iceberg, DataHub Knowledge of S3-compatible object...
(acquired) and GiveDirectly ( $300M revenue, fastest-growing NGO in the world) Backed by top investors including Spark...
with strong analytical skills. Technical Skills (Mandatory) Python (expert level) including PySpark / Spark for data engineering. Azure...
infrastructure in batch and streaming ETL using Azure Data Factory, Spark, Python, and Scala on Databricks Optimize data ingestion... SQL Servers using SSIS Expertise with Azure Data Factory, Spark, Python, and Scala on Databricks Experience working...
(expert level) including PySpark / Spark for data engineering. Azure Databricks with experience implementing Medallion...
(Hadoop, Spark is a plus). Job Description: 6+years of hands-on experience in Data Engineering. Strong expertise... (Hadoop, Spark is a plus). Strong analytical and problem solving skills. Excellent communication and stakeholder management...
evolution of an enterprise data processing framework built on Apache Spark. This role will focus on designing clean, composable... experience, education Deep experience with Apache Spark (Scala and/or Java;Python a plus) Proven success building reusable...