capabilities supporting ecosystem components (Spark, Iceberg, Ranger, Superset, etc.). Contribute to resilient, scalable...
We are seeking an experienced Data Engineer with strong expertise in Databricks, Python, and Spark to design and build scalable data... Spark and PySpark. Key Responsibilities Design, develop, and maintain ETL/ELT data pipelines for large-scale data...
Develop and maintain platform capabilities supporting data ecosystem components such as Spark, Iceberg, Ranger, Sparkflow... with Apache/open-source ecosystem tools such as Ranger, Keycloak, Spark, Iceberg, DataHub Knowledge of S3-compatible object...
capabilities supporting data ecosystem components such as Spark, Iceberg, Ranger, Sparkflow, Superset, and related services... such as Ranger, Keycloak, Spark, Iceberg, DataHub Knowledge of S3-compatible object storage and large-scale distributed data...
, Confluence). Establish best practices for AWS, Data-bricks, Snowflake, and Spark-based processing. Collaboration & Delivery... experience building and optimising data pipelines. Spark / PySpark (nonnegotiable) - Spark SQL, Data Frames, distributed...
aligned with business requirements and definitions Write and review SQL, Python, and Spark code in Fabric notebooks for data.... Working experience with Python and Spark/PySpark in a notebook-based environment. Experience developing shared semantic...
, or STEM through the lens of Harry Potter, we match talented instructors with opportunities to share their skills and spark joy...
of experience required: 8+years Must Have Skills: Python & Spark, advanced ML/statistical modeling, scalable ETL/Big Data..., Machine Learning, and Generative AI with robust Data Engineering, particularly using Spark and AWS, to deliver scalable...
and frameworks. Kafka, Cassandra, Spark, and Hadoop Experience writing performant SQL code/stored procedures (Oracle/Sybase/SQL...
, Spark, Iceberg, DataHub. Knowledge of S3-compatible object storage and large-scale distributed data processing patterns.... Develop and maintain platform capabilities supporting data ecosystem components such as Spark, Iceberg, Ranger, Sparkflow...