applications Build and optimize distributed systems leveraging big data technologies such as Spark, Hive, and Presto Develop high... technologies (e.g., Spark, Hadoop ecosystem, Presto/Trino) 3+years of experience building and consuming RESTful APIs...
those that apply to a big data environment Experience with Python scripting, Spark SQL, and PySpark Pay range: up to $89.95 per hour...
, Spark pools, pipelines), Azure Data Factory (pipelines, triggers, data flows), would be beneficial as well. Azure Data Lake...
Apply strong expertise in AWS, Python, Spark, SQL, data integration patterns, infrastructure as code, containerization, and DevOps... Code Knowledge: Python, Apache Spark, SQL Experience with Agile methodologies/DevOps environment Strong understanding...
to Azure Synapse Analytics (SQL pools, Spark pools, pipelines), Azure Data Factory (pipelines, triggers, data flows...
such as Apache Spark, Hadoop, or Kafka. Performance Tuning and Automation: Hands-on experience in performance tuning, including...
experience, training, military experience, or education. 5–7 years with Apache Spark for big data processing. 3 years... & Qualifications Experience supporting data-heavy financial or regulated environments preferred. Proficiency in Spark frameworks...
expertise in distributed microservices, big-data technologies (HIVE, Presto, Spark, Hadoop, etc.) and full-stack systems... data technologies (e.g. Hadoop, Spark, Presto) 3+years' REST/web services experience and writing complex SQL queries...
such as Workshop, Slate, or Quiver Experience in enterprise-scale or data-heavy environments Familiarity with Spark / PySpark / data...
. Architect our internal transformation framework using open-source tooling (Delta Live Tables or custom Python/SQL Spark... expert — analyze Spark execution plans and Spark UI to diagnose bottlenecks, reduce data skew, and optimize join strategies...