Extensive experience with (py)Spark, Python, JSON, and SQL Experience integrating data from semi-structured and unstructured... with Databricks and optimizing Spark clusters Experience architecting web ecosystems from the ground up, including monolith vs...
Extensive experience with (py)Spark, Python, JSON, and SQL Experience integrating data from semi-structured and unstructured... with Databricks and optimizing Spark clusters Experience architecting web ecosystems from the ground up, including monolith vs...
, MySQL, MongoDB, Redis, Snowflake and Redshift 4+ years of experience building data pipelines using Spark, Kafka, Airflow...
such as Apache Spark, Hadoop, and Kafka. - Work within cloud environments like AWS or Azure to leverage services including..., Dataiku, and AWS native data offerings - Solid experience with big data technologies (Apache Spark, Hadoop, Kafka) and cloud...
Requirements: Design and optimize Data Pipelines using Spark, Hudi, EMR cloud services, and Kubernetes containers...
applications; - Implementing data warehouse and ETL processes using Hive, Spark, Hadoop, or SQL Server to optimize the data...
and building highly scalable and reliable data pipelines using BigData stack (e.g Airflow, DBT, Spark, Hive, Parquet/ORC, Protobuf...
of inclusivity in which the power and potential of every individual can be unleashed. We spark ideas that lead to positive impact...
data sets using SQL/Hive or Spark. Experience analyzing large datasets using one of the following programming languages...: Python, R, SQL, or Spark. Experience generating and visualizing data-based insights in Tableau. Experience with data mining...
pipelines using cutting-edge big data technologies such as Spark, Kafka, Apache Airflow, Apache NiFi, Hadoop, and Hive...