, EKS, EC2, EMR Spark, AWS Glue, SageMaker, SQS, Lambda, Cloud Formation, and Terraform Experience with Flink stream...
, Prometheus Data Ingestion: Airbyte, Snowpipe Files & Streaming, Kafka, APIs Data Processing: Dataiku, Spark, Snowflake (streams...
, Prometheus Data Ingestion: Airbyte, Snowpipe Files & Streaming, Kafka, APIs Data Processing: Dataiku, Spark, Snowflake (streams...
applications on top of Apache Spark and Apache Flink that scale seamlessly to handle massive data volumes (multi-PB scale) Lead... experience with strong coding skills in Python and/or object-oriented Java 5+ years hands-on experience with Apache Spark...
, production-quality code Experience with a wide range of technologies, including SQL and NoSQL databases, Kafka, Spark, Airflow...
databases, Kafka, Spark, Airflow, or their equivalents Proficient in using cloud computing tools throughout the software...
programming languages like Python, SQL, and NoSQL databases, along with Apache Spark for data processing, dbt for data... technologies such as SQL, Python, PySpark, Spark, Scala, JSON, Kafka, DBT (Data Build Tool), Iceberg, Snowflake, Airflow, ADO...
, Spark GUI, Yarn Logs, ETL Metrics, and Grafana Experience with Containerization using Docker and Kubernetes Understanding... with Spark and Scala with a beginning understanding of DSaT MDF Experience with Enterprise Reporting Tool (Qlik or MicroStrategy...
Build the future, spark innovation and align your career with purpose. McKinstry is innovating the waste and climate...
and modern ML tooling (e.g., Spark, Airflow, Ray, SageMaker, Vertex, etc.). Demonstrated ability to translate complex analytical...