Lead Software Engineer - Scala, Spark, Java, Python
skills Experience with data structures and algorithms and efficient coding practices Experience with Spark and distributed...
skills Experience with data structures and algorithms and efficient coding practices Experience with Spark and distributed...
data technologies, including Apache Spark, for large-scale data processing and analytics. Expertise in building data...
, Prometheus Data Ingestion: Airbyte, Snowpipe Files & Streaming, Kafka, APIs Data Processing: Dataiku, Spark, Snowflake (streams...
, Prometheus Data Ingestion: Airbyte, Snowpipe Files & Streaming, Kafka, APIs Data Processing: Dataiku, Spark, Snowflake (streams...
applications on top of Apache Spark and Apache Flink that scale seamlessly to handle massive data volumes (multi-PB scale) Lead... experience with strong coding skills in Python and/or object-oriented Java 5+ years hands-on experience with Apache Spark...
, production-quality code Experience with a wide range of technologies, including SQL and NoSQL databases, Kafka, Spark, Airflow...
databases, Kafka, Spark, Airflow, or their equivalents Proficient in using cloud computing tools throughout the software...
programming languages like Python, SQL, and NoSQL databases, along with Apache Spark for data processing, dbt for data... technologies such as SQL, Python, PySpark, Spark, Scala, JSON, Kafka, DBT (Data Build Tool), Iceberg, Snowflake, Airflow, ADO...
, Spark GUI, Yarn Logs, ETL Metrics, and Grafana Experience with Containerization using Docker and Kubernetes Understanding... with Spark and Scala with a beginning understanding of DSaT MDF Experience with Enterprise Reporting Tool (Qlik or MicroStrategy...
Build the future, spark innovation and align your career with purpose. McKinstry is innovating the waste and climate...