Lead Data Engineer
Level : Bachelor's Degree Skill Required : Data-Databricks Data platform with Spark, Python/Scala/Java, Kafka, HDFS, Hive...
Level : Bachelor's Degree Skill Required : Data-Databricks Data platform with Spark, Python/Scala/Java, Kafka, HDFS, Hive...
cloud tools. Experience with Databricks, PySpark, Spark SQL, or enterprise data engineering. Experience with PDF...
concepts. Experience with big data and distributed systems (Spark, Hadoop, etc.) Hands-on experience with cloud platforms (AWS...
, measurement, and real-time analytics. Requires strong Data Streaming, Python, and Spark skills plus proven experience delivering... across ingestion, ETL/ELT, streaming, storage, and Data Science models using Spark, Kafka and Python. Partner cross-functionally...
with Databricks and core data engineering tools (SQL, Python, Spark;Hadoop familiarity acceptable) Experience designing and building...
scalable ETL and streaming data pipelines. Develop data processing solutions using Spark (PySpark or Java). Work with AWS... with Spark (PySpark preferred) and ETL/streaming pipeline development. Proficiency in Python (preferred) or Java. Experience...
through production Strong hands-on expertise with: Apache Spark Scala SQL Deep experience with Azure Synapse Analytics...
and Spark/Scala for classical statistical analysis and data modeling, machine learning and ETL processes. Intermediate... programming and analytics languages (Python, R, Spark/Scala) and various open source machine learning and analytics packages...
with AWS data services (Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway, etc.). Proficient...
data silos Experience with Medallion Architecture , Delta Lake, and Spark-based data engineering Hands-on with Microsoft...