and architecture of scalable, cloud-based data platforms built on Databricks, Apache Spark, and Delta Lake Define and evolve data... & Implementation Design, build, and maintain production-grade ETL/ELT pipelines using Databricks, Spark, SQL, and Python Implement...
databases and Cloud based data warehousing services such as Redshift and Snowflake Share your passion for staying on top..., and mentoring other members of the engineering community Collaborate with digital product managers, and deliver robust cloud-based...
confidentiality Ability to pick up new tools and concepts quickly such as building depth in Spark, ML engineering, and enterprise... management in cloud environments, including Databricks Experience using PyTorch and transformer-based models Experience leading...
+Months) Pay Range : $50 - 65/Hr Skills: Data Modeling, Spark, Map Reduce, DataBricks, Azure. Job Description: Minimum... of 5 years of hands-on data engineering experience using distributed computing approaches (Spark, Map Reduce, DataBricks...
databases. A strong background in data engineering with experience in Hadoop, Spark, and Scala is also essential for effective... knowledge of Hadoop, Apache Spark, Python, and SQL. Expertise in Java, with experience in REST APIs, container-based...
data tools and workflows (Apache Spark, Kafka, Airflow) in multi-cloud environments. Experience implementing automated... Cloud and the ability to operate effectively in multi-cloud environments to join the IDT&S Simplify & Streamline team...
., Apache Spark, Hadoop). Experience with cloud platforms (AWS, Azure, GCP) and data services, such as AWS Redshift, Azure... Synapse, or Google BigQuery. Knowledge of big data technologies, including Hadoop, Spark, Kafka, and HBase, with experience...
. Implement and optimize data storage solutions using cloud platforms and big data technologies such as Apache Spark and Kafka... Spark and Apache Kafka. Understanding of data governance, data quality frameworks, and regulatory requirements related...
., OPC UA, MQTT, MES) into cloud platforms with Python, SQL, Spark/Databricks, and AWS S3. include schema/contract management... in cloud data platforms. Required: Databricks (Spark, Delta Lake, Databricks Workflows) and experience optimizing PySpark...
and resolve performance issues in Kafka and Spark applications Lead knowledge-sharing initiatives to promote adoption of new...) Strong understanding of AWS cloud architectures Experience with data enrichment, transformation, and optimization Skilled in debugging...