ideal candidate will have hands-on experience in data engineering, database development, and cloud-based data solutions... pipelines Nice to Have Experience with Apache Spark Knowledge of Scala Experience Required 10+ years of experience...
experience in design, implement and maintain Python, Microservice, Spring Boot, Spring Cloud, RESTful services, Kafka, Swagger..., Spark, MongoDB, Flink, Ab Initio, Docker, Kubernetes technologies Strategize, Design data architecture for specific...
and application services using Cloud Run, Cloud Functions, and Cloud SQL. Apply distributed processing frameworks (Apache Spark, Beam... account products governed under stringent regulatory and compliance requirements. SAM operates in a multi-cloud, multi...
— that are trying to connect disparate systems, improve data reliability, or modernize pipelines for cloud-native analytics. You'll... Lake, Unity Catalog, and Spark — to improve pipeline efficiency and reduce operational overhead Collaborate...
, and Spark Streaming;developing and maintaining applications using AWS cloud services including Aurora, Hive, Splunk, AWS Glue... cloud-based big data warehouse using Cloud technologies including AWS, Azure, GCP, and Databricks. Create physical...
while maintaining strict oversight of iteration goals, sprint metrics in Jira, and program-level delivery commitments. Multi-Cloud... Architecture & Pipeline Governance: Govern the design, development, and optimization of distributed data pipelines on Cloud...
and best practices. What You Will Need to Succeed 4+ years as a software engineer Expertise in Python, Terraform, SQL, and Spark... Expertise in Cloud Architecture - AWS Preferred Expertise in Machine Learning Operations (Preferred) Expertise in Data Driven...
(terabytes/petabytes) across multiple data sources using structured query language(SQL), Python, Pytorch, Pyspark, R, Spark... and Scala. In a Cloud Native AWS environment. Deliver custom and commercial scalable solutions for internal and external...
, develop and optimize scalable, reliable data solutions to deliver reusable patterns using Google Cloud Platform (GCP) services...: Big Query, Dataflow, Dataform, Astronomer, Data Fusion, DataProc, Cloud Composer/Air Flow, Cloud SQL, Compute Engine...
services Experience working with Databricks, Spark, or cloud-based data platforms Experience with Python or similar backend... Engineer translates business requirements into full-stack solutions, integrating modern web applications with Databricks, Spark...