Java, Microservices, Python, Spark, Snowflake, and AWS for Business Banking Data Products. Job Responsibilities.... Manage cloud development and deployment, supporting applications in both private andpublic clouds. Required Qualifications...
. We are looking for a highly skilled Data Engineer with a solid experience of building Bigdata, GCP Cloud based ETL Pipelines and Spark... development experience with Big Data & Analytics solutions Hadoop Hive, Spark, Python, shell scripting, GCP Cloud - Big Query...
-efficiency. Manage AWS resources including EC2, S3, Glue, Lambda, API's, IAM, Cloud Watch etc. Interface... Glue, Lambda, S3, EC2, CloudWatch, Cloud Trail. Dbt, Snowflake, SQL, Python, Qlik. Proficient in SQL, with the...
databases. A strong background in data engineering with experience in Hadoop, Spark, and Scala is also essential for effective... knowledge of Hadoop, Apache Spark, Python, and SQL. Expertise in Java, with experience in REST APIs, container-based...
with large-scale datasets to build and optimize data pipelines using AWS services such as EMR (Spark, Trino), S3, Glue, Athena... or related roles 3+ years experience with Python and SQL 3+ years hands-on experience with cloud platforms (AWS, Azure, or GCP...
understanding of containerization (Docker), orchestration (Kubernetes), and cloud platforms (AWS, Azure, GCP). Familiarity with SQL... and NoSQL databases and big data frameworks (Apache Kafka, Spark). Abilities: Good knowledge and experience with serverless...
. This is a backend engineering role, focused on Scala/Python/Java, distributed data platforms (Cloudera/Spark), and cloud based...) are consumers of the platform, not the core focus of this role. Work with massive transactional datasets, modern big data and cloud...
with cloud-based resources. The candidate must possess excellent written and verbal communication skills with the ability... Databricks with (ADLS), Power-BI, ADO, Key Vault Performance Optimization: Optimize Spark jobs, cluster configurations...
. Strong expertise in Databricks, Apache Spark, and Delta Lake. Proven experience designing secure, cloud-native architectures (AWS... in shaping and executing modern cloud-native architectures, ensuring secure, scalable, and innovative solutions that align...
Workflows, MLflow, Triton Inference Server Data Platforms: Kafka, Spark, NiFi, SQL/NoSQL, pgVector, Milvus Cloud... backend technologies, cloud-native architectures, and AI frameworks to continuously improve platform capabilities...