and building reliable, scalable data pipelines. Performance & Cost Optimization: Expertise in tuning Spark jobs, optimizing cluster... of designing and optimizing AI Agents. Cloud & Infrastructure: Deep knowledge of cloud architecture and services on AWS...
lifecycle in cloud environments. Proficient in Python and familiar with ML frameworks such as TensorFlow, PyTorch, and Scikit...-learn. Hands on experience with Databricks, including: Spark based data processing and feature engineering Databricks...
and reliability Translate legacy SQL and Spark logic to Snowflake and Iceberg Analyze data usage patterns to deliver data products... Spark experience ETL/ELT pipeline experience CI/CD and SDLC familiarity Kubernetes exposure Relevant degree Core Data...
Job Title: AWS Cloud Data Engineer Location: Reston, VA Interview: Virtual + In-person Hybrid Seeking a Lead..., maintaining and scaling cloud OR on-premise data solution and data platform with emphasis on reliability, automation...
Skills - Python, Spark, Azure Databricks, Snowflake, complex Sql query, AWS, Airflow Basic Qualifications... Experience with Databricks Experience with Snowflake a plus Deep Understanding of AWS or other cloud providers as well...
), Informatica PowerCenter, and Python-based frameworks Build and optimize scalable data processing solutions using Python, Spark... across relational platforms such asSnowflake, Oracle, and SQL Server Participate in cloud migration and modernization initiatives...
, Spring Boot, Spring Cloud, RESTful services, Kafka, Swagger, Spark, MongoDB, Flink, Ab Initio, Docker, Kubernetes... systems using industry-standard design patterns, practices and cloud strategies. Must possess ability to suggest...
For over 17 years, Trilyon has been a leader in global workforce solutions, specializing in Cloud Technology, AI/ML..., and ensuring data accuracy across large datasets. This role requires a hands-on Data Engineer V who can work with PySpark, Spark...
Big Data Architect (Spark): Extensive experience with Apache Spark for big data processing and analytics. Proficiency... in Spark Core, Spark SQL, Spark Streaming, and MLlib. Knowledge of distributed computing systems and frameworks. Familiarity...
and credentialize your skills with certifications Write high-quality code in SQL, Python, and Spark, and use software engineering...+ years' experience with dbt Core and/or dbt Cloud required Ability to manage an individual workstream independently...