and supporting big data processing using modern tools and cloud platforms. The ideal candidate should have strong proficiency... and a strong understanding of data engineering concepts including ETL processes. Experience with big data technologies such as Spark or PySpark...
in data engineering, cloud platforms, and advanced analytics. This role is pivotal in designing, implementing, and optimizing.... **Key Responsibilities** - Design and implement scalable data platforms and pipelines using Databricks (including Spark...
in a Databricks lakehouse environment (e.g., Apache Spark, Delta Lake) to support scalable ingestion, transformation, and serving... data pipelines using Databricks (Spark) with Delta Lake tables and standard lakehouse patterns (e.g., bronze/silver/gold...
efforts for modernizing legacy data ingestion, ETL, and database systems to cloud-based solutions. Design and implement end...-to-end data architecture solutions using public cloud platforms, primarily AWS. Develop and execute cloud migration...
Role: L3 Cloudera Public Cloud Platform Engineer Work location: Remote Type: Contract 12+ years of experience... in Big Data Platform Engineering / Cloud Platform Operations / Infrastructure roles 6+ years of hands-on experience...
: Experience with FW, WAF, IPS/IDS, and SELinux. Data Infrastructure: Familiarity with Data tools like Kafka, Spark, Snowflake... or Data Lakes. Multi-Cloud: Familiarity with hybrid or multi-cloud architectures. The Perks: Join one of LA’s fastest...
with governed data sources. The role involves working with data pipelines, knowledge graphs, and modern cloud platforms to unlock... such as Airflow, dbt, or Spark, and experience with knowledge graph technologies like Neo4j is highly preferred. Exposure to AI/LLM...
-Frameworks: Apache Spark, Apache Airflow -Cloud services: AWS (Lambda, EC2, ECS, IAM, Athena, S3) -Deployment tools: Ansible...
, cluster policies, user access, integrations with cloud services, and ongoing platform monitoring to support enterprise data... and analytics initiatives. Required Skills: 8 Years of Experience administering Databricks workspaces in a cloud environment...
For over 16 years, Trilyon has been a leader in global workforce solutions, specializing in Cloud Technology, AI/ML... testing, and cloud-based CI/CD environments, along with a passion for building robust and scalable data validation systems...