supporting NextGen Platforms built around Big Data Technologies, including Hadoop, Spark, Kafka, Impala, HBase, and Docker... Hadoop components such as HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, Zookeeper, and Postgres...
in Azure, with strong hands-on skills in Databricks, Spark, Python, and cloud-based DataOps practices. The Data Engineer... as an enterprise asset. This role also supports cloud infrastructure automation and CI/CD using Terraform, GitHub, and GitHub Actions...
workflows and integrate data across cloud & on prem systems Collaborate with engineering, IT, and data science teams to create...) Hands?on with OCI, Azure, GCP + big data tools (Spark, Hadoop, Kafka, Databricks) Familiarity with industrial data...
and deep expertise in AWS cloud services. This role will focus on designing, building, and guiding scalable cloud-native... requirements into scalable, secure application architecture Lead cloud solution design using AWS services and modern development...
. - Define standards for: Programming languages and frameworks. Cloud vs on-prem deployments. Security, privacy...: Relational & NoSQL databases. Big data frameworks (Spark, Hive, Databricks). - MLOps & Deployment: Model lifecycle management...
of experience in developing big data applications in Cloud (AWS, Azure, Google Cloud) Proven experience in building and maintaining... Processing (Flink, Kinesis Analytics, Spark), data movement technologies (ETL/ELT), REST APIs and in-memory technologies...
of cutting-edge big data solutions and cloud technologies. As a key member of our team, you'll collaborate on building... (DynamoDB, Elasticsearch) Proficiency in developing highly scalable distributed systems in cloud environments (AWS/Azure...
. Experience with LangChain, LlamaIndex, Hugging Face Transformers, and OpenAI API Experience with Apache Spark, Kafka, or modern... with TensorFlow, PyTorch, or Hugging Face Familiarity with cloud platforms (AWS, GCP, Azure), CI/CD, Docker, and Kubernetes. Key...
) Some Spark exposure preferred AWS familiarity (Lambda, Fargate, cloud deployment/tracing) Prior work experience at client... and analysis Collaborate with cross-functional teams to design and implement new features Utilize cloud technologies to enhance...
. Proficiency in Java, Spring Boot, and Spark for large-scale data processing. Familiarity with cloud services like AWS, GCP... years for Lead position) 4+ years of experience building scalable data pipelines using Spark in combination with Java...