Java, Spring, AWS, Kubernetes, Kafka, MQ, Cassandra, Oracle, Spark, Control-M, Cloud Foundry, Kubernetes, PowerMock, JMeter..., capabilities, and skills Experience with distributed platforms such as Amazon Web Services Elastic MapReduce and Apache Spark...
data processing technologies and modern analytics ecosystems. Familiarity with Databricks, Apache Spark, and cloud-based...
to end data pipelines for batch and real time processing using Apache Spark and PySpark. Develop scalable data ingestion.... Troubleshoot Spark performance, query optimization, and workload management. Automate data validation, monitoring, and governance...
using Apache Spark (PySpark / Scala) Implement Medallion Architecture (Bronze, Silver, Gold) Develop batch and real-time...
, data visualization, or big data platforms (e.g., Tableau, Hadoop, Spark, AWS, Azure, Google Cloud) Ability to travel up...., SQL, Python, R, Java, Tableau, Power BI, Hadoop, Spark, AWS, Azure, Google Cloud, machine learning frameworks...
migration paths. Distributed data engines: PySpark/Spark (for off-platform processing), Airflow. Observability & SRE: SLA/SLO...
code Hands on experience in Spark Pools, Spark Should be able to merge data/delta loads through Notebooks...
systems, and data pipelines using PostgreSQL, Redis, Spark, Delta Lake, and SQL. Build and integrate Azure OpenAI, RAG...
performance of databases and queries to meet business needs. Implement data processing frameworks e.g., Hadoop, Spark to process.... Spark. Data Modeling. Data Architecture. Qualification And Education: Bachelor's degree in computer science...
compute frameworks (Spark, Ray, Dask) for feature/dataset generation. Familiarity with workflow orchestration tools (Airflow...