on AzureWrite and maintain data transformation logic (Python / SQL / Spark)Build KPI definitions and data models from provided DDR... pipelines~ Strong SQL and Python (Py Spark a plus)~ Hands-on experience with Azure Data Lake, Azure Data Factory, or Microsoft...
ingestion and transformation pipelines using Databricks, Delta Lake, and Spark , supporting large-scale data platform... Optimize Delta Lake table design, partitioning strategies, and storage layout for performance and scalability.Tune Spark...
., GitHub Copilot, Amazon Q). Strong Python for data engineering (Pandas, Spark/PySpark) and API Development (FastAPI...
Insurance Retirement plan Accident Insurance Wellbeing program Dental insurance Flex days Development platforms: Spark...
warehousing high-level principles and understanding of business intelligence. Experience working with Databricks and Apache Spark...
of modern data lake/lakehouse practices Handsâ€on experience with distributed processing (Spark/PySpark or equivalent...
everything with imagination to spark a sense of playfulness, discovery and adventure. This is not simply our job, it's our passion.About The...
knowledge of Python and Spark are required Good understanding of how to enable analytics using cloud technology and ML Ops...
– ASAPResponsibilities 8+ Years in engineering solutions using Py Spark and Python Strong SQL and framework development experience...
, SQL (complex queries, performance tuning), and Py Spark/Apache Spark.Data Modeling: Expert knowledge of data modeling (3..., Delta Live Tables (DLT), and Spark optimization.GCP: Big Query, Dataflow, Dataproc, Pub/Sub, and Cloud Functions.Azure...