, and VectorDBs Data Engineering & Analysis Handle large-scale training and inference using platforms like Databricks and PySpark... Perform statistical analysis, feature engineering, and dimensionality reduction (e.g., PCA, SVD, UMAP, t-SNE) Software...
is primarily focused on data engineering, it also supports business intelligence initiatives by assisting in building basic Power.... CORE RESPONSIBILITIES Data Ingestion & Storage (ADF, Databricks) Design, build, and maintain scalable ETL/ELT pipelines...
identifying practitioners for education on proper claims submissions. Software engineering is the application of engineering... per week. Primary Responsibilities: Relevant analysis, design, coding, engineering, testing, debugging, standards, methods...
/ Unstructured Data (NLP & GenAI) – Building low‑latency real‑time systems using deep learning, LLMs, prompt engineering, and agentic... engineering using PySpark and Big Data tools. Work on batch pipelines, model versioning, and experiment tracking. Develop cost...
(ADF, Databricks, ADLS Gen2, Synapse) and GCP (Composer, Data Fusion, Dataform, DataProc, BigQuery, GCS). Implement Fact... or initiatives. Lead design discussions, perform code reviews, and ensure adherence to engineering standards and best practices...
Job Description Must Have Technical/Functional Skills Technical Skills Deep expertise in Azure data services (Databricks, ADLS, ADF, Event Hub/Service... engineering teams and lead design reviews. Strong collaboration skills with PMs, compliance, business, and engineering...
cloud strategy, guiding engineering teams, and ensuring that solutions meet enterprise standards for scalability, security... hybrid data platforms using Azure services such as Azure Data Lake, ADF, Azure Databricks, Synapse, etc. Solution Design...
, Workflows, Unity Catalog). 3+ years of cloud data engineering experience on Microsoft Azure (ADF, ADLS Gen2, Synapse, Azure SQL... pipelines that power AI/ML models, including feature engineering, training data preparation, and inference feeds using...
cloud strategy, guiding engineering teams, and ensuring that solutions meet enterprise standards for scalability, security... hybrid data platforms using Azure services such as Azure Data Lake, ADF, Azure Databricks, Synapse, etc. Solution Design...
role bridges data engineering, operations, and DevOps practices to deliver reliable, high-quality, and timely data... with ETL/ELT tools (e.g., Informatica, Talend, DBT, Airflow, ADF). - Proficiency in SQL, data modelling, and performance...