Data Scientist
learning, and experience in Databricks Lakehouse (Delta tables, Spark SQL, notebooks, workflows). Ability to integrate...
learning, and experience in Databricks Lakehouse (Delta tables, Spark SQL, notebooks, workflows). Ability to integrate...
. Responsibilities Build and maintain data pipelines using Databricks and Microsoft Fabric Support and optimize SQL Server... Qualifications Experience administering SQL Server (tuning, backups, security, HA/DR) Hands-on Databricks experience (Spark...
and performance. Utilize the Databricks Feature Store to manage and share model features, ensuring consistency and reusability.... Design and build models for automated retraining and deployment using Databricks Jobs & Workflows. Collaborate...
Azure Data Factory (ADF) for building and orchestrating ETL/ELT pipelines. Azure Databricks (using PySpark or Scala...
Service Plans using Azure DevOps pipelines and Infrastructure as Code (IaC). • Azure Databricks: Provision and configure... Databricks workspaces, clusters, and jobs using ARM templates or Terraform. • Azure Data Lake Storage: Automate setup of Gen2...
must include: Python Spark Machine Learning MLOps Airflow Big Data Databricks AWS API CI/CD...
ingestion, transformation, and pipeline development using Azure Data Factory, Azure Synapse Analytics, and Azure Databricks..., Azure Databricks, or Power BI. Experience with Power Platform tools (Power Apps, Power Automate) for AI integration...
integration. Experience with multiple data lake/ lakehouse platforms Microsoft Fabric, Microsoft Azure, Databricks, Snowflake...
. Our products are being used at scale with external customers like Anthropic and Databricks as well as internal customers like Alexa...
, and scalable data workflows. The ideal candidate has deep expertise in the modern data ecosystem (Druid, Databricks, dbt, Redshift..., Databricks, dbt, and Amazon Redshift Manage and optimize distributed data systems for real-time, batch, and analytical workloads...