Manager Preferred qualifications, capabilities, and skills Familiarity of PySpark, DataBricks, Lake House architecture...
frameworks (e.g., Spark, Databricks) for performance and reliability ​Oversee CI/CD pipelines and DevOps practices for data... supporting DHS, USCG, or other federal cloud modernization efforts ​Experience with Databricks, Snowflake, or other cloud...
. SPECIALIZED SKILLS: Data Engineering Skills: Proficiency in SQL, PySpark, Python and Databricks platform. Data Modeling...
in data engineering and the Databricks ecosystem. Design and build robust ETL (Extract, Transform, Load) and ELT workflows... to ingest, transform, and load structured and unstructured data from various sources. Utilize Databricks features like Delta...
engineering toolsets (dbt, Dataform, Databricks, etc.) and familiarity with best practices and methodologies behind the tools...
troubleshooting, change management, and problem resolution in production environments. Hands-on experience with Databricks and Kafka...
Service Plans using Azure DevOps pipelines and Infrastructure as Code (IaC). • Azure Databricks: Provision and configure... Databricks workspaces, clusters, and jobs using ARM templates or Terraform. • Azure Data Lake Storage: Automate setup of Gen2...
integration into popular ML frameworks. Our products are being used at scale with external customers like Anthropic and Databricks...
within data engineering and analytics service ecosystems (e.g., Azure Data Factory, Synapse, Databricks, Redshift). Build... in Python/R, Spark/Kafka 8-10 years – Experience with Azure Databricks/Data Factory or similar technology 8-10 years...
Advanced proficiency in SQL, with hands-on experience using Databricks or similar data platforms Solid experience with data...