The AI ML Analyst II implements and supports the minimum viable product data requirements within the data lake team... technical configuration aspects of the data lake, including the design and implementation of data ingestion and integration...
Lake structures (including JuP1 Data Lake). Collaborate with the Data Management team to uphold data governance standards...
The Data Engineer executes the work of implementing the technical solutions implemented in the data lake, as defined... solutions implemented in the data lake, as defined by the Data Analyst and validated by the Data Architect. Build new...
Lake structures (including JuP1 Data Lake). Collaborate with the Data Management team to uphold data governance standards...
experience with: o Azure Data Lake o Azure SQL Database o Azure Synapse Analytics (formerly SQL Data Warehouse... Azure Data Factory, Synapse Analytics, Azure SQL, and Data Lake environments through Terraform. Containerization...
, Key Vault, and Databricks (Spark, Delta Lake, Unity Catalog). Hands-on proficiency in PySpark and SQL...
field Defining APIs, and develop using Apigee Edge, node.js or Azure functions Store data in Azure Data Lake, SQL Server...
Comprehension: An understanding of data engineering workflows, REST API data pulls, and automated data lake ingestion pipelines...
-centric software engineers, preferably in financial services, in support of Data Lake houses (e.g. AWS, Databricks, Snowflake... including data governance and catalog solutions (e.g. Collibra, Alation, data platform and lake(house) (i.e. 'medallion...
optimization. Databricks: Delta Lake, Unity Catalog, Delta Live Tables (DLT), and Spark optimization. GCP: BigQuery, Dataflow...: Redshift, S3, Lake Formation, Glue, and Lambda. Professional Practices SDLC & DevOps: Proficient in Git workflows, CI/CD...