The AI ML Analyst II implements and supports the minimum viable product data requirements within the data lake team... technical configuration aspects of the data lake, including the design and implementation of data ingestion and integration...
Lake structures (including JuP1 Data Lake). Collaborate with the Data Management team to uphold data governance standards...
Lake structures (including JuP1 Data Lake). Collaborate with the Data Management team to uphold data governance standards...
with Azure Data Lake, Databricks, or cloud-based data platforms. Product Management certifications such as CSPO, Pragmatic...
experience with: o Azure Data Lake o Azure SQL Database o Azure Synapse Analytics (formerly SQL Data Warehouse... Azure Data Factory, Synapse Analytics, Azure SQL, and Data Lake environments through Terraform. Containerization...
, Key Vault, and Databricks (Spark, Delta Lake, Unity Catalog). Hands-on proficiency in PySpark and SQL...
field Defining APIs, and develop using Apigee Edge, node.js or Azure functions Store data in Azure Data Lake, SQL Server...
Comprehension: An understanding of data engineering workflows, REST API data pulls, and automated data lake ingestion pipelines...
optimization. Databricks: Delta Lake, Unity Catalog, Delta Live Tables (DLT), and Spark optimization. GCP: BigQuery, Dataflow...: Redshift, S3, Lake Formation, Glue, and Lambda. Professional Practices SDLC & DevOps: Proficient in Git workflows, CI/CD...
-centric software engineers, preferably in financial services, in support of Data Lake houses (e.g. AWS, Databricks, Snowflake... including data governance and catalog solutions (e.g. Collibra, Alation, data platform and lake(house) (i.e. 'medallion...