in Hadoop and Spark environments. Define long-term migration strategy, data partitioning, and retention policies aligned... pipelines using Spark, Kafka, Airflow, and Delta Lake. Build robust ETL/ELT frameworks to process transactional, behavioral...
in Hadoop and Spark environments. Define long-term migration strategy, data partitioning, and retention policies aligned... pipelines using Spark, Kafka, Airflow, and Delta Lake. Build robust ETL/ELT frameworks to process transactional, behavioral...
on you to source and channel data where it needs to be and how it needs to be organized to power daily operations and decisions... that power Finix's data analytics and reporting capabilities You are Detail-oriented, with a healthy dose of mistrust...
robust data management, governance, lineage tracking, and quality controls that power data-driven decision-making...), pipelines (Spark/Beam), cloud services;implement CDC and schema evolution-including embeddings and code-to-lineage inferences...
/ Power BI / Azure). Collaborate with data scientists, engineers, and business stakeholders to define project requirements..., Snowflake’s security model Data Visualization: Power BI, Angular Monitoring & Orchestration: Dagster, Airflow, Grafana...
/ Power BI / Azure). Collaborate with data scientists, engineers, and business stakeholders to define project requirements..., Snowflake's security model Data Visualization: Power BI, Angular Monitoring & Orchestration: Dagster, Airflow, Grafana...
Description As a Senior Data Engineer, you will work to build and maintain robust data systems that power a state-of-the-art analytics... programming languages like Python, SQL, and NoSQL databases, along with Apache Spark for data processing, dbt for data...
, infrastructure components, ETL/ELT, and reporting/analytic tools and environments (e.g., Apache Beam, Hadoop, Spark, Pig, Hive... the power of strategy, execution and partnership to accelerate digital transformational outcomes for organizations...
In the Technology division, we leverage innovation to build the connections and capabilities that power our Firm... to have: Dask, Ray, Spark, Clustering tech (Zookeeper, consul, etc.) OSS development or enterprise Python development experience...
Outfitters, and Carter's work with us to enable billions of interactions that power tens of billions in revenue for our customers...'s next-generation event streaming platform: Design high-throughput, low-latency solutions that power mission-critical messaging...