Senior Data Engineer (Remote)
frameworks (e.g., Spark) to build high-performance data systems. Design and maintain metadata, lineage, and documentation...
frameworks (e.g., Spark) to build high-performance data systems. Design and maintain metadata, lineage, and documentation...
techniques and aggregation of data at scale from multiple source systems. Highly advanced SQL skills, Python skills, Spark... and tools including Spark, Hadoop and AWS Data Services. Designing and developing data model schema definitions/ ontologies...
/code pipelines using Azure Databricks, Apache Spark, and Scala Collaborate with architects, data engineers and business... stakeholders to understand data requirements and deliver high-quality data solutions Optimize and tune Spark applications...
ecosystems (e.g., Spark, Hadoop) and UNIX commands / scripting - Understanding of best-in-class AI techniques to customize... - Ability to develop end-to-end ML solutions, including NLU/LLM modeling - Proficiency in Python, SQL, Spark - Strong ability...
Data Factory, Spark, Kusto, and more. Provide hands-on technical leadership: prototype in code, review designs and Pull... frameworks such as Apache Spark, Databricks, or similar technologies to transform and manage large-scale datasets. Design, build...
experience. Familiarity with Kubernetes/OKE, Redis, TimesTen, or lakehouse patterns (Object Storage + Spark/Trino). Work...
Models (LLM) Experience with Distributed data and computing tools, including MapReduce, Hadoop, Hive, EMR, Kafka, Spark...
with distributed computing frameworks (Spark, Ray);Experience in educational technology or higher education settings;Publications...
, they spark discovery, innovation and creativity. Among other efforts, our 11 employee resource groups (ERGs) enhance a culture...
/code pipelines using Azure Databricks, Apache Spark, and Scala Collaborate with architects, data engineers and business... stakeholders to understand data requirements and deliver high-quality data solutions Optimize and tune Spark applications...