Data Engineer
: Translating and optimizing legacy SQL and Spark-based consumption patterns (rawand modeled) for compatibility with Snowflake...
: Translating and optimizing legacy SQL and Spark-based consumption patterns (rawand modeled) for compatibility with Snowflake...
)- Development platforms: Spark, Harvard Manager Mentor and English Learning EF English Live School (EF)**More about us**:...
productivity (e.g., GitHub Copilot, Amazon Q). Strong Python for data engineering (Pandas, Spark/PySpark) and API Development...
, Seaborn, Familiarity with the Anaconda suite, etc);Azure (Databricks, Spark, Pyspark, SQL) or equivalent on other stacks...
: Spark, Harvard Manager Mentor and English Learning EF English Live School (EF)**More about us**:...
platforms (Dataiku, H2O, Azure ML)Knowledge of Cloud platforms (AWS, Azure, GCP)Familiarity with Big Data tools (Spark, Hadoop...
processing and transformation workflows using technologies such as Azure Spark, Azure SQL Pools / data warehouses or other cloud... such as Azure Spark, or cloud-native data processing services (Azure Data Lake, Azure Synapse, Azure SQL Pools and On-Demand...
with designing and maintaining data warehouses and/or data lakes with big data technologies such as Spark/Databricks, or distributed..., Airflow, Spark, Python OSS Data Ecosystem). - Knowledge of Software Engineering fundamentals and software development tooling...
challenges that span teams and technologies- Proficiency in tools and technologies such as Python, SQL, Spark, and data...
- Dental insurance. - Flex days. - Employee Assistance Program (PAE). - Development platforms: Spark, Harvard Manager Mentor...