Principal Data Engineer
processing technologies (e.g. Spark, Databricks, Apache Beam). - In-depth knowledge of data governance, quality, security...
processing technologies (e.g. Spark, Databricks, Apache Beam). - In-depth knowledge of data governance, quality, security...
to evaluation, deployment, and continuous improvement. Build data ingestion and processing pipelines leveraging Kafka, Spark, Flink... of data engineering tools and architectures (Kafka, Spark, Flink, Airflow, or similar). Proven experience deploying...
-compatible services Data Integration & Orchestration: OCI Data Integration, Data Flow (Apache Spark), Data Catalog, OCI Data...
with relational and non-relational (NoSQL) databases Experience with Big Data tools/pipelines: Hadoop (Pig, Hive), Spark...
Preferred Qualifications Experience with Kafka, Apache Spark, Lucene, Kubernetes and other big data technologies Hands...
and technologies around Big Data Processing, ETL, Relational Databases, Hadoop Ecosystem, Apache Crunch, Spark, Hive, and SQL...
and maintaining batch and real-time pipelines using technologies like Spark, Kafka. $163,200 - $223,200 a year The target base...
skills Experience with distributed computing platforms such as Spark and Hadoop (a plus) Health care experience, notably...
with Azure Databricks, Spark, Delta Lake, and Azure Data Lake. Strong in Python, PySpark, SQL, and API integrations (REST...
, Data Science or related role Expert knowledge of SQL, data modeling, Python and frameworks such as Spark, Storm, Airflow...