Senior Data Engineer
understanding of open-source distributed systems such as Kafka and Spark Expertise in scalable ETL pipelines and tools like SSIS...
understanding of open-source distributed systems such as Kafka and Spark Expertise in scalable ETL pipelines and tools like SSIS...
Title Java Backend + SQL + Spark (Banking/Finance domain) Location New York (Hybrid 3 to 5 days in the office... databases, strong SQL, Java, and Linux are essential. Working knowledge of big data technologies such as Spark is a plus. The...
such as Apache Hive, Apache Airflow, , Spark SQL , or AWS S3 and EC2 Knowledge of data visualization tools such as Tableau, Power...
for you to find your spark and grow with us. We want you to be happy and satisfied with your role and to really learn what type of work sparks...
Spark concepts, including performance tuning and troubleshooting. 8 Required Experience integrating Databricks with cloud...
Skills - Python, Spark, Azure Databricks, Snowflake, complex Sql query, AWS, Airflow Basic Qualifications...
, scikit-learn Hands-on experience with large-scale data processing & Spark optimization Strong understanding of A/B...
like Spark and/or cloud data platforms is preferred. Healthcare experience in a Payer or Provider/Hospital organization...
-scale data pipelines using Apache Spark on Databricks, Kafka, Stelo, and Azure Data Factory (ADF). The ideal candidate...
understanding of Elasticsearch architecture, shard management, query DSL, and cluster tuning. Experience with Spark for advanced...