working with Hadoop, Spark, Hive, and related processing frameworks. Strong SQL skills and understanding of data warehousing...
PowerCenter, various scripting languages, SQL, querying tools Data management tools and platforms including Spark, Hadoop/Hive...
platforms Strong experience with Apache Spark for large-scale data processing Familiarity with optimizing AWS Glue... jobs for performance and cost-efficiency Proficiency with PySpark including DataFrames, Spark SQL, and Spark Streaming Experience...
and PySpark Experience with AWS cloud technologies Strong knowledge of SQL and PySQL Experience with Spark, Flink, Kafka...
Optional Databricks or Azure or Spark experience for large scale runs Understanding of VaR and stress and PFE concepts... Follow Keywords Model Risk, Quant Developer, Python, SQL, Spark, Databricks, Azure, VaR, Stress Testing, Benchmarking...
issues, cluster stability, Spark optimization, and configuration management. Collaborate with the team to enable advanced... certification and 2+ years of experience maintaining Databricks platform and development in Spark Ability to work directly...
such as TensorFlow, PyTorch, and scikit-learn. Knowledge of data processing and analytics tools such as SQL, Hadoop, Spark, and Apache...
in Build and optimize ETL workflows using tools/technologies such as Spark, Snowflake, Airflow and/or Azure Data factory, Glue...
controls Orchestrate multimodal pipelines** using scalable frameworks (e.g., Apache Spark, PySpark) for automated ETL/ELT...
their skills and spark joy in the next generation. Our mission is simple but powerful: “to infuse every community with high...