Job Title: Data Engineer – Spark & Real-Time Data Processing Location: Richmond, VA Duration: 6 Months Role... Overview We are seeking an experienced Data Engineer with strong expertise in Apache Spark–based ETL pipelines and real-time...
., AWS Glue, Apache Spark) 75761 EEO Statement Apollo Professional Solutions, Inc. is an equal opportunity employer...
on W2. 10 years of experience in big data and distributed computing. Strong hands-on experience with PySpark, Apache Spark.... Optimize Spark performance through partitioning, caching, and tuning. Implement best practices in data engineering (CI/CD...
with GitHub Copilot or similar AI tools Familiarity with SQL, Databricks/Spark, and event-driven architectures Knowledge...
in working with popular web application frameworks like Play and Spark Relevant Knowledge of Java GUI frameworks like Swing, SWT...
Redis / Memcached Airflow or Prefect Snowflake, Databricks, or Spark Strong background in performance tuning...
and real time data streaming using ADF, Spark and Confluent Kafka. · Develop and maintain data quality checks, monitoring...
on application functionality Advanced knowledge in Spark transformations, database query tuning, and performance optimization... and authorization frameworks Monitor and manage ADF Synapse pipelines Produce unit tests for Spark transformations Debug and enhance...
, and stakeholder collaboration skills Nice to Have: Knowledge of Apache Spark, Splunk, and modern data frameworks Experience...
: build trust, spark conversation, and strengthen brand affinity. 2. Reporting You'll track engagement, surface platform...