frameworks Translate legacy SQL logic into Spark-based transformations Define Delta Lake optimization strategy Establish... Strong expertise in Databricks & Delta Lake Advanced PySpark & Spark SQL Experience designing data pipelines from scratch...
understanding of open-source distributed systems such as Kafka and Spark Expertise in scalable ETL pipelines and tools like SSIS...
Job Title: Data Engineer (Python / Spark / AWS) on W2 Location: Richmond, VA / McLean, VA / Dallas, TX Onsite (LOCALS...) at VA or Dallas Tx Job Summary We are seeking talented and experienced Data Engineers with strong expertise in Python, Spark...
years) - ETL/Data Integration Design and Development experience using Java/Scala, Spark preferably on Cloudera Platform...
, Spark, Hive SQl, Hadoop and Kafka Proficiency in Hive and SQL optimization. Understanding of distributed systems and big... data architecture. Knowledge of streaming frameworks (Spark Streaming, Kafka Streams). Familiarity with data partitioning...
5 years). Hands-on experience with big data technologies such as Hadoop, Apache Spark, Hive, Kafka, and NoSQL databases... Qualifications: Proficiency in programming languages such as Python, Scala, or Java. Experience with Spark (Python/Scala) and SQL...
and understands how to develop DAGs Expert in Spark and Pyspark Willing to learn new cloud-based business apps and tools Hands...
-based access control (RBAC): 8 years. Proficiency with Apache Spark concepts, including performance tuning...
, Spark, Dataflow, etc. Familiarity with advanced topics such as reinforcement learning, generative models, or explainable...
Big Data Architect (Spark): Extensive experience with Apache Spark for big data processing and analytics. Proficiency... in Spark Core, Spark SQL, Spark Streaming, and MLlib. Knowledge of distributed computing systems and frameworks. Familiarity...