Senior Data Quality Engineer
Technical Skills: Programming: Python, node.js, SQL Data Technologies: Apache Spark, Kafka, Delta Lake, Databricks, Looker...
Technical Skills: Programming: Python, node.js, SQL Data Technologies: Apache Spark, Kafka, Delta Lake, Databricks, Looker...
, sprint planning, and architectural discussions. Stay current on emerging technologies in data engineering, ML infrastructure... such as Spark, Hadoop, Oracle, or AWS S3. Advanced proficiency in SQL, with experience in databases like SQL Server, MySQL...
Strong experience with big data stack (Spark, PySpark, Hadoop, HIVE, BigQuery, Pub/Sub) in building scalable ETL pipelines Excellent... technical issues Aptitude to independently learn new technologies, prototype, and propose solutions Advanced English level...
) and Airflow (MWAA, AWS-native orchestration) Hadoop/Hive experience, Spark experience (including PySpark) BI experience: Tableau... and collaboration skills, PowerPoint /presentation skills Ability to learn new technologies and skills to incorporate into existing...
with cloud platforms like AWS and Databricks, as well as big data technologies (e.g., Spark, Kafka). Strong proficiency in SQL..., selecting the right technologies to meet business needs. Drive Technical Product Ownership: You will manage the technical...
of Apache Spark ecosystem, including ETL pipelines, data transformations and optimisation Become familiar with the multiple... equivalent Proficiency in developing large scale data processing applications using Apache Spark with Scala including ETL...
and reporting technologies: Azure, Databricks, Unity Catalog, Python, Spark, PySpark, Airflow, MicroStrategy, Tableau...
of Apache Spark ecosystem, including ETL pipelines, data transformations and optimisation Become familiar with the multiple... equivalent Proficiency in developing large scale data processing applications using Apache Spark with Scala including ETL...
Description Do you have Data Warehousing, Hadoop/Spark/EMR, Machine Learning and/or Real Time Event Processing... to have an impact in the development and use of new data analytics technologies? Would you like a career that gives you opportunities...
of data, data systems, data architecture, and data storage. A bias towards self-education of new technologies, techniques... or other data integration/ETL tools. Design and implement scalable Hadoop-based data workflows using HDFS, Hive, and Spark...