Senior Data Engineer

Job Summary

The Senior Data Engineer at DataHub Analytics in Amman is responsible for designing, developing, and optimizing scalable data pipelines and integration solutions using technologies such as Python, Apache Spark, Apache Kafka, and SQL. This role supports regional expansion and AI-driven growth initiatives.

Responsibilities

• Design and maintain scalable ETL/ELT data pipelines.
• Develop and optimize data processing solutions with Python and Apache Spark.
• Create and manage real-time and near-real-time data pipelines using Apache Kafka.
• Write and optimize complex SQL queries and data transformations.
• Integrate data from various structured and unstructured sources.
• Ensure data quality, reliability, and performance in large-scale environments.
• Troubleshoot pipeline failures, performance issues, and data inconsistencies.
• Implement monitoring, logging, error handling, and recovery processes.

Must haves

• 4+ years of experience in Data Engineering, ETL, or Data Integration.
• Proven experience developing ETL/ELT pipelines.
• Proficiency in Python and SQL.
• Hands-on experience with Apache Spark and distributed data processing.
• Experience with Apache Kafka or similar event-streaming technologies.
• Strong knowledge of relational databases, data warehouses, and data modeling.

Nice to haves

• Experience with Java.
• Familiarity with Apache NiFi and data flow management.
• Knowledge of cloud platforms like AWS, Azure, or GCP.
• Experience with Apache Airflow or similar orchestration tools.

We refresh listings regularly, but some roles close early on the source platform.