مهندس بيانات (Data Engineer)

Job Summary

The Data Engineer role involves building, configuring, and optimizing data ingestion, transformation, and consumption processes on a modern on-premises lakehouse platform, with a focus on Spark development and Informatica integration.

Responsibilities

• Design and develop scalable pipelines for data ingestion and transformation
• Build, optimize, and maintain ETL/ELT workloads using Spark
• Develop and manage data models and datasets with Apache Iceberg tables
• Implement and support data integration workflows via Informatica
• Enable data analytics and consumption using Denodo, Starburst, and/or Dremio
• Create secure, governed, and scalable data pipelines following enterprise standards
• Support batch and near real-time data processing needs
• Implement controls for data quality, metadata management, and validation

Must haves

• Experience with Apache Spark (PySpark and/or Scala Spark)
• Knowledge of Apache Iceberg
• Proficiency in Informatica Data Integration
• Familiarity with MinIO Object Storage
• Experience with Denodo
• Skills in SQL and Data Modeling

Nice to haves

• Experience with Starburst and/or Dremio
• Understanding of Data Governance and Metadata Management
• Knowledge of Data Quality Frameworks
• Familiarity with CI/CD for Data Pipelines

We refresh listings regularly, but some roles close early on the source platform.