Job Summary
The Data Engineer role involves building, configuring, and optimizing data ingestion, transformation, and consumption processes on a modern on-premises lakehouse platform, with a focus on Spark development and Informatica integration.
Responsibilities
- Design and develop scalable pipelines for data ingestion and transformation
- Build, optimize, and maintain ETL/ELT workloads using Spark
- Develop and manage data models and datasets with Apache Iceberg tables
- Implement and support data integration workflows via Informatica
- Enable data analytics and consumption using Denodo, Starburst, and/or Dremio
- Create secure, governed, and scalable data pipelines following enterprise standards
- Support batch and near real-time data processing needs
- Implement controls for data quality, metadata management, and validation
Must haves
- Experience with Apache Spark (PySpark and/or Scala Spark)
- Knowledge of Apache Iceberg
- Proficiency in Informatica Data Integration
- Familiarity with MinIO Object Storage
- Experience with Denodo
- Skills in SQL and Data Modeling
Nice to haves
- Experience with Starburst and/or Dremio
- Understanding of Data Governance and Metadata Management
- Knowledge of Data Quality Frameworks
- Familiarity with CI/CD for Data Pipelines
We refresh listings regularly, but some roles close early on the source platform.
Country: Saudi Arabia
City: Riyadh
Job Category: Data Engineering
Job Type: Full Time
Company Name: Datamatics Technologies
