Job Description
About the Role:
We are seeking a skilled Data Engineer to join our growing team in Abu Dhabi. In this role, you will design, build, and maintain robust, scalable data pipelines and platforms that support analytics and reporting. You will work closely with data scientists, analysts, and stakeholders to ensure data accessibility, quality, and performance across our Azure-based ecosystem.
Responsibilities:
- Design, develop, and maintain ETL/ELT pipelines using Apache NiFi and Apache Airflow
- Implement real-time streaming data solutions with Apache Kafka, Spark Structured Streaming, and Apache Flink
- Ingest data via change data capture (CDC) tools and manage data formats such as JSON, Avro, and Parquet
- Build and optimize data lake architectures on Azure Data Lake Storage and Databricks, including Delta Lake implementations
- Develop and enforce data modeling standards and best practices for structured and semi-structured data
- Collaborate with cross-functional teams to translate business requirements into technical solutions
- Monitor, troubleshoot, and optimize data pipelines for reliability, performance, and cost efficiency
- Ensure data quality, governance, and security standards are followed throughout the data lifecycle
Required Qualifications:
- Bachelor’s degree in Computer Science, Engineering, or related field
- 4–7 years of professional data engineering experience
- Proficiency in Python and advanced SQL query writing
- Hands-on experience with Apache NiFi for data ingestion
- Strong expertise in Apache Kafka, Spark, Flink, and Airflow
- Experience implementing CDC solutions and working with common data formats (JSON, Avro, Parquet)
- In-depth knowledge of Azure services, including Data Lake Storage, Databricks, and Delta Lake
- Solid understanding of data modeling principles and best practices
- Experience with version control systems such as Git
- Excellent problem-solving, communication, and collaboration skills
Preferred Qualifications:
- Azure Data Engineer Associate or equivalent certification
- Experience with containerization (Docker) and orchestration (Kubernetes)
- Familiarity with CI/CD pipelines for data workflows
- Knowledge of data governance, cataloging, and security frameworks
- Experience with machine learning pipelines or MLOps
- Domain experience in finance, healthcare, or telecommunications
Position Details
- Position Title: DATA ENGINEER
- Location: Abudhabi, United Arab Emirates
- Experience Required: 4+ years
