Data Engineer

About the Role:

We are seeking a seasoned Data Engineer based in Dubai with 8–10 years of experience to design, build, and optimize scalable data platforms. You will leverage Databricks and SQL to develop robust ETL pipelines, ensure data quality, and support analytics and BI initiatives. In this role, you will collaborate with cross-functional teams to translate business requirements into technical solutions and mentor junior engineers.

Responsibilities:

• Design, develop, and maintain scalable ETL pipelines using Databricks and Spark
• Write, optimize, and troubleshoot complex SQL queries for data extraction and transformation
• Collaborate with data analysts, scientists, and stakeholders to gather requirements and deliver data solutions
• Implement data modeling, schema design, and metadata management best practices
• Monitor data pipeline performance, identify bottlenecks, and implement optimizations
• Ensure data quality, integrity, and security through automated testing and validation
• Document data flows, architecture diagrams, and operational processes
• Mentor and coach junior data engineers, sharing best practices and conducting code reviews

Required Qualifications:

• 8–10 years of professional data engineering experience
• Proficiency in Databricks and Apache Spark for large-scale data processing
• Expert-level SQL skills for query writing, tuning, and optimization
• Strong programming experience in Python or Scala
• Hands-on experience designing and implementing ETL pipelines
• Solid understanding of data modeling, warehousing concepts, and metadata management
• Experience working with cloud platforms such as Azure or AWS
• Excellent problem-solving, communication, and stakeholder management skills

Preferred Qualifications:

• Experience with Snowflake or other cloud data warehouses
• Familiarity with real-time data streaming technologies (e.g., Kafka)
• Certifications in Azure Data Engineer or AWS Data Analytics
• Knowledge of data governance, lineage, and compliance frameworks
• Exposure to containerization and orchestration tools (Docker, Kubernetes)
• Experience in agile software development and DevOps practices