Senior Data Engineer

Role Overview

We are looking for an experienced Senior Data Engineer to support and maintain enterprise-level data engineering platforms and ensure smooth operation of ETL, data quality, metadata, and governance systems.

Key Responsibilities

• Manage and support enterprise data engineering platforms including ETL workflows, data quality, metadata, and governance services.
• Develop, monitor, troubleshoot, and optimize Informatica workflows, mappings, applications, and data pipelines to ensure optimal performance.
• Administer Informatica components such as domains, nodes, repositories, Integration Services, and associated application services.
• Provide support for Informatica PowerCenter, BDM or DEI, IDQ, and EDC or Axon in both production and non-production environments.
• Investigate failures, data-quality issues, performance bottlenecks, and platform incidents; conduct root cause analyses and implement corrective solutions.
• Maintain and support Cloudera Hadoop services and handle data processing tasks involving HDFS, Hive, Spark, and PySpark workloads.
• Perform deployments and migrations across development, QA, UAT, and production environments to maintain system integrity.
• Utilize Linux, shell scripting, and SQL to automate routine tasks, validate datasets, and troubleshoot platform problems efficiently.
• Manage user access and security permissions adhering to established controls and operational procedures.
• Coordinate resolution of incidents and plan changes in collaboration with application, database, infrastructure, business intelligence teams, and stakeholders.
• Maintain comprehensive operational documentation including handover notes, change records, and support procedures.

Technical Skills

• Expertise with Informatica PowerCenter and BDM or DEI including domain and repository administration, Integration Services, ETL development, monitoring, troubleshooting, and performance tuning.
• Experience with Informatica IDQ and metadata/governance tools such as EDC or Axon.
• Proficiency in big data platforms such as Cloudera or Hadoop including HDFS, Hive, Spark, and PySpark workload management.
• Strong knowledge of Linux/Unix operating systems, shell scripting, advanced SQL, and database environments like Oracle or Microsoft SQL Server.
• Hands-on experience with enterprise data warehouse or data lake systems and supporting production environments.
• Additional skills including Informatica MDM or IICS, Kafka, Impala, NiFi, Kerberos, Ranger, Python, Microsoft Azure platform components (Azure Data Factory, Databricks, Snowflake), Power BI, Vertica, or Kubernetes are valuable.

Experience

• Minimum of 10 years of relevant experience in data engineering, specifically with Informatica development and administration.
• History of independently supporting complex enterprise-grade production environments and resolving data platform incidents.
• Demonstrated capability in working across both Informatica and Cloudera/Hadoop ecosystems.
• Experience processing high-volume data pipelines, warehouses, or lakes.
• Familiarity with enterprise or government organizations in the UAE or broader GCC region is considered a plus.