Data Engineer – OCI Data Lakehouse Projects
Dubai, United Arab Emirates · Full Time
Be the first to apply
- Experience
- 7+ yrs
- Salary
- —
- Openings
- 1
- Posted
- 1 day ago
- Work mode
- In office
- Resume
- Required to apply
Where you'll work
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
Role Overview
Seeking an experienced Data Engineer with over 7 years of expertise to join the Data Management Office in advancing comprehensive Oracle Cloud Infrastructure (OCI) Data Lakehouse initiatives. This professional will architect, develop, and enhance scalable data pipelines, ingestion systems, and data products crucial for business intelligence, regulatory compliance reporting, and AI/ML innovation. Collaborating closely with stakeholders from departments such as Actuarial, Underwriting, Claims, Finance, and other business units, the goal is to convert unprocessed data into reliable, strategic assets driving informed decision-making.
Key Responsibilities
- Design, build, and sustain scalable data ingestion, transformation, and orchestration pipelines utilizing OCI Data Flow, Oracle Data Integrator (ODI), and Oracle AI Data Platform (AIDP).
- Create robust ETL/ELT pipelines that support enterprise-wide data integration and analytical needs.
- Implement and oversee Delta Lakehouse architectures incorporating ingestion, curation, and consumption layers.
- Develop and refine analytical data models, marts, and datasets on Oracle Autonomous Data Warehouse (ADW) tailored for reporting, operational analytics, and AI/ML applications.
- Collaborate with business teams to convert requirements into technical, reusable data products.
- Manage both structured and unstructured data assets in OCI Object Storage, advocating storage lifecycle strategies and governance while optimizing costs.
- Partner with data architects to build reusable, high-efficiency ingestion frameworks with embedded data quality, lineage tracking, metadata management, and governance controls.
- Continuously improve platform scalability, reliability, and performance.
- Perform tuning and optimization for SQL workloads, Spark jobs, ETL processes, and ADW resources to mitigate bottlenecks and maximize data processing efficiency.
Required Skills & Experience
- Demonstrated expertise with Oracle Cloud Infrastructure: Autonomous Data Warehouse, OCI Object Storage, OCI Data Flow (Apache Spark), Oracle Data Integrator, and Oracle AI Data Platform.
- Advanced skills in SQL and Python programming languages.
- Proven ability to tune and troubleshoot large-scale data workloads effectively.
- Hands-on experience constructing modern, cloud-native data pipelines and platforms, specifically leveraging OCI.
- Comprehensive understanding of Delta Lakehouse architectures, including Medallion Architecture, data versioning, and contemporary data engineering methodologies.
Preferred Qualifications
- Prior use of Oracle GoldenGate for real-time replication and Change Data Capture (CDC) pipelines.
- Knowledge of modern data governance mechanisms, metadata management, and data observability tools.
- Experience supporting AI/ML data preparation and feature engineering within enterprise Data Lakehouse environments.
Domain Exposure
Familiarity with insurance-related areas such as Policy Administration, Claims Management, Underwriting, and Finance or Regulatory Reporting is advantageous but not mandatory.
Soft Skills
- Strong analytical thinking and problem-solving aptitude.
- Excellent communication capabilities and stakeholder management.
- Collaborative approach to work within cross-functional teams in dynamic environments.