Data Engineer

Role Overview

Our client, a prominent organization in the Asia-Pacific region, is seeking a skilled Data Engineer to join their team. The candidate will be responsible for designing, developing, and maintaining robust ETL processes and data pipelines to integrate data from multiple sources efficiently and reliably.

Key Responsibilities

• Create and maintain scalable ETL workflows and data pipelines for data ingestion, transformation, and integration.
• Develop modular, production-grade code to support statistical data production, optimize existing legacy processes while preserving business logic, and ensure outputs are consistent with current results.
• Design and uphold database schemas, data models, and storage structures to facilitate efficient data handling and retrieval of large datasets.
• Build reusable engineering components like common libraries, configuration frameworks, logging standards, and utilities to enhance production efficiency.
• Implement continuous integration and continuous delivery (CI/CD) workflows for data engineering, including automation of testing and deployment tasks.
• Establish GitLab-based version control systems, set up code review protocols, and create comprehensive technical documentation.
• Oversee and diagnose data pipeline issues, conduct root cause analyses, and continuously enhance system performance and reliability when handling large-scale datasets.

Candidate Requirements

• Possess a degree and have 4 to 7 years of professional experience in data engineering, data platform development, or related software engineering positions.
• Demonstrated strong expertise in Python and SQL, especially in complex data transformations, analytics, and data quality monitoring.
• Practical experience with data frame processing libraries such as Polars and pandas, focusing on high-performance and memory-efficient operations on large data volumes.
• Hands-on skills in database management, data warehousing, and designing ETL processes for data ingestion and integration.
• Proficient in Git version control, encompassing branching strategies, merge requests, code reviews, and managing CI/CD pipelines for automated testing and deployment.
• Familiarity with Linux/Unix operating environments, shell scripting, and command-line tools used for data processing tasks.
• Experience with cloud computing platforms and orchestration or CI/CD tools is preferred.

Additional Information

Interested candidates may contact by sending their CV, stating the position title "Data Engineer" for prompt consideration. Only shortlisted applicants will receive notification.

EA License Number: 10C3636EA. Personnel Name: Hardeep Arora. EA Personnel Registration Number: R1111454.

Submitting your application confirms your acknowledgement of and consent to the data protection policies concerning personal information and agreeing to notify any referees listed about the data usage for recruitment purposes.