- Experience
- 15+ yrs
- Salary
- —
- Openings
- 1
- Posted
- 2 days ago
Where you'll work
Job description
About the Role
We are seeking an experienced Analyst Programmer with a strong background in ETL development and data warehousing. This role involves creating and optimizing complex data pipelines and applications, ensuring efficient data transformation and loading into Teradata-based systems. You will be responsible for performance tuning, automating processes, and building robust data ingestion frameworks.
Responsibilities
- Develop and maintain ETL/ELT processes using Teradata SQL, Informatica, Apache Spark, QueryGrid, and Trino for data transformation and loading into Teradata data warehouses and datamarts.
- Optimize the performance of complex applications to minimize resource consumption.
- Automate end-to-end processes using frameworks like GCFR, shell scripts, and BTEQ, and integrate them with control systems.
- Construct an in-house Change Data Capture (CDC) framework using Java to process Online Transaction Processing (OLTP) logs from SAP (Oracle) and ingest data into Teradata. Develop a configurable framework around this CDC ingestion.
- Implement and build Master Data Management (MDM) applications to handle user uploads, including data validation and approval workflows.
Additional Information
This is a full-time, onsite position based in Singapore.