Senior Data Quality Engineer
Hyderabad, Telangana, India · Full Time
Be the first to apply
- Experience
- 5–6 yrs
- Salary
- —
- Openings
- 1
- Posted
- 3 weeks ago
- Work mode
- In office
- Education
- Any Graduate
- Eligibility
- Open to any graduate candidates
- Resume
- Required to apply
Where you'll work
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
About the Role
We are inviting an experienced and meticulous Data Quality Engineer specializing in automation to join our dedicated data engineering team. This role requires deep expertise in ETL process automation, validating data warehouses, and managing cloud-based data services. Proficiency in test automation frameworks and continuous integration/continuous deployment (CI/CD) is essential to excel in this position.
Key Responsibilities
- Create and implement automated test scripts to verify ETL workflows and data pipeline accuracy.
- Conduct comprehensive data validation, reconciliation, and testing of data warehouses and databases over large volumes of data.
- Partner with data engineers, business analysts, and other stakeholders to establish test strategies that uphold data quality benchmarks.
- Design scalable and reusable test automation platforms utilizing Python and SQL languages.
- Embed automated testing procedures within CI/CD workflows to support uninterrupted testing and seamless delivery.
- Ensure the correctness and completeness of data transformation processes across varied cloud platforms including Azure, AWS, and GCP.
- Engage actively in Agile project events such as sprint planning, retrospectives, and backlog grooming.
Required Qualifications
- A minimum of 5.5 years’ professional experience in ETL automation and testing of Data Warehouses or Data Lakes.
- Advanced expertise in writing SQL queries for data validation and test automation purposes.
- Proficient with Python for scripting and building testing frameworks.
- Practical exposure to at least one Test Automation Framework.
- Hands-on experience with Cloud Data Services across major platforms: Azure (ADF, ADB), AWS (Glue, Lambda, Redshift), and GCP (BigQuery).
- Understanding of CI/CD concepts and tools such as Jenkins, Git, and Azure DevOps.
- Familiar with Agile and Scrum project management methodologies.
Desirable Skills
- Experience with data observability or data quality tools like Great Expectations or Deequ.
- Basic knowledge of data governance principles and metadata management.
- Relevant certifications in cloud platforms (Azure, AWS, or GCP) considered an asset.
Eligibility
Applications are open to any graduate interested in this position.
Level
Senior
Minimum education
Bachelor's Degree