Q

Python Data Testing Engineer

Quess IT Solutions

Bangalore Rural, Karnataka, India (Hybrid) · Full Time

Be the first to apply

Experience
3–5 yrs
Salary
—
Openings
1
Posted
5 seconds ago
Work mode
Hybrid
Education
Any graduate
Eligibility
Candidates who have completed any graduate degree are eligible to apply.
Resume
Required to apply

Where you'll work

Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.

Job description

Company Overview

Sony Group Corporation, established in 1946 and headquartered in Minato, Tokyo, is a renowned Japanese multinational conglomerate. It has grown from a small radio repair shop into a leader in global electronics, video gaming, entertainment, and financial services. The company is driven by a commitment to innovation and creating unique cultural experiences through advanced consumer technology and digital entertainment.

About the Role

We are looking for a skilled ETL Test Engineer specializing in data validation and testing within big data ecosystems. The successful candidate will play a pivotal role in developing and executing testing approaches for data warehouses, ETL workflows, and cutting-edge data platforms. This position demands a strong technical background in big data tools, proficient programming skills in Python, and experience working in cloud-based environments.

Key Responsibilities

  • Develop and contribute to comprehensive end-to-end testing strategies for ETL pipelines, data warehousing solutions, and big data systems.
  • Create and implement scalable frameworks for data validation.
  • Conduct thorough database testing on both SQL and NoSQL platforms.
  • Perform data validation across data lakes such as Snowflake and distributed systems.
  • Work closely with data engineers to uphold data quality and ensure pipeline dependability.
  • Design and maintain automated testing tools for batch and streaming data pipelines.
  • Enhance testing procedures to improve performance, scalability, and precision.
  • Incorporate testing processes within CI/CD pipelines to streamline deployments.
  • Ensure adherence to data governance standards and quality control protocols.

Skills and Experience Requirements

  • Proven hands-on experience with ETL testing and data validation techniques.
  • Strong programming ability in Python.
  • Experienced with PySpark and/or Scala for processing large datasets.
  • Familiarity with SQL, database testing, and data modeling methodologies, including both SQL and NoSQL databases.
  • Knowledgeable in data warehouse architectures and data lakes such as Snowflake.
  • Prior experience with Databricks.
  • Understanding of big data ecosystems and related technologies.
  • Ability to test data pipelines and ETL workflows effectively.
  • Awareness of input/output validation practices for machine learning pipelines.

Additional Beneficial Skills

  • Experience working with Apache Flink for stream and batch processing.
  • Exposure to continuous integration and deployment tools like Jenkins and GitLab.
  • Familiarity with containerization technologies such as Docker and orchestration platforms like Kubernetes.
  • Proficiency with Linux environments and shell scripting.
  • Hands-on experience with AWS backend services.

Company Background

Sony India Software Centre Pvt. Ltd., a subsidiary of Sony India since 1997 and re-established in 2012 as a separate entity, serves as a global capability center. It delivers high-quality software development, enterprise applications, and security services, supporting Sony's global business requirements.

Work Location and Mode

This position is based in Bengaluru and follows a hybrid working model.

Additional Information

Applicants must hold at least a graduate degree.

Minimum education

Bachelor's Degree

Tools & software

Docker required Kubernetes required Snowflake required Databricks required
🤖
Online · instant AI help
Broxer