Senior Data Engineer

About EPAM Systems

EPAM Systems, founded in 1993, has established itself as a leader in digital transformation services worldwide. Leveraging a strong heritage in advanced software engineering, the company provides cutting-edge digital and physical product development alongside digital platform engineering. Its global hybrid teams, with a unique 'Engineering DNA,' support enterprises, educational institutions, and health platforms to connect people and enhance experiences across over 45 countries. EPAM is recognized on the S&P 500, Forbes Global 2000, and Fortune's fastest-growing companies lists.

Job Location and Mode

This role is based in Hyderabad, India, with hybrid work arrangements requiring 2-3 days in the office per week. Other key EPAM locations include Gurgaon, Pune, Bengaluru, Chennai, and Coimbatore.

Position Overview

We seek a Senior Data Engineer with 5 to 14 years of experience in Big Data and related technologies. The ideal candidate possesses deep expertise in Apache Spark's core concepts (including RDDs, DataFrames, fault tolerance mechanisms, Catalyst optimizer, and AQE) and advanced programming skills in Python (covering comprehensions, decorators, generators, exception handling, and data structures). Experience in building streaming data pipelines, integrating data from diverse sources like RDBMS (SQL Server, Oracle), ERP systems, and various file formats is essential. Solid knowledge of SQL, including queries, joins, stored procedures, and relational schema design, coupled with the ability to tune Spark job performance, is required. Competence with native cloud data services across Azure, GCP, and AWS is expected. The position also demands team leadership capabilities and familiarity with Agile development methodologies.

Opportunities and Benefits

• Work on challenging technical projects impacting multiple geographies
• Access to professional development resources such as an online university, global knowledge sharing, and certification opportunities
• Engage internationally by sharing ideas on global platforms
• Participation in sponsored technical talks and hackathons
• Potential relocation to EPAM offices worldwide for various projects
• Focused individual growth paths
• Comprehensive benefits including health, medical, retirement plans, paid time off, and flexible benefits
• Opportunities to pursue interests beyond work through CSR activities, photography, painting, sports, and more

Additional Information

EPAM operates across more than 40 countries with a workforce exceeding 55,000 professionals. Key regional hubs include North America and various parts of Europe and Asia Pacific. Join EPAM and be part of a globally recognized environment fostering innovation and growth.