Data Engineer (Python/PySpark)
Kolkata, West Bengal, India · Full Time
Be the first to apply
- Experience
- 4–8 yrs
- Salary
- —
- Openings
- 1
- Posted
- 2 weeks ago
- Work mode
- In office
- Education
- Any graduate
- Eligibility
- Any graduate is eligible to apply for this role.
- Resume
- Required to apply
Where you'll work
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
About Tata Consultancy Services
TCS is a global leader in IT and business solutions with over 612,000 employees worldwide, spread across 55 countries. For the fiscal year 2023-24, the company generated revenues of USD 29.08 billion. TCS operates across multiple service domains including Cloud Infrastructure, Cognitive Business Operations, Cybersecurity, Consulting, Enterprise Solutions, Internet of Things/Digital Engineering, and Data and Analytics. It is one of India's largest equal opportunity employers, with a significant female workforce exceeding 100,000 associates, and is consistently recognized as one of India's Most Respected Companies.
Role Overview
The position requires a Data Engineer skilled in Python and PySpark with 4 to 8 years of relevant experience. The role is based in Kolkata, Chennai, or Bangalore.
Key Responsibilities
- Create efficient and scalable data pipelines utilizing Python and PySpark technologies.
- Design and enhance ETL/ELT workflows to manage large volumes of data effectively.
- Conduct data transformation, cleansing, and validation tasks ensuring data quality.
- Develop and optimize complex SQL queries to support data-processing demands.
- Implement and support Spark-based distributed data processing systems.
- Integrate diverse data from both structured and unstructured sources.
- Continuously monitor data pipelines and diagnose any production-related issues.
- Work in close coordination with data architects, analysts, and other engineering teams.
Required Skills and Experience
- Proficiency in Python programming and PySpark framework.
- Strong capabilities in Apache Spark for distributed data processing.
- Advanced knowledge of SQL for querying and data handling.
- Familiarity with building ETL processes and data pipelines.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Knowledge of version control systems like Git and Continuous Integration/Continuous Deployment (CI/CD) practices.
Eligibility
Applicants must hold at least a graduate degree in any discipline.
Minimum education
Bachelor's Degree