- Experience
- 2–5 yrs
- Salary
- —
- Openings
- 1
- Posted
- 1 week ago
- Work mode
- In office
- Education
- B.Tech / B.E. / B.Sc / B.C.A.
- Eligibility
- Candidates with qualifications such as B.Tech, B.E., B.Sc, or BCA in any specialization are eligible to apply.
- Resume
- Required to apply
Where you'll work
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
About the Role
We are seeking an experienced AWS Data Engineer with 2 to 5 years of expertise to join our Hyderabad team. This full-time position involves designing and managing scalable data pipelines and platforms leveraging AWS cloud services, to support large-scale data processing for analytics and business intelligence.
Key Responsibilities
- Architect, develop, and sustain scalable data pipelines on the AWS platform.
- Implement ETL and ELT workflows using AWS Glue, EMR, Lambda, or Apache Spark frameworks.
- Optimize ingestion processes to handle data from diverse sources efficiently.
- Build and operate data lakes utilizing Amazon S3 storage solutions.
- Design, deploy, and manage data warehouses with Amazon Redshift.
- Create data models tailored to analytical and reporting needs.
- Maintain high data quality, consistency, and integrity throughout datasets.
- Refine SQL queries and enhance database system performance.
- Automate workflows and orchestrate data operations through Airflow or AWS Step Functions.
- Continuously monitor data pipelines, troubleshoot processing issues and resolve related incidents.
- Apply security measures, governance policies, and compliance standards to data platforms.
- Handle extensive structured and unstructured datasets effectively.
- Partner with Data Scientists, Analysts, and business stakeholders to develop comprehensive data solutions.
- Configure and administer AWS infrastructure including S3, Glue, Lambda, EMR, Redshift, Athena, IAM, and CloudWatch.
- Adopt CI/CD methodologies to improve data engineering workflows.
- Create solutions for both real-time and batch data processing scenarios.
- Develop processes for data validation, reconciliation, and auditing to ensure data reliability.
- Maintain detailed documentation of data architectures, workflows, and technical designs.
- Support live production environments to promptly address data-related challenges.
- Focus on ongoing enhancements in performance, scalability, and dependability of data systems.
Educational Background
Applicants should possess relevant qualifications such as MCA, MSc, MTech, B.Tech, BCA, or BSc in any specialization.
Minimum education
Bachelor's Degree
Industry
IT Services & ConsultingSkills
Tools & software
AWS
Amazon Web Services AWS
required