GCP Data Engineer
Bengaluru, Karnataka, India · Full Time
Be the first to apply
- Experience
- 4+ yrs
- Salary
- —
- Openings
- 1
- Posted
- 6 ದಿನಗಳು ಹಿಂದೆ
- Work mode
- In office
- Education
- B.C.A., B.Tech/B.E., or B.Sc (Any Specialization)
- Eligibility
- Candidates with B.C.A., B.Tech/B.E., or B.Sc degrees in any specialization are eligible to apply.
- Resume
- Required to apply
Where you'll work
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
Role Summary
We are seeking a skilled Data Engineer with extensive experience in Google Cloud Platform (GCP) and proficiency in Scala to join our Data Engineering division. This role focuses on designing, developing, and refining scalable data pipelines and platforms that facilitate sophisticated analytics and AI applications for international clients.
Key Responsibilities
- Create, develop, and support scalable data pipelines utilizing Google Cloud Platform services.
- Construct and enhance batch and streaming data processing systems with Scala.
- Build ETL/ELT workflows employing GCP services including BigQuery, Dataflow (Apache Beam), Pub/Sub, Cloud Storage, and Cloud Composer (Airflow).
- Collaborate effectively with data scientists, analysts, and business teams to back analytics and machine learning initiatives.
- Maintain high standards of data quality, reliability, and pipeline performance.
- Apply best practices related to cloud security, governance, and cost-efficiency.
- Diagnose and resolve production issues through root cause analysis.
- Engage actively in architecture discussions, participate in code reviews, and contribute to DevOps processes.
Required Qualifications and Skills
- At least four years of professional experience in data engineering roles.
- Robust hands-on experience with Google Cloud Platform environments.
- Mandatory expertise in Scala programming language.
- Strong working knowledge of BigQuery and Dataflow/Apache Beam technologies.
- Deep understanding of distributed systems, data modeling techniques, and performance optimization.
- Hands-on experience building ETL/ELT pipelines for large datasets.
- Familiarity with SQL and NoSQL databases, and cloud data warehousing solutions.
- Knowledge of version control (Git), CI/CD pipelines, and Agile project methodologies.
- Excellent problem-solving aptitude and communication abilities.
Preferred Skills
- Experience with Apache Spark and Dataproc environments.
- Exposure to real-time streaming data pipelines using Pub/Sub or Kafka platforms.
- Python programming experience in addition to Scala.
- Understanding of machine learning data pipelines and feature engineering processes.
- Professional GCP certifications, especially as a Certified Professional Data Engineer, are advantageous.
Eligibility
Applicants holding B.C.A., B.Tech/B.E., or B.Sc degrees in any specialization are eligible to apply.
Location
This position is based in Bengaluru, India.
Minimum education
Bachelor's Degree