Data and Platform Engineer (GCP)

Overview

We are seeking a highly skilled Data and Platform Engineer specializing in Google Cloud Platform (GCP) to lead the development and architecture of our enterprise data platform. This role requires a blend of hands-on technical expertise and strategic leadership to steer infrastructure decisions and create scalable data pipelines.

Key Responsibilities

• Lead and define the architectural direction for infrastructure and pipeline design.
• Serve as the technical subject matter expert for GCP within the organization, driving strategic decisions.
• Design and develop Terraform modules from the ground up to manage infrastructure efficiently.
• Own the structure of GCP projects, IAM policies, and environment promotion across development, staging, and production.
• Create and maintain reusable data pipeline frameworks rather than relying solely on existing solutions.
• Develop ETL/ELT pipelines leveraging Dataflow (Apache Beam) as the core processing tool.
• Implement SQL-based data transformations on BigQuery using Dataform.
• Integrate with both modern enterprise data sources and legacy systems, ensuring seamless data flow.

Requirements

• Deep expertise in GCP services and architecture, including project structuring and IAM.
• Strong proficiency in Terraform for infrastructure automation.
• Hands-on experience building ETL/ELT pipelines with Apache Beam/Dataflow.
• Familiarity with Dataform for SQL transformations on BigQuery.
• Ability to design and build reusable pipeline frameworks from scratch.
• Experience integrating data from legacy enterprise systems.
• Proficient scripting skills in Python or Bash are advantageous.

Additional Information

• Educational Qualification: Bachelor of Technology or Bachelor of Engineering in any specialization.
• Location: Hyderabad, India (On-site role).
• Annual Salary Range: INR 1,200,000 to INR 1,800,000.