Data Engineer - GCP

Role Overview

We are looking for a seasoned Data Engineer with over 10 years of experience to architect, build, and manage robust data pipelines and cloud data infrastructure leveraging Google Cloud Platform, Python, SQL, and Apache Airflow.

Key Skills

• Proficient in Python programming and SQL querying.
• Practical experience with GCP services including BigQuery, Dataflow, Pub/Sub, and Cloud Storage.
• Familiarity with Apache Airflow or Cloud Composer for pipeline orchestration.
• Expertise in creating ETL/ELT pipelines and integrating diverse data sources.
• Strong ability in data modeling, transformation, and performance tuning.
• Experience with Looker Studio and LookML for dashboarding and data visualization.
• Knowledge of data governance, security, and quality assurance procedures.
• Competence in managing both batch and streaming data workflows.
• Additional beneficial skills include working knowledge of PySpark/Spark, Kafka, Docker, and CI/CD pipelines.

Responsibilities

• Design and sustain scalable, efficient data pipelines on Google Cloud Platform.
• Create ETL/ELT processes using Python and SQL to transform data.
• Manage pipeline workflows through Airflow or Cloud Composer.
• Develop data schemas and optimize query performance in BigQuery.
• Provide support for analytics platforms and interactive dashboards built on Looker Studio.
• Maintain high standards of data integrity, security, and operational efficiency.
• Work collaboratively with analysts, data scientists, and business units to meet data needs.

Additional Information

This role is based in Sydney, Australia, requiring on-site presence. Interested candidates should send their curriculum vitae to the provided email contact within the company.