Junior Data Engineer

Information Technology
Bengaluru (Karnataka), Karnataka (India), India
December 27, 2024
Full-time
Apply Now

Job Description

We are looking for a motivated Associate Software Engineer with foundational skills in Google Cloud Platform (GCP), specifically BigQuery and Dataproc. The ideal candidate should have experience in Linux/Unix environments, proficiency in at least one programming language, and a solid understanding of unit testing principles. Optional skills include exposure to pipeline migration from Hadoop to BigQuery, familiarity with Airflow, and knowledge in PySpark, Scala, or Java, Shell Scripting, Kafka, and GCP Looker.

Responsibilities

Mandatory Skills:

  • Knowledge of Google Cloud Platform (GCP), specifically BigQuery and Dataproc.
  • Hands on experience in any Query Language (SQL/HQL)
  • Experience with Linux/Unix environments.
  • Work experience in at least one programming language.
  • Understanding of unit testing principles.

Optional Skills:

  • Exposure to pipeline migration from Hadoop system to BigQuery.
  • Familiarity with Apache Airflow.
  • Knowledge of Python / PySpark, Scala, or Java (knowledge in anyone).
  • Proficiency in Shell Scripting.
  • Familiarity with Kafka.
  • Knowledge of GCP Looker.

Requirements

Bachelor’s degree (in any field).

  • MSc/BE/Masters with specialization in IT/Computer Science is desirable.
  • Work experience (2-4 years)
  • Adapt/Experience working in multi-channel delivery projects is desirable
  • Strong problem-solving and analytical skills.
  • Ability to work effectively in a team environment.
  • Excellent communication skills and willingness to learn new technologies.

Related Jobs