AWS Data Engineer
Sydney, New South Wales, Australia · Full Time
Be the first to apply
- Experience
- Any
- Salary
- —
- Openings
- 1
- Posted
- 1 week ago
- Work mode
- In office
- Resume
- Required to apply
Where you'll work
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
Job Summary
The role focuses on designing, developing, and managing cloud-native data platforms and scalable ETL/ELT pipelines leveraging AWS technologies and programming languages such as Python and SQL alongside Spark/PySpark frameworks.
Key Duties and Responsibilities
- Architect and maintain data processing workflows integrating AWS services including S3, Glue, EMR, Athena, and Aurora PostgreSQL.
- Apply Change Data Capture (CDC) methods, data modeling, and build event-driven data pipelines to ensure efficient and dependable data delivery.
- Implement data governance standards, monitoring mechanisms, continuous integration and deployment (CI/CD) through GitHub Actions and associated DevOps workflows.
- Work alongside stakeholders and Agile teams to resolve data-related challenges, enhance platform efficiency, and produce robust data solutions.
Essential Skills and Experience
- Proficient in SQL, Python, AWS cloud services, and the development of ETL/ELT processes with solid experience in Spark or PySpark frameworks.
- Hands-on capability with AWS S3, Glue, EMR, Athena, and Aurora PostgreSQL in production environments.
- Experienced in CDC, data governance, operational monitoring, CI/CD pipelines using GitHub Actions, and managing operational databases.
- Familiarity with Kafka/MSK, Terraform, and event-driven system designs; experience with Snowflake and dbt tools is considered beneficial.
- Excellent problem-solving aptitude, stakeholder engagement, communication, and Agile project delivery skills.
Additional Information
Interested candidates are invited to submit their curricula vitae to the provided company contact email.
Skills
Tools & software
Apache Kafka
required
GitHub Actions
required
AWS S3
required
Terraform
required
How they work
Communication
Problem Solving
Relationship Building