Lead Data Engineer - Azure & Databricks
Wellington, Wellington Region, New Zealand · Full Time
Be the first to apply
- Experience
- 5+ yrs
- Salary
- —
- Openings
- 1
- Posted
- 3 days ago
- Work mode
- In office
- Education
- Bachelor Degree
- Eligibility
- Applicants must be legally eligible to work in New Zealand at the time of application. The employer encourages candidates from diverse backgrounds and supports equal employment opportunities.
- Resume
- Required to apply
Where you'll work
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
Overview
We are looking for a Lead Data Engineer specialized in Azure and Databricks to spearhead the technical strategy and architecture of an enterprise-scale next-generation data platform. This role involves directing the creation and implementation of scalable, secure, and cost-efficient cloud data solutions that support critical decision-making processes within the public sector.
Role Summary
This position combines practical engineering tasks with strategic architecture leadership. As the technical lead, you will promote cloud-native design principles using Azure, Databricks, and container technologies while mentoring and leading an Agile team of data engineers. Working collaboratively with architects and business partners, you will ensure the platform's adaptation to meet advanced standards in data governance, analytics, and integration.
Key Responsibilities
- Lead the design and delivery of Azure-based data services, Databricks platforms, and real-time streaming solutions.
- Promote the use of DevOps practices, Infrastructure as Code using Terraform and Azure DevOps, CI/CD pipeline automation, and proactive system observability.
- Provide mentorship and technical leadership to enhance the skills and capabilities of the data engineering team.
- Collaborate with architects and stakeholders to ensure platform developments align with organizational objectives.
- Evolve platform architecture to enable secure data sharing, comprehensive analytics, and robust governance.
- Enforce technical standards, governance, and embrace a cloud-first approach to platform delivery.
Required Skills and Experience
- Demonstrated experience in designing and managing large-scale enterprise cloud data platforms.
- Expertise in Azure Databricks, Apache Spark, Delta Lake, and Terraform for Infrastructure as Code.
- Strong understanding of cloud-native architecture principles, containerization technologies such as AKS and Docker, and security integration.
- Experience with contemporary data governance frameworks and compliance requirements.
- Proven leadership skills, including mentoring and guiding engineers within Agile development environments.
- Excellent communication skills for conveying complex cloud data strategies to diverse audiences.
Additional Information
- Work location: Wellington, New Zealand (Onsite)
- Employment type: Fixed-term contract until June 2027 with possibility of extension for a multi-year project
- Applicants must have legal entitlement to work in New Zealand.
- The employer is committed to equal employment opportunities and embraces diversity.
Minimum education
Bachelor's Degree