Databricks Data Engineering Manager

About Accenture

Accenture is a leading global professional services firm specializing in digital innovation, cloud, and security. Within the ANZ region, Accenture is heavily committed to advancing capabilities in Generative AI, Data, and AI technologies, making significant strides in delivering impactful client solutions.

Role Overview

You will join Accenture’s Data & AI practice, contributing to the creation of advanced AI-ready data platforms leveraging Databricks technology. As the largest global partner of Databricks with multiple prestigious awards, including Global GSI Partner of the Year for seven consecutive years and APJ Industry Leader Partner in 2025, Accenture provides a robust environment supported by extensive certified teams.

Key Responsibilities

• Lead and provide mentorship to multidisciplinary data engineering teams focused on delivering comprehensive Databricks solutions.
• Work collaboratively with clients and subject matter experts to design scalable, secure, and efficient data platforms.
• Oversee full project life cycles, managing stakeholder communications and resolving issues across cloud data projects.
• Ensure adherence to best practices involving data governance, system observability, and CI/CD pipeline implementation.
• Champion innovation by assessing new data technologies and fostering a culture of continuous learning.

Core Skills and Expertise

• Comprehensive knowledge of the Databricks Lakehouse Platform, including Delta Lake, Delta Live Tables, Unity Catalog, workflows and orchestration, SQL Warehouses, AI/BI Genie features, and AgentBricks for AI orchestration.
• Experience with Generative AI integrations on Databricks such as model serving, vector search, and large language model integration strategies.
• Proficient understanding of data product architectures, semantic layers, and domain-specific data design principles.
• Advanced skills in Python, PySpark, and SQL for handling large-scale data processing tasks.
• Strong background in streaming technologies (Structured Streaming), batch pipeline construction, and optimization for performance.
• Hands-on expertise in CI/CD practices, DevOps, and native Lakehouse deployment frameworks including Spark Declarative Pipelines.
• Extensive experience working with cloud platforms like AWS, Azure, or GCP and integrating within enterprise data ecosystems.
• Knowledgeable in event-driven architecture, APIs, and microservices for seamless system integration.
• Leadership proficiency in managing distributed teams and steering complex, multi-stream enterprise programs.
• Skilled stakeholder engagement including C-level collaboration, providing strategic advisory and driving business-led data and AI transformation.

Employee Benefits

• Generous paid parental leave policy of 18 weeks.
• Options for long and short-term career breaks.
• Structured career progression frameworks and local/international mobility opportunities.
• Recognition as a Family Inclusive Workplace™ and a top performer on Diversity & Inclusion Index.
• Flexible work arrangements supporting health, wellbeing, and a truly human approach to work.

Inclusion and Equal Opportunity

Accenture champions a diverse and inclusive workplace where all individuals can be their authentic selves. The company is committed to equitable hiring practices, eliminates barriers throughout recruitment and employment, and promotes an environment free from discrimination based on age, disability, ethnicity, gender, religion, or sexual orientation.

The role is based onsite in Auckland, New Zealand, and emphasizes Accenture’s dedication to fostering a supportive and progressive professional setting.