C

AI Data Engineer

Compare the Market Australia

Brisbane, Queensland, Australia · Full Time

Be the first to apply

Experience
Any
Salary
—
Openings
1
Posted
4 weeks ago
Work mode
In office
Eligibility
Candidates must possess unlimited working rights in Australia; sponsorship is not available.
Resume
Required to apply

Where you'll work

Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.

Job description

Who We Are

iSelect and Compare the Market are reputable and widely recognized brands dedicated to assisting millions of Australians in comparing and purchasing personal finance and household products like insurance, energy, and loans. Together, they provide a smooth, customer-centered experience designed to help Australians find the most suitable products.

Primary Responsibilities

  • Design, develop, and optimize scalable data pipelines and AI-ready data products tailored for batch, streaming, and event-driven systems.
  • Create production-level retrieval pipelines enabling document ingestion, embeddings, vector search, semantic retrieval, and Retrieval Augmented Generation (RAG) solutions.
  • Develop reusable frameworks to support AI enablement, including prompt orchestration, model integration, evaluation workflows, and preparation of model-compatible datasets.
  • Implement DataOps and MLOps methodologies to facilitate deployment, monitoring, testing, observability, and continuous enhancement of AI systems.
  • Promote responsible AI practices, governance, and secure-by-design principles to ensure that solutions are dependable, scalable, and compliant with policies.
  • Work in close partnership with data engineers, AI engineers, architects, software developers, and business stakeholders to deliver innovative AI and data capabilities.

What We Offer

  • A collaborative workplace that values your ideas, contributions, and personal growth with recognition for meaningful work.
  • A culture driven by shared values: Drive, Noble Intent, and All Together.
  • A vibrant social community with annual celebrations, family fun days, and regular events.
  • Flexible working options including the possibility of one work-from-home day per week or a 9-day fortnight schedule.
  • Additional leave provisions such as ‘ME’ leave, ‘Volunteer Day’ leave, and options for purchasing extra leave.
  • A Return To Work bonus program for returning parents.
  • Quarterly awards and recognition initiatives.

Preferred Qualifications and Skills

  • Experience in Data Engineering, Analytics Engineering, Machine Learning Engineering, or AI Engineering roles.
  • Competence with Databricks, Spark, PySpark, Python, and SQL for data processing and engineering.
  • Proven ability to design and build data products supporting AI and ML initiatives.
  • Understanding of generative AI techniques including RAG, embeddings, vector search, prompt orchestration, and large language model applications.
  • Proficiency in software engineering best practices such as CI/CD, testing, infrastructure as code, and version control.
  • Familiarity with DataOps, MLOps, governance, security, and responsible AI principles.
  • Strong communication skills tailored to engage both technical and non-technical audiences.
  • Experience working with AI-enabled applications, intelligent search solutions, copilots, or agentic workflows is highly valued.

Additional Information

This position is open exclusively to candidates holding unrestricted Australian work rights; sponsorship is not provided. iSelect and Compare the Market are equal opportunity employers committed to diversity and privacy, ensuring all applicant information is securely managed in compliance with Australian privacy regulations.

Tools & software

Apache Spark required Databricks required

How they work

Communication Teamwork & Collaboration Attention to Detail
🤖
Online · instant AI help
Broxer