Data Scientist

About Eucalyptus

Eucalyptus is dedicated to promoting lifelong health by tackling obesity and its related chronic conditions, impacting over one billion people globally. As a part of Hims & Hers, a leader in personalized health, Eucalyptus powers Juniper: one of the largest weight management programs globally that integrates GLP-1 medication with tailored nutrition, movement, and clinician-led care. Clinical studies demonstrate that this combined clinical and behavioral approach enables patients to lose four times more weight compared to alternatives.

The company operates across five countries, including Australia, the UK, Germany, Japan, and Canada, with a selective endorsement from NICE to provide services to the NHS.

Role Overview

In this role, you will spearhead the creation of a unified evaluation framework that ensures all patient-related AI conversations—clinical consultations, medical support, health coaching, AI assistant interactions, and patient experience communications—are safe, precise, and high quality. You will be responsible for developing services that monitor these patient conversations in real time, identifying and flagging risky content for appropriate review and escalation.

Additionally, you will integrate AI assistants with internal patient data models to ensure responses are grounded in accurate, personalized patient context. This position offers significant ownership and impact from the outset, supported by experienced teams, reporting directly to the Head of Data and collaborating closely with ML Engineering, Data Engineering, and Data Science teams.

Key Responsibilities

• Design and implement a standardized evaluation framework encompassing clinical and health coaching interactions, AI assistant conversations, patient experience support, and health insights.
• Develop and maintain monitoring services that detect and flag risky statements in patient-facing conversations for further review.
• Create evaluation datasets, metrics, and thresholds in collaboration with clinicians, coaches, and support leads to quantify quality standards.
• Manage technical integration between AI assistants and patient data models to ensure consistent, safe access to relevant patient and business context.
• Run and monitor these systems in production environments, including alerting and iterative improvements in response to evolving models and input prompts.
• Automate guardrail updates reflecting internal feedback and patient interactions involving third-party support tools.
• Communicate evaluation outcomes to respective teams and assist them in enhancing their workflows and interactions.

Candidate Profile

• Degree in computer science, engineering, data science, or related fields—or equivalent practical experience.
• Proficient in Python programming with an emphasis on creating reliable services beyond exploratory notebooks.
• Hands-on experience working with Large Language Models (LLMs), including prompt engineering and familiarity with evaluation frameworks or LLM-as-judge techniques through coursework, internships, or personal projects.
• Strong commitment to safety with meticulous attention to edge cases to ensure AI communications are appropriate for real patients.
• Excellent communication skills, capable of translating evaluation findings across technical and clinical audiences.
• Ability to thrive in ambiguous, novel contexts by helping to define a new evaluation layer that currently does not exist.

Desirable Qualifications

• Exposure to evaluation tooling such as promptfoo, Ragas, LangSmith, or proprietary evaluation systems.
• Experience in healthcare, regulated sectors, or other environments involving high-stakes AI applications.
• Familiarity with Google Cloud Platform (GCP), SQL, or contemporary data infrastructure.

Why Join Eucalyptus?

• Opportunity to contribute to a global preventive healthcare ecosystem with ambitious goals, including supporting one million patients worldwide over the next three years.
• Work on fast-paced, challenging projects that directly influence patient health outcomes through scalable, evidence-based care delivery.
• Benefit from high responsibility, ongoing feedback, and dedicated professional development support.
• Collaborate with a driven, skilled team to solve complex clinical and operational issues at scale.
• Engage with global teams across multiple countries and participate in a culture valuing learning, with access to budgets for conferences, certifications, and peer shadowing.
• Enjoy a supportive work environment prioritizing employee well-being through wellness talks, exercise classes, social clubs, health and personal days, parental leave, and Employee Assistance Programs.

Additional Information

Eucalyptus embraces diversity and inclusivity, welcoming candidates from all backgrounds and offering reasonable adjustments throughout the recruitment process. The company employs AI-powered tools to increase workplace efficiency; however, hiring decisions are made by humans, and all applications are personally reviewed by recruitment staff.