Perception Engineer - Localisation, Sensor Fusion & 3D World Mapping

About the Role

Join Breaker as a Perception Engineer focused on Localisation and Sensor Fusion, situated in Sydney, Australia. This role entails full technical ownership of a 3D localisation system that transforms 2D camera detections into exact real-world coordinates, relying solely on passive sensors without LIDAR. You will engage deeply with camera-based localisation, sensor fusion, and real-time data processing on edge hardware embedded in moving robotic platforms.

This greenfield position offers an opportunity to lead enhancements in localisation accuracy through creation of performance metrics, tooling, and continuous improvement processes applicable across various hardware configurations. You will coordinate with teams handling computer vision, hardware, and field operations to ensure system integration and reliability.

Company Overview

Breaker redefines robotic autonomy by enabling robots to function as self-organizing teammates operated via natural language communication over existing push-to-talk radios without additional controllers or gear. Their software supports real-time, intent-based controls even in restrictive environments with limited connectivity, pushing the boundaries of physical AI with a small, expert team backed by renowned investors.

Responsibilities

• Maintain and enhance Breaker's 3D localisation pipeline from 2D input to geospatial output.
• Develop data collection methods, ground truth acquisition, and automated evaluation tools to monitor localisation metrics.
• Create, test, and integrate novel localisation and sensor fusion methods to boost system precision and robustness.
• Advance tracking capabilities for moving objects on mobile platforms and ensure adaptability across different camera and hardware setups.
• Specify interface requirements for related subsystems such as CV pipelines and camera hardware.
• Analyze field data to uncover failure points and validate technological improvements.
• Design real-world test scenarios to rigorously assess localisation behaviors.
• Participate actively in field testing, instructing teams on proper data gathering processes.
• Conduct hardware-in-the-loop and software-in-the-loop experiments to ensure system reliability.

Candidate Profile

The ideal candidate will have:

• Proven expertise in camera-based localisation on mobile robotic platforms without LIDAR reliance.
• Strong understanding of sensor fusion concepts including sensor timing and calibration for synchronized multi-sensor integration.
• Experience with real-time data processing on constrained and edge devices.
• Ability to diagnose and troubleshoot localisation system failures using robotic datasets.
• Knowledge of geometric optimization frameworks such as Ceres or GTSAM.
• Programming proficiency in Python and/or C++ within Linux environments.
• Evidence of having deployed production localisation systems rather than purely academic projects.
• Legal authorization to work in Australia and willingness to partake in frequent field testing.

Preferred Qualifications

• Experience in GPS-denied navigation or localisation contexts.
• Familiarity with photogrammetry or large-scale imagery workflows.
• Robotic manipulation employing camera feedback or visual servoing techniques.
• Expertise handling gimbaled camera systems and their particular nuances.
• Insight into machine learning integration with geometric perception systems.
• Multi-robot platform data fusion capabilities.
• Hands-on with ROS or ROS2 development.
• Drone or UAV system experience.
• Background working in startup or scale-up companies.
• Australian citizenship is advantageous but not mandatory.

Additional Information

This is a highly impactful position within a pioneering company at the forefront of physical AI development. The role is based onsite at Cicada Innovations, Eveleigh, Sydney, located within the National Innovation Centre. Employees are encouraged to be hands-on, collaborative, and deeply involved in shaping Breaker’s product suite and growth trajectory.