Principal Product Manager - AI Observability

About Palo Alto Networks and Chronosphere

Palo Alto Networks® is driven by a unifying mission to protect the digital lifestyle. The company thrives at the crossroads of innovation and meaningful impact utilizing advanced technology and visionary thinking. They foster an environment where all voices and ideas matter. Employees collaborate globally in hybrid teams, transcending location barriers to solve major challenges, closely interact with customers, and develop professionally. The organizational culture is grounded in trust, responsibility, and collective success.

Chronosphere, a Palo Alto Networks business unit, offers an observability platform tailored for modern container-centric environments. It helps users concentrate on critical data and insights by minimizing complexity, optimizing expenses, and accelerating issue resolution. By significantly reducing data volumes and costs by an average of 84%, Chronosphere saves developers thousands of hours. It is recognized as a market leader and trusted by innovative companies such as DoorDash, Affirm, and Zillow.

Role Summary

The Principal Product Manager will lead the development of AI Observability and Evaluation functionalities designed for developers to assess the accuracy, relevance, performance, and safety of AI models, agents, and retrieval-augmented generation applications. This role requires balancing close collaboration with both customer-facing and engineering teams, translating user requirements into effective solutions ensuring AI models and agents operate reliably before and during production.

Key Responsibilities

• Conduct primary user research including interviews with end-users and buyers to understand needs and benefits related to AI Observability and Evaluation.
• Collaborate with engineering and technical teams to define, scope, and deliver well-integrated AI Observability features and extend product lines.
• Enhance Chronosphere’s observability platform to facilitate systematic testing, measuring, and benchmarking of AI models, especially Large Language Models and agent-based AI applications.
• Establish and monitor key performance indicators (KPIs) to reflect customer value and impact.
• Create detailed roadmaps and execution plans to achieve customer and business outcomes.
• Communicate priorities and rally cross-functional teams to align on goals.
• Manage the product backlog including grooming user stories and decomposing tasks.
• Lead cross-team efforts to ensure coherent features and workflows within the product platform.
• Coordinate closely with product marketing on positioning and messaging strategies.
• Maintain clarity and transparency in communications and processes.

Initial Objectives

Within the first 30 days, immerse in market research, understand the user base and ongoing projects by engaging customers and participating in team agile practices. Quickly establish authority as the product owner focusing on delivery and validation while aligning projects with long-term strategic goals.

By three months, lead new projects from inception, independently conduct research, set KPIs, and make informed decisions. Be recognized as the customer and product knowledge authority.

Qualifications

• Over 10 years of product management experience, including work on enterprise software products.
• More than 3 years managing Machine Learning and foundational model products/platforms.
• Familiarity with quality metrics relevant to Large Language Models, such as entropy, cross entropy, and perplexity.
• Proficient understanding of AI Observability and Evaluation techniques including functional correctness, similarity measurement, AI as a judge, and cross-model comparisons.
• Experience with major AI models and agent platforms.
• Demonstrated success delivering software through agile methodologies with tight feedback loops.
• Experience building and operating Software as a Service (SaaS) solutions.
• Strong attention to detail and commitment to quality.
• Comfort with cloud-native monitoring technologies.

Location

Remote position based in Australia.

Company Commitments

Palo Alto Networks fosters innovation through diversity and inclusion and is committed to providing reasonable accommodations for qualified individuals with disabilities. The organization promotes equal employment opportunity and maintains confidentiality according to EEO guidelines.

Additional Information

This role is eligible for immigration sponsorship.