Senior Technical Program Manager, Machine Learning Infrastructure

About Cohere

Cohere is a pioneering enterprise AI company committed to security-first principles. We develop state-of-the-art foundational AI models and comprehensive products tailored to address real-world enterprise challenges. Our team comprises researchers, engineers, designers, and other passionate professionals dedicated to enhancing the capability and value of our AI models.

Headquartered in Toronto with offices globally including Montreal, London, New York City, San Francisco, Paris, Berlin, and Seoul, Cohere operates as a remote-first company with a strong preference for candidates in the Eastern Time zone.

Role Overview

As our programs expand in size and complexity, we seek experienced Technical Program Managers to oversee and coordinate these efforts. The role involves operational expertise in managing cross-functional initiatives, executing tactical tasks with precision, and collaborating strategically with senior leadership to elevate the impact and scale of our AI infrastructure.

Key Responsibilities

• Oversee a portfolio of programs related to inference, efficiency, serving, and endpoint management to scale Cohere’s infrastructure for internal and external users.
• Drive end-to-end program coordination and execution with strong collaboration across Modeling and customer-facing teams.
• Identify challenges and implement processes to enable teams to concentrate on development while enhancing user satisfaction and engineering excellence.
• Foster a culture of ongoing improvement, including working with incident management teams to diagnose problems accurately and deliver timely solutions.
• Manage multiple overlapping projects, prioritizing effectively to meet the company’s highest priorities.
• Partner with stakeholders company-wide to establish, monitor, and manage timelines, deliverables, budgets, and scopes to guarantee successful program delivery.
• Communicate clear, timely, and consistent updates to engineering, leadership, and non-technical teams regarding progress, plans, and incidents.
• Provide both tactical and strategic partnership to senior leaders, supporting detailed execution and high-level problem-solving to drive company-wide impact.

Candidate Profile

• Minimum 5 years of experience in Technical Program Management within Machine Learning Infrastructure, covering areas like model inference, serving, efficiency, and endpoint design and implementation.
• Deep technical understanding of ML infrastructure architectures and engineering best practices balancing speed and structure in fast-growing organizations.
• Proven ability to navigate and succeed in dynamic, fast-paced, and often unstructured environments; pragmatic and hands-on approach when needed.
• Preferred but not mandatory: hands-on technical experience to deeply engage with internal systems and champion engineering best practices.
• Preferred: experience collaborating with ML teams and a functional understanding of machine learning model development to advocate effectively across infrastructure and modeling teams.

Employee Benefits

• Weekly lunch allowance of $75 (or equivalent currency).
• Comprehensive health and dental coverage, including dedicated mental health budget.
• Retirement plans with RRSP matching, 401K, or Pension schemes as applicable.
• 100% parental leave top-up up to six months for any parent.
• Annual enrichment budgets covering arts, culture, wellness, quality time, workspace setup, professional education, conferences, and coaching.
• Generous paid vacation of six weeks (30 working days).
• Travel budgets for remote employees to visit offices and participation in an annual company-wide offsite event.

Work Environment

• Remote-friendly culture with multiple global offices.
• Office amenities include daily lunch service, snacks, and community events.
• Co-working benefits for employees not near an office.
• Home office setup stipend of $500 for all employees.

Additional Information

Cohere is committed to diversity, equity, and inclusion, welcoming applicants from all backgrounds and offering accommodations throughout the hiring process. The recruitment process uses AI tools to assist in candidate screening but does not restrict recruiter review. Beware of fraudulent job postings; official communications come only from Cohere email domains.

Compensation

Salary range from CA$230,000 to CA$280,000 annually.