- Experience
- 5+ yrs
- Salary
- USD 190,000 – USD 325,000 / year
- Openings
- 1
- Posted
- 4 hours ago
- Work mode
- Work from home
- Resume
- Required to apply
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
About Cohere
Cohere is a leading AI enterprise focused on security, creating foundational AI models and comprehensive products aimed at solving practical business challenges. Headquartered in Toronto with key offices worldwide, the company develops frontier AI models for enterprise AI systems, emphasizing collaboration among researchers, engineers, and designers dedicated to advancing AI capabilities.
Role Overview
This role involves designing, building, and operating high-performance, reliable machine learning infrastructure that supports the deployment of large language models via APIs. Working within the Model Serving team, you will collaborate with various groups to deploy optimized NLP models in environments requiring low latency, high throughput, and high availability. You will also interact with customers to implement tailored deployment solutions.
Key Qualifications
- Over 5 years of experience managing production infrastructure at large scale.
- Expertise in building distributed systems that are highly available, specifically using Kubernetes and GPU workload management.
- Proficiency in developing and maintaining Kubernetes environments for both development and production.
- Experience working with multiple cloud platforms including GCP, Azure, AWS, OCI, and hybrid on-premises setups.
- Strong skills in deploying, supporting, and troubleshooting complex Linux-based systems.
- Competency in managing computational resources, cost optimization for compute, storage, and networks.
- Excellent teamwork and problem-solving skills required to maintain mission-critical systems efficiently.
- Adaptability and determination to resolve evolving technical challenges.
- Familiarity with GPU, TPU, or custom accelerators and their impact on inference latency and throughput.
- Deep understanding or hands-on experience with distributed systems architecture.
- Programming skills in Golang, C++, or other languages suitable for high-performance scalable server development.
Employee Benefits
- Weekly lunch stipend equivalent to $75 or £75 in your currency.
- Comprehensive health and dental coverage, including dedicated mental health budgets.
- Retirement benefits such as RRSP matching, 401K, or pension schemes.
- Full parental leave salary top-up for up to six months, applicable to either parent.
- Annual enrichment budgets for arts, culture, fitness, quality time, workspace enhancements, and educational pursuits such as courses, conferences, and coaching.
- Generous paid vacation totaling six weeks (30 working days).
- Travel allowances for remote employees to visit offices and participate in an annual company offsite event.
Work Environment
- Remote-friendly culture with offices located in multiple global cities including Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin, and Seoul.
- Office amenities include daily lunches, snacks, and community engagement events.
- Remote workers receive co-working benefits to facilitate collaboration within their local communities.
- Home office setup stipend of $500 for all employees.
Additional Information
Cohere encourages applications from candidates who may not perfectly match all criteria. The company is committed to inclusivity and equal opportunity, offering accommodations during the recruitment process upon request. AI tools may assist in candidate screening, but do not restrict recruiter consideration. Beware of fraudulent communications; official hiring outreach comes only from cohere.com domains. The compensation for this role ranges from $190,000 to $325,000 annually.