- Experience
- Any
- Salary
- CAD 250,000 – CAD 535,000 / year
- Openings
- 1
- Posted
- 2 days ago
- Work mode
- Work from home
- Resume
- Required to apply
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
About Cohere
Cohere is a pioneering enterprise AI company with a strong emphasis on security, dedicated to creating state-of-the-art foundational AI models and comprehensive solutions designed to tackle real-world business challenges. Our team comprises passionate researchers, engineers, and designers who strive to enhance model capabilities and maximize value for our clients. Based globally with headquarters in Toronto and offices in major cities including London, New York City, San Francisco, Montreal, Paris, Berlin, and Seoul, we maintain a remote-friendly culture open to locations between EST and EU time zones.
Role Summary
The Machine Learning Engineer for pre-training data will be instrumental in developing the data pipelines essential for powering Cohere's advanced language models. This includes conducting data ablations to evaluate the quality of datasets and constructing effective pre-training mixtures to boost model performance. This role blends research with engineering to translate raw data into high-quality training inputs, improving vital training metrics such as throughput and accelerator utilization.
Key Responsibilities
- Perform data ablations to rigorously assess dataset quality and experiment with diverse data mixtures for enhancing model effectiveness.
- Design and implement robust data modeling and structuring methods to optimize training dataset formatting and efficiency.
- Investigate and apply innovative data curation strategies using Cohere’s infrastructure to advance natural language processing capabilities.
- Collaborate extensively with researchers and engineering teams to ensure data pipelines meet the stringent requirements of cutting-edge language models.
Required Qualifications
- Strong proficiency in software engineering, particularly with Python and constructing scalable data pipelines.
- Understanding of curriculum learning, data mixing techniques, and data attribution methodologies.
- Experience with large-scale data processing frameworks such as Apache Spark, Apache Beam, Pandas, or comparable tools.
- Prior experience managing extensive datasets including web, code-based, and multilingual corpora.
- Knowledge in methods for assessing data quality and experimenting with data combinations to improve results.
- Enthusiasm for integrating research with engineering to address complex data challenges in AI training.
Additional Preferred Qualifications
Having published research in premier conferences or journals such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL or EMNLP is advantageous.
Work Location and Culture
This position is remote-friendly with the option to work from any of Cohere's global offices. We value outstanding talent irrespective of geographic location while encouraging coordination within the EST to EU time zones.
Compensation and Benefits
- Competitive salary range from CA$250,000 to CA$535,000 annually.
- Weekly lunch allowance of $75 (or equivalent in local currency).
- Comprehensive health and dental coverage with dedicated mental health budgets.
- Retirement contributions including RRSP matching, 401K, or pension schemes.
- Full parental leave top-up for six months for any parent.
- Annual development benefits encompassing arts and culture, wellness, quality time, workspace upgrades, and education stipends for conferences and coaching.
- Six weeks (30 working days) of paid vacation.
- Travel budget for visiting other offices and annual company-wide offsite events.
- Home office setup stipend of $500.
- Office-based employees enjoy daily lunches, snacks, and social events; remote workers receive co-working space benefits.
Inclusion and Hiring Practices
Cohere is committed to fostering an inclusive environment and welcomes applicants from all backgrounds. Accommodations during recruitment can be provided upon request. Note that AI tools may assist in applicant screening but do not restrict recruiter review processes.
Security Note
Cohere strictly does not charge candidates for hiring services. Communications come solely from official @cohere.com or @cw.cohere email domains.