Job description

Role Overview

We are seeking a Machine Learning Analyst to join our client’s team on a full-time basis. This position involves practical analytical work with production-level datasets, machine learning metrics, and outputs to assess, diagnose, and enhance the functioning of sophisticated AI systems. The suitable candidate will have expertise at the crossroads of data analysis and machine learning, demonstrating strong analytical precision and the ability to manage real datasets alongside ML evaluation processes.

Key Responsibilities

Examine both structured and unstructured datasets derived from ML training, inference, and evaluation pipelines.
Establish, calculate, and verify metrics crucial for assessing model performance and behavior.
Analyze data distributions, model results, failure points, and edge cases pertinent to benchmarking tasks.
Develop and execute Python and SQL code to process data, generate reports, and support evaluation workflows.
Ensure data integrity, consistency, and accuracy across various datasets and experiments.

Required Skills and Qualifications

At least 3 years of experience in roles focused on data analysis or analytics engineering.
Proficient in Python programming geared toward data analysis.
Experienced working with SQL and relational databases.
Familiarity with analyzing machine learning outputs and evaluation metrics.
Solid foundation in statistical concepts and analytical thinking.

About the Opportunity

This position offers a chance to collaborate with a worldwide leader in software development and data infrastructure, contributing to benchmark-based evaluation projects involving practical machine learning systems. The role involves partnering with ML engineers and researchers to craft demanding evaluation challenges.

Equal Employment Opportunity

We prioritize hiring based on skills and expertise without bias toward background, experience, or previous employment. Applications are assessed solely on technical capability and qualifications.