AI Model Evaluation Specialist

About the Role

We are looking for a seasoned professional to assess and enhance the quality of our AI models by conducting detailed tests and analyses. This role involves creating evaluation frameworks, performing model assessments, and delivering practical insights aimed at improving model performance.

Key Responsibilities

• Develop and apply evaluation metrics tailored for AI models
• Perform extensive testing of model accuracy under varied conditions
• Examine model outputs to identify biases, ensure fairness, and validate accuracy
• Work closely with machine learning engineers to apply enhancements based on findings
• Prepare comprehensive documentation outlining results and suggestions for improvement

Candidate Profile

• Holds a PhD or Master's degree in Computer Science, Machine Learning, or a closely related discipline
• Brings over five years of experience specifically in AI/ML model evaluation
• Possesses a strong foundation in statistical analysis methodologies
• Experienced with a variety of evaluation frameworks and performance metrics
• Exhibits excellent communication skills for reporting and collaboration