Quality Analyst - AI Personalization (English)

Role Overview

This position is for a Quality Analyst working remotely to evaluate AI personalization features. The focus is on assessing how effectively an AI model incorporates information from previous interactions such as conversations, emails, searches, and user activity to generate personalized, relevant responses.

Key Responsibilities

• Assess the quality of AI-generated personalized responses using your own life experiences as contextual input.
• Create innovative, multi-turn prompts that challenge the AI model's integration of personal data sources.
• Analyze AI outputs for correctness in personalization, strong data integration, and overall helpfulness, identifying any faulty or forced personal connections.
• Compare AI responses side-by-side to identify subtle variations in relevance and accuracy.
• Provide comprehensive feedback to improve AI personalization and response quality.

Required Qualifications and Skills

• Advanced proficiency in English reading and writing.
• Experience with prompt engineering or designing evaluation cases for AI systems.
• Strong analytical capability to evaluate nuanced and ambiguous AI responses rigorously.
• Familiarity with personalization principles and relevant AI assessment metrics.
• Exceptional attention to detail to detect subtle inconsistencies in AI outputs.
• Willingness to utilize your primary personal Google account enabling access to personal data sources for testing.
• Availability for full-time work aligned with your local time zone to support a global team operating 24/7.

Additional Details

This opportunity allows you to collaborate with a leading global technology organization dedicated to advancing AI systems that have tangible business effects. The employer is committed to equal opportunity, considering applications purely on technical skills and qualifications regardless of background or previous employment.