- Experience
- Any
- Salary
- —
- Openings
- 1
- Posted
- 12 ਘੰਟੇ ਪਹਿਲਾਂ
- Work mode
- Work from home
- Resume
- Required to apply
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
Role Summary
We are searching for an AI Quality Analyst to work remotely on a full-time basis for one of our clients. The position involves evaluating a new AI personalization feature that integrates past conversation histories, emails, search activity, and other data to generate customized responses. This role combines inventive prompt creation with careful analysis of AI-generated outputs.
Primary Responsibilities
- Assess the quality of AI-generated personalized replies using your own personal data as a contextual reference.
- Develop creative, multi-turn prompts designed to thoroughly test the model’s ability to integrate multiple personal data sources.
- Evaluate AI responses for accuracy, grounding, and helpful integration, identifying any incorrect personalization or fabricated links.
- Conduct side-by-side comparisons of various AI outputs to detect nuanced differences in relevance and precision.
- Offer comprehensive feedback on AI behavior to enhance the effectiveness of personalization features.
Qualifications and Skills
- Proficient in English with excellent reading and writing skills.
- Experienced in prompt engineering or designing test cases specifically for AI models.
- Strong analytical skills to interpret subtle and ambiguous AI responses rigorously.
- Knowledgeable about AI personalization principles and relevant evaluation metrics.
- Highly attentive to details to notice minor inconsistencies in model outputs.
- Comfortable using your primary Google account and enabling related personal data sources for evaluation purposes.
- Able to dedicate full-time hours aligned with your local time zone to support a global 24-hour operation.
Additional Information
This role presents an exciting chance to work with a global leader in technology and information services, contributing directly to the advancement of impactful AI systems.
Equal Employment Opportunity
We select candidates solely based on expertise and relevant skills regardless of background or previous job history. Every qualified applicant is invited to apply and will be assessed fairly.