- Experience
- Any
- Salary
- —
- Openings
- 1
- Posted
- 23 hours ago
- Work mode
- Work from home
- Eligibility
- Open to all qualified individuals regardless of background or experience, focusing on skills and technical aptitude.
- Resume
- Required to apply
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
Position Summary
We are seeking a dedicated Quality Analyst to join our client’s team on a full-time remote basis. The primary focus is to evaluate a new AI personalization feature by examining how effectively the model integrates information from diverse personal data sources such as past conversations, email, search activity, and more, to provide relevant and accurate responses.
Key Responsibilities
- Critically assess personalized AI responses by leveraging your own personal experience as context.
- Develop innovative multi-turn prompts designed to challenge the AI’s ability to accurately incorporate personal data in responses.
- Analyze model-generated content for accuracy, relevance, and proper integration of information, identifying any erroneous personalization or forced links.
- Conduct comparative evaluations of side-by-side AI model outputs to identify nuanced differences in response quality.
- Provide comprehensive feedback to enhance the AI system’s personalization capabilities.
Qualifications and Skills
- Strong command of English, including reading and writing proficiency.
- Experience with prompt engineering or creating test scenarios for AI applications.
- Skill in critically analyzing ambiguous or subtle AI responses with thorough attention to detail.
- Understanding of AI personalization concepts and evaluation methodologies.
- Detail-oriented mindset to detect subtle inconsistencies in AI outputs.
- Willingness to utilize your personal primary Google account and enable access to personal data sources for evaluation purposes.
- Availability to work full-time in your local time zone to support a global, around-the-clock operation.
Additional Information
This opportunity allows you to contribute to innovative AI development with a leading global entity in the technology and information sector, driving impactful advancements in AI personalization. The employer is an equal opportunity organization focusing solely on candidates' skills and technical expertise, without bias regarding background or prior work history.