AI Labeling & Evaluation Agent (Russian-Speaking)

About the Role

Join a global technology and services leader dedicated to advancing Artificial Intelligence solutions. Based in Lisbon, Portugal, this full-time, onsite position as an AI Labeling & Evaluation Agent focuses on assessing AI-generated outputs to enhance the quality and reliability of Large Language Models (LLMs).

Key Responsibilities

• Critically review AI-generated responses following comprehensive quality standards.
• Generate precise and consistent labels for outputs produced by language models.
• Evaluate content for factors such as quality, relevance, factual correctness, safety, and adherence to policies.
• Implement complex annotation procedures across various scenarios.
• Detect inconsistencies and unusual cases, escalating concerns when necessary.
• Maintain high-quality results while fulfilling productivity and accuracy objectives.
• Handle structured linguistic data and AI-produced content meticulously.
• Protect sensitive information and conform to project quality protocols.
• Contribute feedback to drive ongoing AI system improvements through careful evaluations.

Candidate Requirements

• Fluent Russian language skills both spoken and written (C1 level), along with good English proficiency (B2 level).
• Background in AI data annotation, evaluating large language models, reinforcement learning from human feedback (RLHF), supervised fine-tuning (SFT), quality assurance, content labeling, trust and safety, or other related analytical roles.
• Strong analytical abilities, keen attention to detail, and an objective approach to decision-making.
• Ability to interpret and apply intricate written instructions consistently.
• Excellent comprehension of written language and comfort with structured texts and data-driven evaluation assignments.
• Familiarity with generative AI technologies, large language models, and relevant annotation tools.
• Availability for rotating shift schedules if necessary.

Benefits and Opportunities

• Competitive remuneration package.
• Comprehensive paid training and ongoing opportunities for skill enhancement.
• Practical experience working with generative AI and data annotation platforms.
• Opportunities for career advancement within a leading global tech organization.
• Access to free learning and leadership development programs.
• Diverse, international, and multicultural workplace environment.
• Central location in Lisbon for convenient access.
• Referral bonuses through a bring-a-friend program.

Additional Information

Concentrix is an equal opportunity employer committed to creating an inclusive work atmosphere free from discrimination or harassment. Recruitment decisions are strictly based on business needs and candidates' qualifications without bias regarding race, gender identity, sexual orientation, religion, or other protected attributes.

Work Eligibility: Candidates must have legal authorization to work in Portugal as per national law.