Remote Data Annotation Specialist

Overview

Rex.zone is seeking full-time remote specialists to conduct data annotation tasks supporting AI training for large language models and computer vision applications. Your role includes labeling data, performing reinforcement learning from human feedback (RLHF) evaluations, prompt assessments, and quality assurance to enhance training dataset quality and model performance across production workflows.

Key Responsibilities

• Annotate diverse data formats including text, images, and structured records adhering to comprehensive guidelines and rubrics.
• Execute NLP and computer vision labeling tasks such as named entity recognition, classification, data extraction, bounding boxes/polygons creation, and content safety tagging.
• Conduct RLHF preference rankings, pairwise item comparisons, and rubric-based scoring with well-documented justifications.
• Perform quality assurance evaluations, resolve complex edge cases, and flag unclear items for further review.
• Work collaboratively with project leads, reviewers, and engage in calibration processes to ensure annotation consistency.

Qualifications

• Intermediate to senior-level experience in data annotation or labeling with demonstrable quality outcomes.
• Competency in consistently applying detailed annotation rubrics and crafting clear QA rationale documentation.
• Understanding of RLHF methodologies, prompt evaluation strategies, and indicators used in large language model assessments.
• Proficient English reading and professional writing skills for interpreting guidelines and reporting issues.

Quality and Performance Metrics

• Performance is evaluated based on adherence to guidelines, audit success rates, accuracy in calibration tasks, and consistency among annotators.
• Feedback is periodically shared through review notes, audits, and calibration meetings to maintain high standards.