Remote Data Labeling Specialist

Position Overview

Rex.zone seeks skilled Remote Data Labeling Specialists based in Manchester to develop and validate labeled datasets critical for training and assessing AI technologies, including natural language processing, computer vision, content safety labeling, and large language model evaluation, such as reinforcement learning from human feedback (RLHF) and prompt assessment.

Key Responsibilities

• Annotate and verify text and multimodal datasets for NLP and computer vision tasks.
• Conduct RLHF preference ranking and quality assurance to facilitate large language model assessments.
• Perform prompt evaluations assessing instruction adherence, veracity, and usefulness.
• Implement content safety labeling adhering to policies, ensuring consistent explanations and documentation.
• Monitor data quality metrics, including performance on gold standards, consensus reviews, adjudication findings, and agreement rates, and report any guideline deficiencies.
• Maintain detailed audit trails, documenting decisions, disagreement rationales, and edge cases.
• Operate in secure environments while following stringent data confidentiality and handling protocols.

Required Qualifications

• Mid to senior level experience in data labeling, annotation, quality assurance, or related roles in data operations.
• Exceptional attention to detail and proficiency in adhering to complex annotation standards.
• Familiarity with named entity recognition, classification taxonomies, or structured labeling systems.
• Competence in working with ambiguous linguistic content and challenging cases in large language model training workflows.
• Effective communication skills to consistently explain labeling decisions and align with reviewers.
• Reliable internet connectivity and capability to work efficiently in a fully remote environment.

Compensation and Work Details

• Hourly wage ranges between $30 and $50 (USD).
• Position type: Full-time.
• Work mode: Remote, targeted at Manchester-based candidates.