Remote Data Labeling Specialist

About Rex.zone

Rex.zone is recruiting remote professionals in Ottawa to perform data labeling tasks that support artificial intelligence and machine learning workflows. The focus is on generating and assessing high-quality training datasets for large language models and computer vision applications, thereby enhancing both data accuracy and overall model effectiveness.

Job Responsibilities

• Annotate and quality-check data across multiple formats including text, images, audio, and video utilizing specific annotation platforms and taxonomies
• Adhere closely to annotation standards and compliance protocols while thoroughly documenting any ambiguous or exceptional cases to maintain uniform labeling practices
• Perform reward learning with human feedback (RLHF) activities such as preference ranking, comparison of pairs, and rubric-based assessments for outputs generated by language models
• Evaluate prompts and grade responses for attributes like usefulness, accuracy, and safety
• Carry out quality assurance inspections by auditing a subset of annotated data, analyzing agreement levels across annotators, and escalating unclear issues
• Apply named entity recognition and structured extraction techniques for natural language processing datasets
• When assigned, provide support with computer vision annotations including drawing bounding boxes, segmentation masks, and key point identification
• Label content for policy compliance involving categories such as hate speech, harassment, self-harm, and sexually explicit material as needed
• Offer constructive suggestions to refine annotation guidelines, clarify ambiguities, and increase efficiency without compromising quality

Candidate Requirements

• Mid to senior-level experience in data annotation roles within AI or ML production environments
• Experience participating in large language model evaluation processes, specifically RLHF, prompt appraisal, or quality assurance assessments
• Excellent written communication skills paired with analytical reasoning for explaining labeling decisions and resolving disputes
• Ability to work independently in a remote setting, managing asynchronous collaboration, meeting quality benchmarks, and responding to auditing feedback

Compensation Details

The position offers an hourly wage between 30 and 50 US dollars.