Data Science Expert

About the Role

We are representing a prominent AI research organization seeking skilled Data Science Experts to assist in assessing the effectiveness of AI systems performing complex real-world data science tasks. This position involves developing rigorous evaluation frameworks and critically reviewing AI-generated outcomes with objective, evidence-supported feedback rather than direct modeling or business analysis work.

Key Responsibilities

• Create comprehensive, task-specific evaluation standards for data science deliverables such as data analyses, predictive and statistical models, dashboards and visualizations, experimental outcomes, and executive-level insights.
• Assess both AI-produced and human-generated outputs using structured scoring methods.
• Provide thorough written rationales for each evaluation to maintain technical precision and consistency.
• Employ analytical judgment to generate reproducible, defensible assessments.
• Integrate reviewer feedback to continuously enhance evaluation procedures.
• Work collaboratively across teams to elevate AI training processes and uphold evaluation quality standards.

Qualifications

• Minimum of five years' industry experience in Data Science.
• Strong expertise in business operations, product or growth analytics, or related analytical domains within technology firms.
• Proficiency in experimental design, A/B testing, statistical methods, SQL, Python, metric development, and interpreting analysis into actionable business insights.
• Exceptional written communication skills capable of explaining technical reasoning clearly.
• Meticulous attention to detail and ability to apply consistent evaluations using structured rubrics.
• Ability to accept feedback constructively and collaborate on standardizing evaluation criteria.
• Preferred experience includes contributing to AI evaluation, training or data annotation projects, familiarity with large language models, AI-assisted analytics, or machine learning workflows, and experience mentoring or reviewing analytical teams.

Additional Information

• Engagement is as an independent contractor.
• Work is fully remote with flexible hours.
• Project length may vary depending on needs and performance.
• Compensation ranges from $120 to $170 per hour, paid weekly upon approved work completion.
• H1-B and STEM OPT visa sponsorships are not available.

Application Process

• Submit your resume or detailed technical background to initiate consideration.
• Selected candidates may be asked to complete a brief technical evaluation or provide further details of expertise.

Why Work With Us?

• Influence the advancement of next-generation AI capable of sophisticated analytical reasoning.
• Use your professional data science skills on impactful AI evaluation projects.
• Enjoy remote employment with flexible schedule options.
• Collaborate with an experienced professional network focused on AI quality and reasoning development.

We encourage candidates of diverse backgrounds to apply and are committed to equitable recruitment with reasonable accommodations.