- Work from
- Worldwide
- Contract
- Full-time
- Salary
- $20 – $45 / hour
- Posted
- 16 November 2026
- Apply by
- 15 January 2027
You will provide structured feedback that helps make model responses more accurate, helpful, and safe.
About the role
Join a project-based expert network supporting AI model evaluation and improvement.
Responsibilities
- Rank and compare model responses to identify the strongest answer.
- Rate responses for accuracy, helpfulness, tone, and safety using detailed rubrics.
- Review individual reasoning steps and label them as correct or incorrect.
- Write concise rationales to explain ratings and decisions.
- Fact-check claims using reliable sources.
- Evaluate responses against content policies and style guides.
- Assess search result relevance and provide live feedback on model outputs during sessions.
Requirements
- Zero to five years of relevant professional experience.
- Native or near-native written English proficiency and excellent attention to detail.
- Experience rating, reviewing, fact-checking, editing, moderating content, or grading work against written guidelines.
- Experience applying a rubric or style guide consistently across a large number of items.
- A degree or work background in a field where you can assess answers, such as writing, journalism, research, teaching, trust and safety, mathematics, science, law, medicine, or finance.
- Experience with AI data labeling, preference ranking, response rating, search quality rating, or ads rating is helpful but not required.
Salary
Compensation ranges from $20 to $45 per hour depending on the project, field, and experience level. Compensation Range: $41.6K - $93.6K
Compensation & Benefits
You are paid for hours worked.
Location
Fully remote. Projects typically last from one week to several months.
R
N
C
M
J
P
Discussion
No comments yet. Ask a question or share a tip about this role.