- Work from
- Worldwide
- Contract
- Full-time
- Salary
- $20 – $45 / hour
- Posted
- 18 November 2026
- Apply by
- 17 January 2027
Join a talent pool supporting AI model evaluation and improvement through careful, structured feedback. This flexible, project-based work helps improve the quality, accuracy, and safety of AI systems.
Responsibilities
- Compare and rank model responses to identify which performs better.
- Rate answers for accuracy, helpfulness, tone, and safety using detailed rubrics.
- Label reasoning steps as correct or incorrect and write concise rationales for your ratings.
- Fact-check claims against reliable sources and assess compliance with content policies and style guides.
- Evaluate search result relevance and provide live feedback on model outputs during sessions.
Requirements
- Zero to five years of relevant professional experience.
- Native or near-native written English and meticulous attention to detail.
- Experience rating, reviewing, fact-checking, editing, moderating, or grading work against written guidelines.
- A degree or work background in a field you can evaluate, such as writing, journalism, research, teaching, trust and safety, mathematics, science, law, medicine, or finance.
- Ability to apply rubrics or style guides consistently across many items.
- Experience with AI data evaluation platforms, search quality rating, or ads rating is useful but not required.
Salary
Compensation is $20 to $45 per hour, depending on the project, field, and experience.
Compensation & Benefits
Pay is based on hours worked.
Location
Fully remote. Projects typically run from one week to several months.
S
L
O
S
D
Discussion
No comments yet. Ask a question or share a tip about this role.