caferemote
RemoteJobsOne

Domain Contributor - Evaluation Specialist – Remote (Worldwide)

Remote Canada, France, Germany, India, Netherlands, Pakistan, United Kingdom, United States Contract $30 – $60 / hour Posted yesterday
Apply now
Work from
Canada, France, Germany, India, Netherlands, Pakistan, United Kingdom, United States
Contract
Contract
Salary
$30 – $60 / hour
Posted
20 November 2026
Apply by
19 January 2027

In this role, you'll apply your expertise to help train next-generation AI systems.

IMPORTANT: after you apply, please check your email. We sendyou a link to complete your application — it is not considered until that laststep is done. If you do not see it, check your spam folder.

Pay: $30–$60/hr

Role Title: Domain Contributor - Evaluation Specialist

Role Type: Contractor (~15 hrs/week)

Location: Remote

We are engaging Domain Contributor - Evaluation Specialists to support an internal project evaluating and improving advanced AI models. Your work will shape how models learn, reason, and perform through high-quality, real-world input. Flexible, pay-per-task work across history, law, finance, journalism, and tech, for experts with prior AI training experience.

Scope of Work

  1. Design nuanced, domain-specific tasks that probe AI model limits and surface reasoning flaws.
  2. Author questions and scenarios demanding deep subject knowledge, beyond general understanding.
  3. Assess AI-generated outputs, validating accuracy against authoritative, primary sources in your area of expertise.
  4. Document clear rationales for model shortcomings, specifying missed reasoning, source errors, or nuances.
  5. Apply detailed task guidelines and evaluation rubrics consistently to each submission.
  6. Submit completed deliverables independently on a rolling basis, meeting project requirements for written and verbal clarity.

Nice to have

  1. Proven hands-on experience with AI model training, annotation, RLHF, or evaluation.
  2. Deep expertise in a core domain: history, archival or library science, law (paralegal, legal academic, compliance), finance (equity research, PE/VC, forensic accounting), journalism, or technology/industry history.
  3. Advanced research skills with a track record of verifying complex claims against authoritative sources.
  4. Exceptional written and verbal communication skills to articulate findings and feedback.
  5. Demonstrated ability to precisely follow detailed instructions and evaluation frameworks.
  6. Background in adversarial or “stomp the model” task design is advantageous.
  7. Graduate-level research, experience at a Fortune 100 company, or professional fluency in a non-English language a plus.

Eligibility

  • This is a fully remote position, open to candidates based in 55 countries, including Pakistan, United States, United Kingdom, Canada, Germany, India, France, Netherlands.

Compensation Structure

Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.

Start Timeline & Availability

We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.

How to apply

Apply here with your profile. We will then email you a link to complete yourapplication on the hiring platform — your application is only considered oncethat final step is done.

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from RemoteJobsOne

View company →

Senior Industrial Trades and Maintenance Expert – Remote (Worldwide)

RemoteJobsOne
Remote Bangladesh, Canada, France, Germany, India, Netherlands, United Kingdom, United States Contract $20 – $60 / hour

IMPORTANT: after you apply, please check your email. We sendyou a link to complete your application — it is not considered until that laststep is done. If…

20h ago All Other Remote

UI/UX Designer – Remote (Worldwide)

RemoteJobsOne
Remote Canada, France, Germany, India, Netherlands, Nigeria, United Kingdom, United States Full-time $160K – $250K / year

IMPORTANT: after you apply, please check your email. We sendyou a link to complete your application — it is not considered until that laststep is done. If…

20h ago Design

STEM Expert – Biology & Bioinformatics (PhD) – Remote (Worldwide)

RemoteJobsOne
Remote Canada, France, Germany, India, Netherlands, Philippines, United Kingdom, United States Contract $45 – $90 / hour

IMPORTANT: after you apply, please check your email. We sendyou a link to complete your application — it is not considered until that laststep is done. If…

21h ago All Other Remote

English Language Expert (Great Britain) – Remote (Worldwide)

RemoteJobsOne
Remote Canada, France, Germany, India, Netherlands, Nigeria, United Kingdom, United States Contract $20 – $45 / hour

IMPORTANT: after you apply, please check your email. We sendyou a link to complete your application — it is not considered until that laststep is done. If…

21h ago Data

Similar remote jobs

Browse all →

Senior BI/DW Developer

Nextpower
Remote India Full-time

Job Description: BI/DW Architect (Finance Analytics & Insights) Position Summary The BI/DW Architect (Finance Analytics & Insights) is a strategic leader within the Global Controllership…

4h ago Data

Senior Analytics Solutions Lead – Power BI & Fabric

Cooper Equipment Rentals Limited
Remote Canada Full-time CAD 110K – CAD 130K / year

Build your Career at Cooper Equipment Rentals Please note, to be considered for this position applicants should currently be residing in Canada and legally entitled to work. Why Work with…

4h ago Data

ServiceNow Business Analyst

LIGHTFEATHER IO LLC
Remote United States Full-time $110K – $130K / year

LightFeather is seeking a Senior ServiceNow Business Analyst to lead the requirements gathering and process design for our federal agency clients. In this role, you will act as the critical…

4h ago Data

Senior Data Migration Specialist

WELLSTAR
Remote Canada Full-time CAD 75K – CAD 95K / year

Who we are At WELLSTAR , we are committed to reshaping Canadian healthcare by leveraging technology to address the administrative burdens that pull physicians away from their true calling,…

4h ago Data

Risk Adjustment Operations Senior Project Analyst

Datavant
Remote United States Full-time $103K – $121K / year

Datavant is the data collaboration platform trusted for healthcare. Guided by our mission to make the world’s health data secure, accessible and actionable, we provide critical data…

4h ago Data

Data Scientist

Timeleft
Remote Albania, Andorra, Austria, Belarus, Belgium, Bosnia and Herzegovina, Bulgaria, Croatia, Cyprus, Czechia, Denmark, Estonia, Faroe Islands, Finland, France, Germany, Gibraltar, Greece, Guernsey, Holy See (Vatican City State), Hungary, Iceland, Ireland, Full-time

⌘Role Overview The Data Scientist is the first hire on the team whose job is to put machine learning into production , not just into a notebook. You'll build models that power product and…

5h ago Data

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.