caferemote
mercor

AI Rubric Reviewer - Fully Remote | Up to $75/hr

Remote India Contract $40 – $75 / hour Posted 3 days ago
Apply now
Work from
India
Contract
Contract
Salary
$40 – $75 / hour
Posted
18 November 2026
Apply by
17 January 2027

Position: AI Evaluation Rubric ReviewerType:ContractCompensation:$40–$75/hourLocation:Remote

About the role

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Requirements

  • Substantial experience writing or reviewing rubrics for LLM evaluations.
  • Ability to read long agent transcripts and identify errors.
  • Precise writing skills and a commitment to data verification.

Role Responsibilities

  • Review AI-drafted tasks and evaluate model attempts for fairness and accuracy.
  • Assess if the grading rubric aligns with the prompt and correct any unfair criteria.
  • Flag tasks that cannot be saved and provide concise feedback on each evaluation.
  • Analyze long agent transcripts to identify errors and improve AI model performance.
  • Ensure rubric structures are correct per guidelines and enhance training data quality.

Resources & Support

  • For details about the interview process and platform information, please check:
  • For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

How to apply

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from mercor

View company →

Accounting Expert - CPA Certified

mercor
Remote India Contract $130 – $160 / hour

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include…

6h ago Management and Finance

Audio Engineer - Fully Remote | Up to $10/task

mercor
Remote United Kingdom Contract

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include…

8h ago Software Development

Audio Engineer - Fully Remote | Upto $16/hr

mercor
Remote United Kingdom Contract $16 / hour

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include…

8h ago Software Development

AI Software Engineer - Task Curator

mercor
Remote United States Contract $60 – $90 / hour

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include…

8h ago Data

Similar remote jobs

Browse all →

Systems Analyst

Koniag Government Services
Remote United States Full-time $110K – $145K / year

Applications for this position will be accepted through 11/15/26 Koniag IT Systems, LLC a Koniag Government Services company, is seeking a Systems Analyst to support KITS and our government…

1h ago Data

Sr Data Analyst

Alignment Health
Remote United States Full-time $113K – $169K / year

Alignment Health is breaking the mold in conventional health care, committed to serving seniors and those who need it most: the chronically ill and frail. It takes an entire team of…

1h ago Data

Senior Analyst, Revenue Management

OPENLANE
Remote United States Full-time $90K – $110K / year

Who We Are: At OPENLANE we make wholesale easy so our customers can be more successful. We’re a technology company building the world’s most advanced—and uncomplicated—digital…

1h ago Data

Manager, Data Product Management

wex
Remote United States Full-time $133K – $159K / year

About the Team/Role WEX Data & Analytics is building the data products and platform capabilities that help employers, partners, and operators access accurate, actionable information. As we…

1h ago Data

Centralized Study Specialist I, Remote US

Fortrea
Remote United States Full-time $60K – $80K / year

Job Responsibilities: Manage clinical systems. Manage study documents and support eTMF management. Maintain study databases (CTMS, IWRS, EDC, etc.) Track and follow up with CRAs for…

1h ago Data

F-35 Data Analyst Mid - 31190 (Arlington, VA, Virginia, United States)

HII
Remote United States Full-time $90K – $110K / year

Requisition Number: 31190 Required Travel: 0 - 10% Employment Type: Full Time/Salaried/Exempt Anticipated Salary Range: $90,000.00 - $110,000.00 Security Clearance: Ability to Obtain Level…

1h ago Data

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.