caferemote
Terac

Subject Matter Experts: Machine Learning Model Evaluation

Remote United States Contract $75 / hour Posted 7 days ago
Apply now
Work from
United States
Contract
Contract
Salary
$75 / hour
Posted
14 November 2026
Apply by
13 January 2027

You will evaluate these responses for accuracy, relevance, and overall quality using a structured rating system. You will also provide brief written justifications for your ratings to help us understand your evaluation process.

What We're Researching

We are running a paid study to evaluate the quality and accuracy of machine learning model outputs. This work directly informs how AI systems handle complex research tasks and domain-specific prompts. By analyzing these generated responses, we can better understand where current models succeed and where they require further refinement.

How It Works

Participants will review a series of machine learning model outputs generated in response to specific research prompts. The project involves approximately five hours of independent work, which you can complete asynchronously.

Who This Is For

We are looking for subject matter experts across various academic and professional domains with a strong eye for detail. We welcome researchers, data analysts, technical writers, and domain specialists who can critically assess complex information. If you have experience evaluating technical content or research data, you will be a great fit for this project.

Responsibilities

  • Review machine learning model outputs across a variety of research tasks
  • Rate AI-generated responses for accuracy, relevance, and factual correctness
  • Provide clear written justifications for your evaluation scores
  • Complete approximately five hours of asynchronous evaluation work

Eligibility

  • Professional or academic expertise in a specialized domain
  • Strong critical thinking and analytical skills
  • Comfortable reading and assessing complex technical or research-focused text
  • Ability to commit approximately five hours to complete the evaluation tasks

Salary

$75 per hour

About Terac

Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.

Learn more at or on YouTube at @jointerac.

How to apply

Start your paid interview now

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from Terac

View company →

AML and Compliance Experts: AI Training Tasks

Terac
Remote United States Contract $100 / hour

What We're Researching We're running a paid project focused on evaluating and training artificial intelligence models for complex financial compliance tasks.…

23h ago Data

Computational Biologists (Wet Lab): Building Research Tasks for AI Training

Terac
Remote United States Contract

What We're Researching We're hiring computational biologists and wet lab scientists to develop highly technical prompts and tasks for artificial intelligence…

23h ago Data

Software Developers: Interview on AI Assistant Integrations

Terac
Remote United States Contract $85 / hour

What We're Researching We are running a paid study on how developers approach building integrations for AI assistants. This research helps us understand the…

23h ago Software Development

Car Owners: 25-Minute Survey on Automotive Ownership Experiences

Terac
Remote United States Contract

What We're Researching We're running a paid study on automotive ownership and the day-to-day realities of maintaining a luxury personal vehicle. Your feedback…

23h ago Sales and Marketing

Similar remote jobs

Browse all →

AI Safety Expert - Bilingual

mercor
Remote United States Contract $17 – $25 / hour

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter…

2h ago Data

Senior AI & Transformation Enablement Specialist

Datasite
Remote United States Full-time $83K – $141K / year

About us Datasite is the essential infrastructure for M&A. Also comprising Grata, Blueflame AI, and Sherpany, we help dealbreakers find opportunities, manage transactions, and make key…

2h ago Data

Business Analyst III Claims, DRG

Centene Corporation
Remote United States Full-time $70K – $126K / year

Position Purpose: Perform various analysis and interpretation to link business needs and objectives for assigned function. Key Details: Must be authorized to work in the U.S. without the…

2h ago Data

Functional Consultant – Epicor Kinetic (Operations & Supply Chain) – 100% Remote

TeccWeb
Remote United States Full-time

About Teccweb Teccweb is an Epicor Service Partner specializing in the implementation and optimization of Epicor Kinetic for mid-market manufacturers and distributors across North America.…

2h ago Data

Product Owner

Dev Partners
Remote Philippines Full-time

💻 We Are Hiring- Product Owner | 100% Remote We are seeking an experienced Product Owner to oversee and coordinate the ongoing maintenance, enhancement, and continuous improvement of an…

3h ago Data

Mechanical Engineer III

DLB Associates
Remote United States Full-time $105K – $135K / year

DLB Associates is a premier engineering and consulting firm specializing in innovative, mission-critical solutions across hyperscale data centers, advanced infrastructure, and…

3h ago Data

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.