caferemote
micro1

AI Agent Evaluator

Remote United States Contract $25 – $45 / hour Posted 4 days ago
Apply now
Work from
United States
Contract
Contract
Salary
$25 – $45 / hour
Posted
16 November 2026
Apply by
15 January 2027

AI agents are starting to handle real-life errands: paying bills, booking trips, doing the groceries. We want to know how well they actually do it, from the point of view of a real user.

Role Title: AI Agent Evaluator

Role Type: Contractor

Location: Remote — U.S Based

Opportunity Snapshot

Pay: $25-45/hour

Time per task: ~1.5 hours per run (evidence and scoring included)

Onboarding: Once you are presented to the hiring manager, onboarding typically takes 24–48 hours before you can start tasking.

You’ll need: An active personal popular AI account (Free, Go, or Plus, Pro), an active personal and a smartphone that can screen record

About the role

That’s you.

You’ll test two AI agents side by side, using your own accounts on your phone, and tell us what worked, what didn’t, and how it felt.

Responsibilities

Your tasks

Run everyday errands with two AI agents, approve key steps, screen record, and score the results

What you’ll do

  1. Run real-life scenarios: bills, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms
  2. Approve or stop the agent at key steps
  3. Screen record every attempt
  4. Score each run on completion, quality, control issues, satisfaction, and time
  5. Share clear written feedback on the agent experience

Eligibility

  1. Based in the U.S, with a bachelor’s degree.
  2. Someone who already uses AI in daily life
  3. 2-3 years of experience, preferably in engineering, business management, or office/operations
  4. Detail-oriented, great at following instructions and documenting each step
  5. Clear written communication
  6. Generalists welcome, domain experts preferred
  7. No coding or AI background needed

Why you’ll like it

  1. Get paid to use the AI tools you already use
  2. Work entirely from your phone, on your schedule
  3. Have a direct say in how next-generation AI agents get built and improved

How the selection process works

  1. Apply
  2. Complete the screening questions
  3. Interview: 15-30 minutes max
  4. Profile review: if everything looks good, we present you to the client
  5. Onboarding: our Talent Ops team will contact you to get you started

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from micro1

View company →

GPU Programming Software Engineer

micro1
Remote Worldwide Full-time $50 – $120 / hour

Role Title: GPU Programmer Software Engineer Role Type : Contractor Location : Remote In this role, you will apply your expertise as a GPU programmer to design…

10h ago Software Development

CUDA Engineering Expert

micro1
Remote Worldwide Contract $60 – $120 / hour

Role Title: CUDA Engineering Expert Role Type: Contractor Location: Remote micro1 is engaging CUDA Engineering Experts to contribute to a cutting-edge customer…

10h ago Software Development

Music Teacher

micro1
Remote Worldwide Contract $15 – $45 / hour

Role Title: Music Teacher Role Type: Contractor Location: Remote micro1 is engaging Music Teachers to contribute their expertise to a dynamic customer project…

13h ago All Other Remote

Telecommunications Customer Support Specialist

micro1
Remote Worldwide Contract $18 – $28 / hour

Role Title: Telecommunications Customer Support Specialist Role Type: Contractor Location: Remote micro1 is engaging Telecommunications Customer Support…

16h ago Customer Support

Similar remote jobs

Browse all →

AI Safety Expert - Bilingual

mercor
Remote United States Contract $17 – $25 / hour

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter…

1h ago Data

Senior AI & Transformation Enablement Specialist

Datasite
Remote United States Full-time $83K – $141K / year

About us Datasite is the essential infrastructure for M&A. Also comprising Grata, Blueflame AI, and Sherpany, we help dealbreakers find opportunities, manage transactions, and make key…

2h ago Data

Business Analyst III Claims, DRG

Centene Corporation
Remote United States Full-time $70K – $126K / year

Position Purpose: Perform various analysis and interpretation to link business needs and objectives for assigned function. Key Details: Must be authorized to work in the U.S. without the…

2h ago Data

Functional Consultant – Epicor Kinetic (Operations & Supply Chain) – 100% Remote

TeccWeb
Remote United States Full-time

About Teccweb Teccweb is an Epicor Service Partner specializing in the implementation and optimization of Epicor Kinetic for mid-market manufacturers and distributors across North America.…

2h ago Data

Product Owner

Dev Partners
Remote Philippines Full-time

💻 We Are Hiring- Product Owner | 100% Remote We are seeking an experienced Product Owner to oversee and coordinate the ongoing maintenance, enhancement, and continuous improvement of an…

2h ago Data

Mechanical Engineer III

DLB Associates
Remote United States Full-time $105K – $135K / year

DLB Associates is a premier engineering and consulting firm specializing in innovative, mission-critical solutions across hyperscale data centers, advanced infrastructure, and…

3h ago Data

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.