caferemote
mercor

DevOps Engineer - AI Model Evaluator

Remote United States Full-time Posted 2h ago
Apply now
Work from
United States
Contract
Full-time
Posted
9 November 2026
Apply by
9 December 2026

Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)Type:ContractCompensation:$85/hourLocation:Remote

About the role

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Requirements

  • 2+ years of professional DevOps, SRE, or Cloud Engineering experience.
  • Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling.
  • Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
  • Ability to evaluate model-generated infrastructure and reliability engineering solutions.

Nice to have

  • Experience supporting production-scale systems.

Compensation & Legal

  • $400 per accepted task.
  • Compensation is tied to accepted work.

Role Responsibilities

  • Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
  • Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD systems, observability, and infrastructure automation.
  • Identify bugs, edge cases, reliability issues, and failure modes.
  • Compare outputs from multiple frontier models and assess their strengths and weaknesses.
  • Apply professional engineering judgment to realistic infrastructure engineering scenarios.
  • Work independently and asynchronously to meet sprint-based project deadlines.

Resources & Support

  • For details about the interview process and platform information, please check:
  • For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

How to apply

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from mercor

View company →

Product Strategy Expert - Fully Remote | Upto $90/hr

mercor
Remote Canada Contract

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include…

2h ago Product

AI Adversarial Specialist - Fully Remote | Upto $62/hr

mercor
Remote Australia Full-time

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include…

2h ago Data

Astrophysics Specialist - Fully Remote | Upto $85/hr

mercor
Remote United States Contract

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include…

2h ago Data

Building Architect - Fully Remote | Upto $75/hr Part-time

mercor
Remote United States Full-time

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include…

2h ago Data

Similar remote jobs

Browse all →

DevOps Engineer

Rushdown Studios
Remote United States Full-time $100K – $150K / year

Founded by games industry veterans, Rushdown was created with a simple philosophy in mind: We believe that when talented developers are consistently challenged and given clear ownership of…

1h ago DevOps and Sysadmin

OT Cybersecurity Senior Manager

Accenture
Remote United States Full-time $112K – $338K / year

We Are Accenture is a leading solutions and services company that helps the world’s leading enterprises reinvent by building their digital core and unleashing the power of AI to create…

2h ago DevOps and Sysadmin

Cloud / DevOps Exploitation Specialist

CACI International Inc
Remote United States Full-time $90K – $189K / year

Job Title: Cloud / DevOps Exploitation SpecialistJob Category: Information TechnologyTime Type: Full timeMinimum Clearance Required to Start: Public TrustEmployee Type: RegularPercentage of…

2h ago DevOps and Sysadmin

Senior Platform Engineer

CivicPlus
Remote United States Full-time $104K – $156K / year

Your Impact The Senior Platform Engineer is a key technical leader on the Platform Engineering team, independently owning platform domains and driving their evolution. You design systems;…

3h ago DevOps and Sysadmin

Remote Senior Lead Engineer

Global Channel Management, Inc.
Remote United States Full-time

Remote Senior Lead Engineer needs 7+ years ' experience Remote Senior Lead Engineer requires: North Carolina (NC) District of Columbia (DC) Delaware (DE) Florida (FL) Georgia (GA) Maryland…

3h ago DevOps and Sysadmin

Engineering Manager, Proactive Security - Platform

DoorDash
Remote Canada, United States Full-time $193K – $285K / year

About the Team At DoorDash we’re building the industry’s most scalable and reliable delivery network to support our three-sided marketplace of Consumers, Merchants, and Dashers.…

3h ago DevOps and Sysadmin

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.