caferemote
Epoch AI

Software Engineer, Cybersecurity Benchmarks

Remote United States Full-time $150K – $350K / year Posted 9 days ago
Apply now
Work from
United States
Contract
Full-time
Salary
$150K – $350K / year
Posted
12 November 2026
Apply by
11 January 2027

We are looking for a Research Engineer to help us build trustworthy, public evaluations of AI cybersecurity capabilities as part of our AI Benchmarking Hub. You will work closely with the benchmarking team, researchers, analysts and other engineers to design benchmarks, run them on our infrastructure, and make sure the results are accurate and feed into our research.

Epoch AI is looking for a Software Engineer, Cybersecurity Benchmarks who will help us measure how capable frontier AI models are at cybersecurity, and keep those measurements safe to run. The role will involve building and owning cybersecurity benchmarks, securing our evaluation environments against AI escape, and using threat modelling to shape our evaluation strategy.

About the role

Your day-to-day activities will include building and maintaining cybersecurity benchmarks (primarily in the Inspect library), hardening the sandboxes they run in, and keeping our benchmarks running so we can evaluate new model releases quickly. An ideal candidate for this role might have a background in red teaming and sandboxing software, alongside strong software engineering experience and hands-on familiarity with AI coding harnesses. Your work will be key to giving researchers, developers and policymakers an independent, rigorous picture of what AI can do in cybersecurity.

Responsibilities

Cybersecurity benchmarks

  • Design, build and maintain cybersecurity benchmarks for AI within our evaluation infrastructure, primarily using the Inspect library
  • Pitch and prototype your own ideas for new benchmarks and experiments
  • Keep the suite running so we can evaluate new model releases quickly and painlessly

Secure evaluation environments

  • Sandbox and harden our evaluation environments so highly capable AI models cannot escape them
  • Stay current on how AI agents and coding harnesses interact with their environments

Evaluation strategy and threat modelling

  • Use threat modelling to inform our benchmarking approach and decide what we measure
  • Provide strategic input on our AI cybersecurity evaluation strategy

Infrastructure and collaboration

  • Integrate with AI providers and set up benchmarks to run on our infrastructure
  • Work with researchers, analysts and other engineers to ensure evaluation data and outputs are accurate, insightful, and integrated into our research products and publications

Requirements

  • Strong software engineering experience, including several years building and maintaining complex systems and regularly contributing robust, maintainable code
  • Experience sandboxing software against highly capable adversaries
  • Red team experience ethically hacking software
  • Familiarity with agentic AI use and coding harnesses
  • Ideas and creativity: you can generate your own ideas for new benchmarks and experiments
  • Motivation from Epoch AI’s mission to provide rigorous, independent insight into key trends in AI, including delivering public, trustworthy evaluations of AI capabilities

Nice to have

  • Experience benchmarking AIs and running evaluations
  • Experience setting up CTF infrastructure
  • Experience using modern AI for red teaming or ethically hacking
  • Knowledge of the inner workings of AI coding harnesses and tool calls
  • Familiarity with inspect_ai
  • A solid grasp of current AI trends

If you don’t tick all these boxes but think you would be a great fit, please consider applying anyway!

Practicalities

Location: Fully remote. We are able to hire in many countries.

Work Hours: Full-time, flexible. We prefer candidates who can overlap with UTC–8 (Pacific Time) and UTC (Greenwich Mean Time).

Travel Requirement: None required. We prefer candidates who can travel to our three retreats per year.

Compensation: $150,000 to $350,000

Application Deadline: Applications are reviewed on a rolling basis

Start Date: As soon as selected candidate is available

Reports to: CTO

Additional Information

Please submit all of your application materials in English and note that we require professional level English proficiency.

Please do not include a cover letter, photograph, or headshot of yourself, or any personal information that is not relevant to the role for which you're applying (including marital status, age, identity traits, etc.).

Epoch is committed to building an inclusive, equitable, and supportive community for you to thrive and do your best work. We’re committed to finding the best people for our team, so please don’t hesitate to apply for a role regardless of your age, gender identity/expression, political identity, personal preferences, physical abilities, veteran status, neurodiversity or any other background. Please if you have any questions about this role, accessibility requests, or if you want to request an extension to the application deadline. However, we will not review applications submitted to this email address; please submit your application through the link on this page.

Epoch AI is a research institute that investigates trends in machine learning and the economic consequences of AI. Our mission is to develop a comprehensive, publicly accessible knowledge base on AI that informs policymakers, industry leaders, and society at large.

We strive to achieve both rigor and accessibility to our work, as exemplified by some of our most successful projects, including our database of AI models and our AI trends dashboard. Our body of research includes our work on compute trends (IJCN 2022), data scarcity (ICML 2024), and algorithmic progress (NeurIPS 2024). You can read more about our work and mission on our website and in this Time profile.

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from Epoch AI

View company →

Product Designer

Epoch AI
Remote United States Full-time $100K – $150K / year

Epoch AI is looking for designers to help us turn complex research on AI into dashboards and data visualizations. We are open to two different areas of…

yesterday Data

Similar remote jobs

Browse all →

AI Safety Expert - Bilingual

mercor
Remote United States Contract $17 – $25 / hour

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter…

just now Data

Senior AI & Transformation Enablement Specialist

Datasite
Remote United States Full-time $83K – $141K / year

About us Datasite is the essential infrastructure for M&A. Also comprising Grata, Blueflame AI, and Sherpany, we help dealbreakers find opportunities, manage transactions, and make key…

1h ago Data

Business Analyst III Claims, DRG

Centene Corporation
Remote United States Full-time $70K – $126K / year

Position Purpose: Perform various analysis and interpretation to link business needs and objectives for assigned function. Key Details: Must be authorized to work in the U.S. without the…

1h ago Data

Functional Consultant – Epicor Kinetic (Operations & Supply Chain) – 100% Remote

TeccWeb
Remote United States Full-time

About Teccweb Teccweb is an Epicor Service Partner specializing in the implementation and optimization of Epicor Kinetic for mid-market manufacturers and distributors across North America.…

1h ago Data

Product Owner

Dev Partners
Remote Philippines Full-time

💻 We Are Hiring- Product Owner | 100% Remote We are seeking an experienced Product Owner to oversee and coordinate the ongoing maintenance, enhancement, and continuous improvement of an…

2h ago Data

Mechanical Engineer III

DLB Associates
Remote United States Full-time $105K – $135K / year

DLB Associates is a premier engineering and consulting firm specializing in innovative, mission-critical solutions across hyperscale data centers, advanced infrastructure, and…

2h ago Data

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.