caferemote
Clera

Senior Software Engineer, Model Evaluation

Remote United States Full-time Senior $180K – $250K / year Posted 6h ago
Apply now
Work from
United States
Contract
Full-time
Experience
Senior
Salary
$180K – $250K / year
Posted
22 November 2026
Apply by
21 January 2027

In this research-focused engineering role, you will work with procurement and manufacturing experts to create benchmarks, train models, and improve agents used in real operational workflows.

About the role

Join an early-stage AI company building agents for manufacturing and supply chain operations.

Responsibilities

  • Design benchmarks and evaluation suites for supplier sourcing, qualification, compliance documents, purchase orders, freight, and order tracking.
  • Work with domain experts to scope tasks, write reference answers and rubrics, and build graders.
  • Train and fine-tune models hands-on, using evaluation results to guide experiments.
  • Identify agent failures, develop improvements, and validate those improvements with measured results.
  • Help establish research and evaluation practices as an early member of the team.

Requirements

  • At least 3 years of experience, with senior- or staff-level capability.
  • Experience designing and writing benchmarks or evaluations.
  • Experience authoring tasks, including defining scope, creating reference solutions or rubrics, and checking task quality.
  • Hands-on experience training and fine-tuning models, beyond using models through APIs.
  • Ability to work closely with non-ML domain experts and translate their knowledge into measurable tasks.
  • Supply chain, procurement, manufacturing, or early-stage startup experience is a plus.

Eligibility

  • Visa sponsorship policy was not provided.

Salary

Base salary is $180,000 to $250,000 annually, plus equity. Compensation Range: $180K - $250K

Compensation & Benefits

Location

Fully remote in the United States.

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from Clera

View company →

Executive Assistant, Founder's Office

Clera
Remote United States Full-time $120K – $160K / year

About the Role A Series A/B aerospace company is seeking an Executive Assistant to support the CEO and Founder through a period of growth. You will be a…

4h ago Management and Finance

Business Development Representative

Clera
Remote United States Full-time $70K / year

About the Role Join a growing sales team as a Business Development Representative, opening conversations with operators at multi-location restaurant,…

4h ago Sales and Marketing

Product Manager

Clera
Remote United States Full-time $130K / year

About the Role Own the product roadmap for an AI-powered operations platform serving restaurants, convenience stores, and specialty retail. You will work…

6h ago Software Development

Head of Marketing

Clera
Remote United States Full-time $200K – $275K / year

About the Role As the first marketing hire at an early-stage aerospace company, you will build the marketing function from the ground up. You will shape how…

6h ago Sales and Marketing

Similar remote jobs

Browse all →

Professional Services Technical Architect - West

GitLab
Remote Canada Full-time

GitLab is the intelligent orchestration platform for DevSecOps. GitLab enables organizations to increase developer productivity, improve operational efficiency, reduce security and…

2h ago DevOps and Sysadmin

Azure Cloud Engineer

T-Rex Solutions, LLC
Remote United States Full-time $115K – $145K / year

Since 2016, T-Rex Solutions (T-Rex) has been supporting large scale hybrid-cloud migrations and systems modernization, to include the successful deployment of the first-ever online U.S.…

2h ago DevOps and Sysadmin

DevOps Engineer

Oddball
Remote United States Full-time $110K – $145K / year

Oddball believes that we can bring change and improve the daily lives of millions by bringing quality software to the federal space. Our team is full of experienced engineering, product,…

3h ago DevOps and Sysadmin

Engineering Manager - Grafana Infrastructure (Remote, Canada)

Grafana Labs
Remote Canada, United States Full-time CAD 192K – CAD 231K / year

Grafana Labs is the company behind Grafana Cloud, the fully managed observability platform trusted by more than 10,000 organizations to ensure reliability, resolve incidents faster, and…

3h ago DevOps and Sysadmin

Site Reliability Engineer

AbbVie
Remote United States Full-time $96K – $183K / year

AbbVie Information Security is looking for a highly motivated, diligent, and skillful Site Reliability Engineer to join the Cyber Security Engineering (CSE) Team. The CSE Team, working…

3h ago DevOps and Sysadmin

Cloud Engineer

Lone Wolf Technologies
Remote Canada Full-time CAD 120K – CAD 140K / year

Be part of a fast moving, lean product development Organization, supporting the Lone Wolf family of Applications. Serve as a senior, hands-on engineer on the Cloud Operations team…

3h ago DevOps and Sysadmin

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.