caferemote
Cantina Labs

Machine Learning Engineer, Core Evaluations

Remote Europe, USA Full-time Posted 10 days ago
Apply now
Work from
Europe, USA
Contract
Full-time
Posted
10 November 2026

We are seeking an experienced Machine Learning Engineer (MLE) to focus on audio model evaluation, specifically for speech generation and recognition models.

About the role

This role involves designing and developing comprehensive model evaluation pipelines for both development and production environments, as well as creating automated dashboards for reporting evaluation results.

As the founding member of our evaluation team, the ideal candidate is expected to leverage their experience to lead our evaluation efforts and play a key role in the future growth of the evaluation team.

Responsibilities

  • Designing model evaluation pipelines for models in development and production
  • Designing user studies for subjective model evaluations.
  • Converting requirements into measurable metrics.
  • Designing and developing automated evaluation dashboard to see model performances and compare results.
  • Training new models to capture new and different evaluation metrics.
  • Communicating with the model team to help design better models based on the evaluation results.
  • Communicating with the data team to help decide the type of data necessary to improve model performance.
  • Communication with the product-manager to make sure product requirements are correctly measured.
  • Help grow the evaluation team as the founding member.
  • Lead the evaluation team in the future.

Requirements

  • Strong experience and intuition for designing metrics that capture model performance.
  • Strong experience with designing user studies on Mechanical Turk or similar platforms..
  • Strong experience with model training and fine-tuning for model evaluation.
  • Strong statistical knowledge and experience to statistically compare evaluation results and take decisions.
  • Very strong engineering and programming skills.
  • Experience with training ASR, TTS models.
  • Experience at ML teams working on large-scale machine learning problems. (>3B models with >1m hours of data)

Benefits

  • Competitive salary and generous company equity
  • Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina
  • 42 days of paid time off, including:
    • 15 PTO days
    • 10 sick days
    • 15 company holidays
    • 2 floating holidays
  • Generous parental leave & fertility support
  • 401(k) retirement savings plan
  • Lifestyle spending account – $500/month to use however you’d like
  • Complimentary lunch and snacks for in-office employees
  • One Medical membership, and more!

Salary

When determining compensation, a number of factors will be considered, including skills, experience, job scope, location, and competitive compensation market data.

About Cantina Labs

Cantina Labs is a social AI company, developing a suite of advanced real-time models that push the boundaries of expression, personality, and realism. We bring characters to life, transforming how people tell stories, connect, and create. We build and power ecosystems. Cantina, our flagship social AI platform, is just the beginning.

If you're excited about the potential AI has to shape human creativity and social interactions, join us in building the future!

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from Cantina Labs

View company →

Senior Staff Software Engineer, Search & Recommendation

Cantina Labs
Remote USA Full-time $250K – $320K / year

About Cantina: Cantina Labs is a social AI company, developing a suite of advanced real-time models that push the boundaries of expression, personality, and…

2 days ago Software Development

Research Scientist, Real-Time Video Generation

Cantina Labs
Remote Europe, USA Full-time

About Cantina Cantina Labs is a social AI company, developing a suite of advanced real-time models that push the boundaries of expression, personality, and…

10 days ago Data

Machine Learning Engineer, Voice Conversion

Cantina Labs
Remote Europe, USA Full-time

About Cantina: Cantina is a new social platform founded by Sean Parker with the most advanced AI character creator. Our bots are lifelike, social creatures…

10 days ago Data

Machine Learning Engineer, Ops

Cantina Labs
Remote Europe, USA Full-time

About Cantina: Cantina Labs is a social AI company, developing a suite of advanced real-time models that push the boundaries of expression, personality, and…

10 days ago Software Development

Similar remote jobs

Browse all →

AI Safety Expert - Bilingual

mercor
Remote United States Contract $17 – $25 / hour

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter…

1h ago Data

Senior AI & Transformation Enablement Specialist

Datasite
Remote United States Full-time $83K – $141K / year

About us Datasite is the essential infrastructure for M&A. Also comprising Grata, Blueflame AI, and Sherpany, we help dealbreakers find opportunities, manage transactions, and make key…

2h ago Data

Business Analyst III Claims, DRG

Centene Corporation
Remote United States Full-time $70K – $126K / year

Position Purpose: Perform various analysis and interpretation to link business needs and objectives for assigned function. Key Details: Must be authorized to work in the U.S. without the…

2h ago Data

Functional Consultant – Epicor Kinetic (Operations & Supply Chain) – 100% Remote

TeccWeb
Remote United States Full-time

About Teccweb Teccweb is an Epicor Service Partner specializing in the implementation and optimization of Epicor Kinetic for mid-market manufacturers and distributors across North America.…

2h ago Data

Product Owner

Dev Partners
Remote Philippines Full-time

💻 We Are Hiring- Product Owner | 100% Remote We are seeking an experienced Product Owner to oversee and coordinate the ongoing maintenance, enhancement, and continuous improvement of an…

2h ago Data

Mechanical Engineer III

DLB Associates
Remote United States Full-time $105K – $135K / year

DLB Associates is a premier engineering and consulting firm specializing in innovative, mission-critical solutions across hyperscale data centers, advanced infrastructure, and…

3h ago Data

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.