caferemote
Cantina Labs

Machine Learning Engineer, Ops

Remote Europe, USA Full-time Posted 10 days ago
Apply now
Work from
Europe, USA
Contract
Full-time
Posted
10 November 2026

We are looking for an ML Engineer to own the production inference stack for our text-to-speech (TTS) and speech recognition (ASR) models, end to end. Our research team delivers trained model checkpoints; you will productionize them as low-latency, real-time streaming services that run cost-efficiently on GPUs. The role covers the inference engines, the Kubernetes infrastructure they run on, and the performance benchmarking and accuracy validation that let us ship changes safely.

About the role

You will bridge research and production, and own latency, throughput, cost and accuracy as we scale.

Responsibilities

  • Build and optimize streaming inference engines for TTS and ASR models, including multi-stage model pipelines.
  • Optimize latency (time to first chunk, p50/p99) and throughput using continuous batching, CUDA Graphs, torch.compile and mixed precision.
  • Maintain numerical parity with the reference implementation through automated accuracy regression tests, per stage and end to end.
  • Deploy and operate GPU inference services on Kubernetes: autoscaling, containerization and infrastructure as code.
  • Build CI/CD for model artifacts, with model versioning and reproducible releases.
  • Own observability and performance benchmarking: p50/p99 latency, real-time factor (RTF), GPU utilization and cost per request.
  • Partner with research to productionize new models.

Requirements

  • Hands-on experience deploying, scaling and optimizing ML models in production, beyond consuming model APIs.
  • Working knowledge of the full inference stack, from CUDA kernels to serving frameworks, with depth in some layers; expertise across all of them is not expected.
  • GPU performance optimization: profiling (Nsight Systems, PyTorch Profiler), memory bandwidth, CPU-GPU synchronization.
  • Solid understanding of model serving: continuous batching, KV cache management, request scheduling.
  • Production experience with Kubernetes, CI/CD and cloud infrastructure.
  • Strong Python and PyTorch, and a rigorous approach to performance benchmarking.
  • Experience with speech or audio models (TTS, ASR, voice conversion).
  • Experience with inference frameworks such as vLLM (vLLM-Omni), SGLang, TensorRT-LLM, TensorRT or Triton Inference Server.

Benefits

  • Competitive salary and generous company equity
  • Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina
  • 42 days of paid time off, including:
    • 15 PTO days
    • 10 sick days
    • 15 company holidays
    • 2 floating holidays
  • Generous parental leave & fertility support
  • 401(k) retirement savings plan
  • Lifestyle spending account – $500/month to use however you’d like
  • Complimentary lunch and snacks for in-office employees
  • One Medical membership, and more!

Salary

When determining compensation, a number of factors will be considered, including skills, experience, job scope, location, and competitive compensation market data.

About Cantina Labs

Cantina Labs is a social AI company, developing a suite of advanced real-time models that push the boundaries of expression, personality, and realism. We bring characters to life, transforming how people tell stories, connect, and create. We build and power ecosystems. Cantina, our flagship social AI platform, is just the beginning.

If you're excited about the potential AI has to shape human creativity and social interactions, join us in building the future!

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from Cantina Labs

View company →

Senior Staff Software Engineer, Search & Recommendation

Cantina Labs
Remote USA Full-time $250K – $320K / year

About Cantina: Cantina Labs is a social AI company, developing a suite of advanced real-time models that push the boundaries of expression, personality, and…

2 days ago Software Development

Research Scientist, Real-Time Video Generation

Cantina Labs
Remote Europe, USA Full-time

About Cantina Cantina Labs is a social AI company, developing a suite of advanced real-time models that push the boundaries of expression, personality, and…

10 days ago Data

Machine Learning Engineer, Voice Conversion

Cantina Labs
Remote Europe, USA Full-time

About Cantina: Cantina is a new social platform founded by Sean Parker with the most advanced AI character creator. Our bots are lifelike, social creatures…

10 days ago Data

Machine Learning Engineer, TTS

Cantina Labs
Remote Europe, USA Full-time

About Cantina Cantina is a new social platform founded by Sean Parker with the most advanced AI character creator. Our bots are lifelike, social creatures that…

10 days ago Data

Similar remote jobs

Browse all →

Cyber Security Engineer

The EDH Global
Remote United States Full-time

The Cyber Security Engineer is a key member of the Team, providing technical expertise and support on a wide range of cyber security projects and initiatives. The ideal candidate should…

just now Software Development

Senior Cyber Security Analyst

Boston Government Services
Remote United States Full-time

Boston Government Services , LLC. (BGS) is seeking a Senior Cyber Security Analyst to support our clients. BGS is an engineering, technology, and security firm helping to advance missions…

2h ago Software Development

ADC Expert - Preclinical R&D

mercor
Remote United Kingdom Contract $60 – $100 / hour

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter…

2h ago Software Development

Software Installer - Senior

Peraton
Remote United States Full-time $104K – $166K / year

Responsibilities Join Peraton in advancing the safety, efficiency, and modernization of the National Airspace System (NAS) through the FAA’s Brand New Air Traffic Control System (BNATCS)…

2h ago Software Development

Subject Matter Expert - Crash Course Algebra

Complexly
Remote United States Contract

Subject Matter Expert - Crash Course Algebra When it comes to math, the vast majority of U.S. high schoolers start in the same place: with algebra. It’s a subject that some find curiously…

2h ago Software Development

Senior Salesforce Software Developer

Tripoint Solutions, LLC
Remote United States Full-time $144K – $164K / year

Position Summary The Senior Software Developer is the lead Salesforce developer for a large enterprise Salesforce platform that is moving from Salesforce Education Data Architecture (EDA)…

2h ago Software Development

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.