caferemote
Salvo Software

Senior MLOps Engineer

Remote United States Full-time Senior Posted 5 days ago
Apply now
Work from
United States
Contract
Full-time
Experience
Senior
Posted
15 November 2026
Apply by
14 January 2027

We’re growing our AI department and are looking for a Senior MLOps Engineer to build the platform that takes our models and LLM systems reliably into production.

Role OverviewWe are looking for a Senior MLOps Engineer to design, build, and own the infrastructure and workflows behind our machine learning and LLM-powered systems. Your core work will be creating a reliable path from experimentation to production: training and fine-tuning pipelines, model registries, automated deployment, scalable inference, and monitoring for models running in cloud, on-prem, and air-gapped environments.

This is a senior, hands-on role. You’ll define MLOps standards and platform architecture, make key decisions on reliability, scalability, and cost, and provide technical guidance to AI Developers and RAG Engineers on the team. You’ll work closely with engineering, product, and client stakeholders to make sure AI features are reproducible, observable, secure, and ready to scale.

Responsibilities

MLOps Platform & Engineering (core focus)

  • Design, deploy, and operate MLOps platform infrastructure, cloud services (AWS, Azure, GCP), and LLM inference pipelines (Ollama, vLLM).
  • Build automated CI/CD pipelines, IaC, and monitoring/alerting systems to support RAG applications, AI agents, and production deployments.
  • Manage Linux servers, networking, security endpoints, and troubleshoot production issues alongside AI engineering teams.

Technical Leadership

  • Establish department-wide MLOps/DevOps standards, best practices, and reusable infrastructure templates.
  • Partner with AI Developers and RAG Engineers to guide architecture, deployment strategies, tool selection, and production readiness.
  • Translate feature requirements into reliable, secure, cost-effective infrastructure and maintain comprehensive system documentation.

Infrastructure & Operations

  • Provision containerized workloads, Linux servers, and infrastructure using IaC (Terraform, Ansible) across cloud and on-prem environments.
  • Manage CI/CD (GitHub Actions, Azure DevOps), observability tools (Prometheus, Grafana), secure networking, and GPU-enabled hardware.
  • Troubleshoot platform incidents, perform root cause analysis, and maintain operational resilience.

Requirements

  • 5+ years of senior-level experience in DevOps/SRE/platform engineering with at least 1 year deploying ML models and LLM inference engines (Ollama, vLLM) in production.
  • Proficiency with Linux, Docker, Kubernetes, virtualization (Proxmox, VMware), GPU infrastructure (CUDA/NVIDIA), and major cloud platforms (AWS, Azure, GCP).
  • Hands-on expertise with Infrastructure as Code (Terraform, Ansible), CI/CD platforms (GitHub Actions, Azure DevOps), Bash, and Python scripting.
  • Solid background in core networking (DNS, TLS, firewalls, VPNs), monitoring/logging, and security/authentication (OAuth2/OIDC, API gateways, Zero Trust/SOC 2).
  • Familiarity with ML tooling (MLflow, Kubeflow), vector DBs, RAG/agent frameworks (MCP), workflow orchestration (Airflow/Kafka), and model optimization/quantization.

About Salvo Software

Salvo Software is a global technology company specializing in custom software development and advanced engineering solutions. With distributed teams across the US, LATAM, and India, we partner with clients to build high-performance, scalable systems that solve complex technical challenges. Our culture values innovation, ownership, and engineering excellence.

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

Similar remote jobs

Browse all →

Sr. Database Developer

Concept Plus
Remote United States Full-time

About Concept Plus Concept Plus is a mission-focused technology solutions provider that transforms IT concepts into impactful solutions for federal agencies. Headquartered in Fairfax, VA,…

2h ago DevOps and Sysadmin

Database Developer

Concept Plus
Remote United States Full-time

About Concept Plus Concept Plus is a mission-focused technology solutions provider that transforms IT concepts into impactful solutions for federal agencies. Headquartered in Fairfax, VA,…

3h ago DevOps and Sysadmin

Product Manager AI Cluster Orchestrator

DriveNets
Remote United States Full-time

Description Remote US - (frequent customer travel and regular communication time with R&D in Israel) About DriveNets DriveNets is a leader in large-scale networking solutions for AI…

3h ago DevOps and Sysadmin

Senior Cloud Operations Manager

PTC
Remote United States Full-time $175K – $250K / year

Our world is transforming, and PTC is leading the way. Our software brings the physical and digital worlds together, enabling companies to improve operations, create better products, and…

3h ago DevOps and Sysadmin

Principal Software Engineer, AI & Agentic Systems

Urrly
Remote United States Full-time $220K / year

Principal Software Engineer, AI & Agentic Systems Build production AI that helps health plans turn fragmented member journeys into more connected experiences. This is a hands-on principal…

5h ago DevOps and Sysadmin

Super Software Engineer - AI Factory – _ San Francisco Bay Area

SIVAD Consulting
Remote United States Full-time $200K – $275K / year

Super Software Engineer - AI Factory – (Remote) $200k to $275K Develop the infrastructure, tooling, and workflows to orchestrate AI agents, automate engineering tasks, and continuously…

6h ago DevOps and Sysadmin

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.