caferemote
Vectara

Platform Engineer

Remote United States Full-time Posted 3 days ago
Apply now
Work from
United States
Contract
Full-time
Posted
17 November 2026
Apply by
16 January 2027

You'll own the infrastructure that runs our deploy anywhere platform — from Kubernetes clusters serving ML inference at scale to the CI/CD pipelines, IaC, and observability stack that keep it all reliable. This is a hands-on role: you'll write Helm charts and Terraform one day, debug a Kafka consumer lag issue the next, and ship a backend service feature the day after.

Our founding members include industry veterans and experts in neural information retrieval and distributed systems from Google. We’re a passionate team that’s hyper-focused on solving enterprise-level technology and business problems with AI. Join us!

About the role

You'll deploy across AWS, GCP, and on-premises (including air-gapped environments), and you'll participate in an on-call rotation supporting enterprise customers.

Responsibilities

  • Build and maintain infrastructure-as-code (Terraform, Helm) for our AWS EKS and GCP GKE clusters, plus on-premises deployments (including Tanzu and air-gapped environments).
  • Own CI/CD pipelines (GitHub Actions, Bazel, ArgoCD) and drive GitOps adoption.
  • Deploy, scale, and optimize ML/NLP inference workloads (vLLM, PyTorch, GPU scheduling with various Kubernetes scalers).
  • Build and improve observability: Prometheus, Grafana, Datadog,, and OpenTelemetry.
  • Collaborate with Field Engineering to support PoCs and platform deployments in customer cloud VPCs and on-prem environments.
  • Contribute to backend services (Java 21, Python, gRPC) and platform features.
  • Improve system reliability, scalability, and developer experience across the engineering org.

Requirements

  • 5+ years in platform engineering, DevOps, SRE, or backend infrastructure roles.
  • Strong Kubernetes experience (deployment, debugging, scaling — not just `kubectl apply`).
  • Hands-on with infrastructure-as-code: Terraform, Helm, or Pulumi.
  • Experience with at least one major cloud provider (AWS preferred; GCP or Azure also valued).
  • Proficiency in one or more of: Go, Python, Java. Comfortable reading and contributing to backend codebases.
  • Working knowledge of CI/CD systems (GitHub Actions, Bazel, ArgoCD, or similar).
  • Solid fundamentals in Linux, networking, and distributed systems.

What Sets You Apart (Preferred)

  • Experience deploying or operating ML inference workloads (model serving, GPU scheduling, vLLM, TensorFlow Serving, or similar).
  • Familiarity with streaming/messaging systems (Kafka, Pulsar) and data stores (MariaDB/PostgreSQL, Aerospike, ClickHouse, OpenSearch).
  • Experience with GitOps workflows (ArgoCD, Flux).
  • Exposure to air-gapped or on-premises Kubernetes deployments.
  • Background in observability tooling (Prometheus, Grafana, OpenTelemetry, Datadog).
  • Experience providing technical support or working directly with enterprise customers on infrastructure issues.
  • Comfort with AI-assisted development workflows and managing AI coding agents.

Eligibility

We support remote applicants from all over the US but candidates who can come to the office 2-3 days a week in our Palo Alto office are preferred.

Benefits

  • 100% paid Medical, Dental, Vision for employees.
  • Option of Health Savings Account (HSA) or Flexible Savings Account (FSA).
  • Generous paid time off (PTO) plus paid sick time and holidays.
  • Professional development and training opportunities.
  • Company virtual happy hours and fun team building activities and more.
  • Salary is just one component of Vectara’s employee compensation.
  • Our full-time employees are also equity owners in the company, which although not an immediate cash component, can have positive impacts on long-term total compensation for each participating employee.
  • We would be remiss if we didn’t highlight and celebrate our focus on engaging many of our employees in being economic co-owners of the business.
  • Vectara welcomes all.
  • We value the collective wisdom of people from different backgrounds, experiences, abilities and perspectives.
  • We never discriminate on the basis of race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status.
  • Vectara has a positive and supportive culture—we look for people who are inventive and work to be a little better every single day.
  • We seek to be smart, humble, hardworking and, above all, curious.
  • After all, we are on a mission to find meaning.

About Vectara

Vectara is the Enterprise Agent Platform that enables businesses to build and deploy governed, grounded, auditable AI agents across SaaS, VPC, and on-prem. We have developed our own models, observability and orchestration layers, guardrails, and context management systems in order to provide our customers with the greatest levels of AI agent accuracy, security, and explainability.

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

Similar remote jobs

Browse all →

NEN SMIT Senior Solution Architect

Leidos
Remote United States Full-time $107K – $195K / year

Leidos is currently seeking a Senior Solution Architect to join our SMIT Growth Team. The Senior Solution Architect will be responsible for providing technical leadership and delivering…

1h ago DevOps and Sysadmin

Cloud Architecture Manager

Smart Tech Contracting
Remote United States Full-time $140K – $170K / year

Smart Tech Contracting delivers turnkey BAS & EPMS solutions for mission-critical colocation and hyperscale data centers operating at national program scale. As a Master Systems Integrator…

1h ago DevOps and Sysadmin

Cloud System Administrator (Shift B - Day)

NexusTek
Remote United States Full-time $28 – $31 / hour

Shift Schedule: This is a 12-hour day shift (5:45 AM to 6:15 PM Mountain Time), operating on a 12/7 rotational schedule . The rotation is as follows: Week 1: Work Thursday through Saturday…

2h ago DevOps and Sysadmin

Principal, Software Development

Common Securitization Solutions
Remote United States Full-time $181K – $208K / year

OVERVIEW The Company U.S. Financial Technology (U.S. FinTech) is seeking an experienced Principal, Software Development to join our team of talented professionals. This is a full-time…

4h ago DevOps and Sysadmin

Lead Devops Engineer

Way2B1
Remote United States Full-time

Our Company and the Role This is a hands-on Lead DevOps Engineer role responsible for designing, operating, and evolving a highly available, multi-tenant platform on AWS. You will work…

4h ago DevOps and Sysadmin

Senior Platform Engineer — Kubernetes, DevOps, & Cloud Infra (US)

Genios AI
Remote United States Full-time

We are on a mission to build the AI-native platform for finance —a multi-agent system that reimagines how investment teams make decisions and empowers them to move faster, think deeper,…

4h ago DevOps and Sysadmin

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.