caferemote
Arize AI

Senior AI Product Engineer, Backend

Remote United States Full-time Senior $125K – $225K / year Posted 2 days ago
Apply now
Work from
United States
Contract
Full-time
Experience
Senior
Salary
$125K – $225K / year
Posted
18 November 2026
Apply by
17 January 2027

The expectation and scope of every individual on this team is high, whether it’s finding the most efficient way to compute model evaluation metrics across billions of data points, designing the next generation of our OLAP database architecture, or researching and implementing the latest dimensionality reduction techniques – you will never lack a technical challenge.

About the role

Our Backend Engineering team builds all of the highly scalable distributed services that power Arize’s ML observability platform. While Go is our primary language for these distributed systems, the team also maintains services and tools written in Python, Java, and TypeScript.

You will be a part of the core team that drives product innovation at Arize. You will be challenged with understanding how some of the most impactful engineering teams are developing AI and LLM-powered applications, and how to build the right tools to enable them to do their best work. Our product solutions range from clean APIs that magically instrument applications, interactive playgrounds for prompt engineering and agent development, or scaling up real-time evaluation infrastructure to handle millions of annotations per second.

Responsibilities

  • Write maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScript.
  • Build high-volume and highly available analytics systems.
  • Design and build APIs specific to our customers’ Machine Learning and LLM workflows.
  • Prototype, optimize, and maintain scalable backend services that power the Arize core platform.
  • Extend, and contribute back to, open source OLAP databases and distributed message queue frameworks.
  • Develop and integrate collection tools for robust monitoring of ML and LLM pipelines.
  • Research and implement cutting-edge visualization & dimensionality reduction algorithms in a distributed environment.
  • Collaborate with our product, design, and directly with customer engineering teams to enhance and expand our product offerings.
  • Contribute to the build our own in-house AI Agents

Requirements

  • 5+ years of experience working with high-performance backend systems.
  • Strong experience writing Go, Python, TypeScript/Node, Java, or similar server programming languages.
  • Enthusiasm and interest in the AI and LLM ecosystem, with a desire to learn and stay updated on emerging technologies.
  • Previous work building and operating highly complex SaaS platforms/systems.
  • Knowledge of working with public clouds & container orchestration - AWS, GCP, Azure, Kubernetes, etc.

Bonus Points, But Not Required

  • Experience with distributed stream processing - Kafka, Gazette, or similar.
  • Experience with OLAP systems.
  • Familiarity with system observability tooling like Prometheus.
  • Working knowledge of Machine Learning and/or Data Science.
  • First-hand experience working with large language models (LLMs) or developing AI products.
  • Actual compensation is determined based on a variety of job-related factors that may include transferable work experience, skill sets, and qualifications.
  • Total compensation also includes a comprehensive benefits package, including medical, dental, vision, a 401(k) plan, unlimited paid time off, a generous parental leave plan, and additional support for mental health and wellness.

While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.

Salary

The estimated annual salary for this role is between $125,000 - $225,000, plus a competitive equity package.

About Arize AI

AI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their AI systems. That’s where we come in. Arize AI is the leading AI & Agent Engineering observability and evaluation platform, empowering AI engineers to ship high-performing, reliable agents and applications. From first prototype to production scale, Arize AX unifies build, test, and run in a single workspace—so teams can ship faster with confidence.

We’re a Series C company backed by top-tier investors,with over $135M in funding and a rapidly growing customer base of 150+ leading enterprises and Fortune 500 companies. Customers like, Uber, Siemens, and PepsiCo leverage Arize to deliver AI that works.

More About Arize

Arize’s mission is to make the world’s AI work—and work for people.
Our founders came together through a shared frustration: while investments in AI are growing rapidly across every industry, organizations face a critical challenge—understanding whether AI is performing and how to improve it at scale.

Learn more about what we're doing here

Diversity & Inclusion @ Arize

Our company's mission is to make AI work and make AI work for the people, we hope to make an impact in bias industry-wide and that's a big motivator for people who work here. We actively hope that individuals contribute to a good culture

  • Regularly have chats with industry experts, researchers, and ethicists across the ecosystem to advance the use of responsible AI
  • Culturally conscious events such as LGBTQ trivia during pride month
  • We have an active Lady Arizers subgroup

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from Arize AI

View company →

Enterprise Account Executive (West)

Arize AI
Remote United States Full-time $250K – $300K / year

About Arize AI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their…

6 days ago Sales and Marketing

Technical Product Manager

Arize AI
Remote United States Full-time $200K – $250K / year

About Arize AI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their…

6 days ago DevOps and Sysadmin

Senior AI Product Manager, Evals & Annotations

Arize AI
Remote United States Full-time $200K – $250K / year

About Arize AI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their…

9 days ago Software Development

UX Designer

Arize AI
Remote United States Full-time $165K – $200K / year

About Arize AI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their…

11 days ago Software Development

Similar remote jobs

Browse all →

Senior AI Agent Engineer

Bonapolia
Remote Albania, Andorra, Armenia, Austria, Belarus, Belgium, Bosnia and Herzegovina, Bulgaria, Croatia, Cyprus, Czechia, Denmark, Estonia, Faroe Islands, Finland, France, Georgia, Germany, Gibraltar, Greece, Guernsey, Holy See (Vatican City State), Hungary, Contract

We are looking for a Senior AI Agent Engineer: 🗣 Language Proficiency: Upper-Intermediate 🧾 Employment type: Full time 🌍 Candidate Location: Poland, other EU countries, Kazakhstan,…

5h ago Back-End Programming

Staff Software Engineer - Golang

Rapid7
Remote United States Full-time $164K – $222K / year

Rapid7 is seeking a Staff Software Engineer, AI-SOC to own the control plane and API server that expose our autonomous investigation platform to more than 10,000 customers. This role is for…

6h ago Back-End Programming

Cloud & Backend Software Engineer

UIC Alaska
Remote United States Full-time $110K – $130K / year

Overview CLOUD & BACKEND SOFTWARE ENGINEER (ERDC AI-DRIVEN ENGINEERING QA/QC): Bowhead is seeking a Cloud & Backend Software Engineer to support the development of an AI-driven Engineering…

7h ago Back-End Programming

Software Engineer III

MCCi
Remote United States Full-time

About Us: MCCi is a premier provider of intelligent business process automation solutions and a trusted partner to over 2,000 organizations across state and local government, education, and…

10h ago Back-End Programming

Backend Engineer

Domaine
Remote Canada Full-time

Meet Domaine , a global digital commerce and transformation partner for ambitious and beloved brands. We are the world’s largest independent Shopify partner. We are also a growing team of…

11h ago Back-End Programming

Senior Software Reliability Engineer – Splunk Framework & Runtime Services

Cisco
Remote United States Full-time $139K – $203K / year

The application window is expected to close on: 11/27/2026 Note: This role is Remote in the US with a strong preference for locations except CA, WA, DC, MD, NJ, NY, CT, MA, VA, AK. Meet the…

11h ago Back-End Programming

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.