caferemote
Hello Heart

Clinical AI Quality Specialist

Remote United States Full-time $130K – $143K / year Posted 17h ago
Apply now
Work from
United States
Contract
Full-time
Salary
$130K – $143K / year
Posted
21 November 2026
Apply by
20 January 2027

As a Clinical AI Quality Specialist, you will evaluate and monitor Nia’s clinical behavior before and after release, working alongside the Clinical AI Quality & Governance Team Lead. You will run evaluations, review production conversations, and turn findings into documented decisions with product and engineering.

About the role

Hello Heart’s AI team builds Nia, an AI health assistant for people managing their cardiovascular health. This is a hands-on role for a clinician who is comfortable working with AI tools.

Responsibilities

  • Run Nia’s offline evaluations for clinically relevant changes. Write test cases, including tricky and ambiguous ones, and score outputs against the expected clinical behavior. Build and maintain evaluation datasets and contribute to scoring methods
  • Review production conversations using defined sampling methods. Take part in the weekly review and help prepare monthly results that state what was and wasn’t covered.
  • Test whether Nia detects and correctly handles high-risk situations, including medical emergencies, self-harm, and medication safety. Measure how often it escalates too much or too little.
  • Describe each failure clearly enough for engineering to act on, and flag your best read of the cause (for example, a wrong answer, missing patient context, or an escalation that fired too late). Make sure each unsafe or incorrect finding has an owner, a ticket, and a decision.
  • Keep clinical specifications, review records, and evidence current and auditable. Write clear, precise clinical assessments that engineering and product can act on.

Requirements

  • PharmD (or equivalent clinical doctorate) with an active US license. 3+ years of combined clinical practice and clinical AI evaluation.
  • Questions assumptions and investigates before drawing conclusions. Reads current guidelines, drug labels, and primary sources, and cites them in written assessments. Uses AI tools to work faster, and verifies AI output against sources before relying on it.
  • Experience designing or running evaluations for LLM-based systems, reviewing production conversations, and using monitoring tools (e.g., Langfuse).
  • Command of triage and escalation, crisis and self-harm handling, and medication safety, grounded in current guidelines.
  • Comfortable working with AI tools and evaluation workflows.
  • Excellent written and verbal communication. Explains clinical risk clearly to engineering and product audiences, writes precise clinical assessments and documentation, and accepts feedback without defensiveness.
  • Genuine passion for how AI can improve preventive care and chronic disease management. Curious, open to learning, and comfortable with ambiguity and a fast-moving field.

Nice to have

  • Clinical experience in cardiovascular care or hypertension management.
  • Experience with structured rating of clinical transcripts, including agreement between raters.
  • Experience reviewing crisis and self-harm behavior.
  • Experience designing or running evaluations for LLM-based systems, or using monitoring tools such as Langfuse.
  • Salary ranges are determined by role and level.
  • Individual compensation is based on job-related skills, experience, and relevant education or training.
  • Compensation details listed in United States job postings reflect annual salary and bonus only and do not include equity or benefits.

Hello Heart has a positive, diverse, and supportive culture - we look for people who are collaborative, creative, and courageous. Oh, and if you want to see some recent evidence of the fun things we do at Hello Heart, check out our Instagram page.

Salary

The United States base salary range for this full-time position is $130,000 to $143,000.

About Hello Heart

Hello Heart is on a mission to make heart attacks a thing of the past.

We’re an AI company focused exclusively on heart health, building a platform that predicts and prevents cardiac events before they happen—identifying risk up to 10 days in advance versus 10 years in traditional clinical models.

This is already working at scale. Hello Heart has been shown to reduce inpatient hospital days by 47% and deliver ~$1,800 in annual savings per member. Hello Heart is the cardiac prevention partner to over 80% of large U.S. health plans and serves hundreds of public and private employers.

We’re defining how the #1 cause of death—heart disease—is managed in the AI era. Join us.

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from Hello Heart

View company →

User Support Specialist

Hello Heart
Remote United States Full-time $60K – $72K / year

About Hello Heart : Hello Heart is on a mission to make heart attacks a thing of the past. We’re an AI company focused exclusively on heart health, building…

2 days ago Software Development

Director, Global Supply Chain

Hello Heart
Remote United States Full-time $155K – $170K / year

About Hello Heart : Hello Heart is on a mission to make heart attacks a thing of the past. We’re an AI company focused exclusively on heart health, building…

3 days ago Management and Finance

Senior Talent Aquisition Partner

Hello Heart
Remote United States Contract $110K – $160K / year

About Hello Heart : Hello Heart is on a mission to make heart attacks a thing of the past. We’re an AI company focused exclusively on heart health, building…

7 days ago Human Resource Management

Senior Vice President, Client Growth

Hello Heart
Remote United States Full-time $220K – $245K / year

About Hello Heart : Hello Heart is on a mission to make heart attacks a thing of the past. We’re an AI company focused exclusively on heart health, building…

8 days ago Sales and Marketing

Similar remote jobs

Browse all →

Staff Analytics Engineer

Modern Health
Remote United States Full-time $136K – $189K / year

Modern Health Modern Health is a mental health benefits platform for employers. We are the first global mental health solution to offer employees access to one-on-one, group, and self-serve…

4h ago Data

Cocoa Sustainability Data & Reporting (London, All locations, GB)

The Hershey Company
Remote United Kingdom Full-time

About The Hershey Company The Hershey Company (NYSE: HSY) is an industry-leading snacks company known for making more moments of goodness through its iconic brands. With a strong portfolio…

4h ago Data

Consultant, Stars Consulting Center of Excellence

Qualtrics
Remote United States Full-time $108K – $132K / year

At Qualtrics , we create software the world’s best brands use to deliver exceptional frontline experiences, build high-performing teams, and design products people love. But we are more…

4h ago Data

Senior Data Scientist

Walmart - Internal
Remote United States Full-time $172K – $234K / year

What you'll do... Position: Senior Data Scientist Job Location: 1375 Crossman Avenue, Sunnyvale, CA 94089 Duties: Build advanced feature extraction algorithms that feed into various…

4h ago Data

Legal Expert (Copyright Law) | Remote - Contract

Xperteez Technology
Remote United States Contract

Job Description Role Title: Legal Expert (Copyright Law) Role Type: Contractor Location: Remote We are engaging Legal Experts specializing in Copyright Law to participate in a customer’s…

4h ago Data

Kyriba Implementation Senior Analyst

Clearsulting
Remote India Full-time $2800K – $3900K / year

Who We Are: Clearsulting is a global consulting company with the motivation to deliver positive change through digital finance. Our team consists of finance specialists that bring…

4h ago Data

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.