caferemote
Harris

Staff AI Engineer - QA

Remote Canada, United States Full-time Lead $120K – $160K / year Posted yesterday
Apply now
Work from
Canada, United States
Contract
Full-time
Experience
Lead
Salary
$120K – $160K / year
Posted
20 November 2026
Apply by
19 January 2027

Harris Computer is hiring a Staff AI Engineer (QA) to join their, expanding team! We’re seeking a seasoned expert to pioneer the quality and reliability of our cutting-edge AI and machine learning solutions for healthcare. As a Staff AI Engineer focused on Quality Assurance, you will be the technical authority responsible for ensuring our AI systems are robust, fair, accurate, and safe.

This is a unique opportunity to define the future of AI quality in a domain where it matters most, mentoring a talented team and establishing the gold standard for testing intelligent systems that impact patient care.

What your impact will be

  • Build the core AI system end-to-end, from the service layer and data pipelines to the evaluation infrastructure, and own its architecture.
  • Design and build the evaluation infrastructure, including dataset management, automated test harnesses, and replay of AI systems against historical workflows.
  • Build and maintain evaluation datasets with clinician-reviewed correct answers, ensuring they evolve as our systems change.
  • Create error metrics weighted by severity, so mistakes with clinical or financial impact are prioritized accordingly.
  • Build production monitoring for accuracy, overrides, and safety issues, with actionable alerts for the engineering team.
  • Write adversarial tests for AI systems, including hidden or malicious instructions in documents and invented content.
  • Work with product and clinical leads to define accuracy thresholds and the criteria for expanding or pulling back an AI capability.
  • The candidate must possess a curiosity and willingness to actively adopt and leverage emerging AI tools to improve workflows, solve problems, and drive efficiency along with being comfortable using a range of AI-enabled tools (such as copilots, chat-based AI, and automation solutions) as part of everyday work.

Requirements

  • 7 or more years in software or machine learning engineering, with at least 3 years focused on evaluation, testing, or quality for AI systems.
  • A track record of designing and building complete systems from scratch, taking them from prototype to production.
  • A track record of building and running evaluation systems that teams use in production, not just for one-off analyses.
  • At least 2 years of experience evaluating large language model (LLM) systems in a production environment.
  • Strong statistical skills for measuring accuracy, including sampling, confidence intervals, and error analysis.
  • 1 year + of experience designing evaluation sets for document extraction, classification, or structured output.
  • Deep knowledge of explainable AI (XAI) techniques and AI-powered tools (e.g., SHAP, LIME, Claude).
  • Clear written communication, including design documents, and the ability to explain complex trade-offs to clinicians, engineers, and executives.

Nice to have

  • Experience working within the healthcare or another highly regulated industry.
  • Familiarity with AI-specific testing techniques like metamorphic testing, adversarial testing, or data validation with tools like Great Expectations.
  • A history of mentoring engineers and influencing technical direction across multiple teams.

Eligibility

  • This is a full-time, remote position open to candidates in the U.S. or Canada.

Benefits

  • Plenty of opportunities to grow your career
  • Comprehensive medical, dental, and vision benefits
  • 3 weeks of vacation plus 5 personal days to recharge
  • Employee stock ownership, RRSP program, 401k matching
  • A chance to give back through community involvement
  • Flexible work arrangements to suit your lifestyle

Salary

$120,000-160,000 USD depending on experience and qualifications.

About Harris

Harris provides mission critical software solutions for the Public Sector, Healthcare, Utilities and Private Sector verticals throughout North America, Europe, Asia and Australia.

Working for Harris is the perfect opportunity to fulfill your professional goals as well as achieve your personal dreams!

Our employees enjoy a casual work environment that offers comfort while providing superior service to our customers. We offer a comprehensive benefit package as well as other additional “Perks”!

  • We empower our employees to make a difference
  • We have an award-winning culture
  • We offer opportunity to learn
  • We are financially strong and we are owned by the largest software company in Canada (CSI)
  • We have fun!

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from Harris

View company →

Senior Manager, U.S. Tax

Harris
Remote Canada Full-time $130K – $170K / year

Harris is seeking an experienced Senior Manager, U.S. Tax to play a critical role within our Global Tax team. Reporting directly to the Director, U.S. Tax,…

12h ago Management and Finance

Senior Software Architect

Harris
Remote Canada, United States Full-time $150K – $200K / year

Harris Computer is looking for a Senior Software Architect to join our innovative Team! We’re looking for a passionate and experienced engineer to lead the…

20h ago Software Development

Staff AI Engineer - DevOps

Harris
Remote Canada, United States Full-time $120K – $160K / year

Harris Computer is looking for a Staff AI Engineer - DevOps to join our innovative Team! We are seeking a visionary engineer to build and lead the operational…

yesterday DevOps and Sysadmin

Conseiller(ère) juridique commercial(e)

Harris
Remote Canada Full-time

Le groupe juridique de Harris est à la recherche d’un(e) avocat(e) motivé(e), débrouillard(e), ayant un excellent sens des affaires, pour se joindre à…

yesterday Management and Finance

Similar remote jobs

Browse all →

Audio Engineer - Fully Remote | Upto $14/hr

mercor
Remote India Contract $14 / hour

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter…

5h ago Quality Assurance

Lead Auditor Quality Compliance

Integra LifeSciences
Remote France, Germany, Ireland, Switzerland, United Kingdom Full-time

Changing lives. Building Careers. Joining us is a chance for you to do important work that creates change and shapes the future of healthcare. Thinking differently is what we do best. To…

5h ago Quality Assurance

CHAPS & International Payments Test Lead – Banking

May Business Consulting
Remote Spain, United Kingdom Full-time

Hello! At MBC by Izertis , we are continuing to grow, and we are now looking for a CHAPS & International Payments Test Lead with strong experience in test management and leadership within…

6h ago Quality Assurance

Salesforce QA Tester DHS Public Trust- Remote

ICF
Remote United States Full-time $67K – $114K / year

Job Description * We are open to supporting 100% remote work anywhere within the continental US * The Salesforce Quality Assurance Tester (QA Tester) is responsible for crafting thorough…

9h ago Quality Assurance

Senior QA Engineer

Premier Inc.
Remote United States Full-time $90K – $150K / year

Senior QA Engineer What you will be doing: The Senior QA Engineer verifies that software products and systems function as described in the associated business requirements and design…

9h ago Quality Assurance

Audio Engineer - Fully Remote | Upto $42/hr

mercor
Remote United States Full-time $14 – $42 / hour

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter…

10h ago Quality Assurance

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.