caferemote
HighLevel

Software Development Engineer in Test III - AI

Remote India Full-time Posted 5h ago
Apply now
Work from
India
Contract
Full-time
Posted
18 November 2026
Apply by
17 January 2027

We are looking for a Senior Software Development Engineer in Test (SDET 3) with strong expertise in AI tools and testing AI-driven products. This role requires a hands-on individual who can design and execute test strategies for AI systems, automate intelligently, and mentor junior team members. You will work independently, drive tasks to closure, and play a key role in ensuring the quality of our AI initiatives.

About HighLevel:HighLevel is an AI-powered business operating system that gives agencies, entrepreneurs and SMBs the infrastructure to build, automate and scale. Today, HighLevel supports SMBs across 150+ countries, fueling community-driven growth rooted in real customer outcomes.
To date, businesses operating on HighLevel have generated over $7 billion in ecosystem value, demonstrating the impact of shared infrastructure at scale. By centralizing conversations, automation and intelligence into one system, we help businesses move faster, reduce complexity and execute efficiently.
Behind the platform, HighLevel powers more than 4 billion API hits and 2.5 billion message events daily. With 250 terabytes of distributed data, 250+ microservices and over 1 million domain names supported, our architecture is built for performance, resilience and long-term scalability.

Our People
With over 2,000 team members across 10+ countries, HighLevel operates as a global, remote-first organization built for speed and ownership. We value initiative, clarity and execution, creating space for ambitious people to build systems that support millions of businesses worldwide. Here, innovation thrives, ideas are celebrated and people come first, no matter where they call home.

Our Impact
Every month, HighLevel enables more than 1.5 billion messages, 200 million leads and 20 million conversations for the more than 1 million businesses we support. Behind those numbers are real people building independence, expanding opportunity and creating measurable impact. We’re proud to be a part of that.

Learn more about us on our YouTube Channel or Blog Posts

Responsibilities

  • Design, develop, and maintain automation frameworks and test strategies for AI products
  • Test and validate AI-powered features (including OpenAI, Claude, and other AI integrations)
  • Evaluate and improve RAG (Retrieval-Augmented Generation) flows, ensuring accuracy and performance
  • Leverage AI automation tools to optimize test coverage and efficiency
  • Collaborate closely with developers, product managers, and AI researchers to ensure high-quality releases
  • Own tasks end-to-end, working independently to deliver on commitments.
  • Mentor and guide junior SDETs, fostering a culture of quality and continuous learning

Requirements

  • 5+ years of overall experience in QA/SDET roles
  • Proven experience working with AI tools (e.g., OpenAI, Claude, or similar LLM platforms)
  • Strong understanding of testing AI/ML products and their unique challenges
  • Hands-on knowledge of RAG pipelines and their testing methodologies
  • Proficiency in automation frameworks (e.g., Playwright, Cypress, Selenium, or similar)
  • Experience with API testing (Postman, REST, GraphQL, gRPC)
  • Strong problem-solving skills with the ability to work independently
  • Mentorship and leadership skills in guiding peers or junior engineers

Nice to have

  • Experience with CI/CD pipelines and cloud platforms (AWS/GCP/Azure)
  • Familiarity with MLOps pipelines and monitoring AI systems
  • Exposure to performance and scalability testing of AI workloads

EEO Statement

The company is an Equal Opportunity Employer. As an employer subject to affirmative action regulations, we invite you to voluntarily provide the following demographic information. This information is used solely for compliance with government recordkeeping, reporting, and other legal requirements. Providing this information is voluntary and refusal to do so will not affect your application status. This data will be kept separate from your application and will not be used in the hiring decision.

We encourage you to review our Privacy Policy before submitting your application

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from HighLevel

View company →

Software Development Engineer III - Users

HighLevel
Remote India Full-time

About HighLevel : HighLevel is an AI-powered business operating system that gives agencies, entrepreneurs and SMBs the infrastructure to build, automate and…

3h ago Back-End Programming

Software Development Engineer II (Frontend) - Opportunities

HighLevel
Remote India Full-time

About HighLevel : HighLevel is an AI-powered business operating system that gives agencies, entrepreneurs and SMBs the infrastructure to build, automate and…

3h ago Front-End Programming

Software Development Engineer II (Frontend) - Tasks

HighLevel
Remote India Full-time

About HighLevel : HighLevel is an AI-powered business operating system that gives agencies, entrepreneurs and SMBs the infrastructure to build, automate and…

5h ago Front-End Programming

Talent Management Partner

HighLevel
Remote India Full-time

About us HighLevel is an AI-powered business operating system that gives agencies, entrepreneurs and SMBs the infrastructure to build, automate and scale.…

6h ago Data

Similar remote jobs

Browse all →

Senior Project Manager, QA/QC

Cash Construction Company Inc.
Remote United States Full-time $150K – $175K / year

Overview As one of the nation's leading electric transmission line construction companies, MasTec Power Delivery companies engineer and construct efficient and reliable electrical…

2h ago Quality Assurance

QA Automation Test Engineer

Aretum
Remote United States Full-time $80K – $120K / year

Public Trust Eligibility Required About Aretum Aretum is a mission-driven organization committed to delivering innovative, technology-enabled solutions to our customers across defense,…

3h ago Quality Assurance

AI Workflow Evaluator - Fully Remote | Upto $190/hr

mercor
Remote United States Contract $50 – $190 / hour

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter…

3h ago Quality Assurance

QA Manager, EPIC Loan Systems

Aquila Software Group
Remote Canada Full-time CAD 130K – CAD 150K / year

We are excited to speak to you about this opportunity. If you are interested in joining our growing team, please apply to this link directly. Who we are At Aquila, we invest in…

4h ago Quality Assurance

Andromeda Shimu Deep Research Reviewer (EN-US)

Welo Global
Remote United States Contract $28 / hour

About the Role We're looking for a QA Deep Research Reviewer to evaluate long-form, AI-generated research outputs against detailed rubrics and guidelines. You'll read documents that include…

5h ago Quality Assurance

Sr. QE Test Coordinator (ATL, LOU, or Remote)

Papa Johns
Remote United States Full-time

What’s Unique About You Is What Makes Us Better! Diversity is our strength and competitive advantage. Bring your flavor to the Papa John's team today! Job Summary The Senior Test…

5h ago Quality Assurance

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.