caferemote
Syllo

Senior Data Scientist, AI Evaluation

Remote United States Full-time Senior $160K – $200K / year Posted 3 days ago
Apply now
Work from
United States
Contract
Full-time
Experience
Senior
Salary
$160K – $200K / year
Posted
17 November 2026
Apply by
16 January 2027

We’re seeking a Senior Data Scientist to help us evaluate and improve the quality and performance of our AI systems. You’ll develop rigorous approaches to measuring system behavior, run experiments, investigate issues, and turn complex data into actionable decisions.

About the role

This is a hands-on role at the intersection of data science, engineering, and applied AI. You’ll work directly with production data and systems and partner closely with Engineering, Product, and Analytics.

Requirements

  • Master's degree in computer science, data science, machine learning, or a related field with substantial hands-on experience; or 2–4 years of relevant professional experience.
  • Strong Python and SQL skills and experience working directly with production data.
  • Comfortable navigating production code and data systems you did not build.
  • Strong foundation in applied statistics, experimentation, and quantitative analysis.
  • Practical experience working with and evaluating modern AI/ML systems.
  • Experience diagnosing complex issues involving data, models, or production systems.
  • Ability to turn ambiguous questions into structured investigations and clearly communicate the results.

Nice to have

  • Experience building AI/ML evaluation frameworks, benchmarks, or monitoring systems.
  • Experience with information retrieval, search, or large-scale information systems.
  • Familiarity with modern cloud data platforms and production data infrastructure.
  • Experience building internal analytics or observability tooling.

United States - Remote Pay Range

$160,000—$200,000 USD

Salary

Salary Range ($160K- $200K) plus health insurance and equity.

About Syllo

Syllo is on a mission to transform litigation. Our product is a unified litigation platform that enables lawyers and paralegals to safely harness the power of language models and agentic AI throughout the litigation life cycle. Since going to market, we have gained a diverse group of enterprise customers, including some of the biggest law firms and corporations in the country, and we are quickly expanding. By reducing the expense of litigation industry-wide, we aim to improve access to high-quality representation and promote the alignment of legal outcomes with merit.

Responsibilites

  • AI Evaluation: Develop quantitative methods and tooling to evaluate AI system quality and performance.
  • Experimentation: Design and run experiments to compare approaches, understand tradeoffs, and measure the impact of changes.
  • Quality Monitoring: Build repeatable processes to identify regressions, anomalies, and changes in system performance.
  • Data Analysis: Extract, transform, and analyze production data to support technical and product investigations.
  • Technical Investigation: Diagnose complex issues involving data, models, and production systems, identifying root causes and potential solutions.
  • Measurement & Instrumentation: Partner with Engineering to improve how system quality, reliability, and performance are measured.
  • Internal Tooling: Build tools and dashboards that make system performance easier to understand and monitor.
  • Communication: Clearly communicate findings, tradeoffs, and recommendations to technical and non-technical stakeholders.

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from Syllo

View company →

Director of Client Services

Syllo
Remote United States Full-time $150K – $180K / year

About Syllo Syllo is leading the Litigation AI category. In 2019, a team of litigators and engineers founded Syllo to redefine how complex litigation works.…

yesterday Customer Support

Data Specialist (Thurs-Mon, 9am-6pm PT)

Syllo
Remote United States Full-time $120K – $140K / year

Data Specialist Location: Remote, USA Time Zone: Must be in Pacific time zone and willing to work 9AM - 6 PM PT , Thursday-Monday About Syllo Syllo is defining…

yesterday Data

Change Management and Enablement Strategist

Syllo
Remote United States Full-time $120K – $160K / year

About Syllo Syllo is leading the Litigation AI category. In 2019, a team of litigators and engineers founded Syllo to redefine how complex litigation works.…

2 days ago Management and Finance

Platform Software Engineer

Syllo
Remote United States Full-time $170K – $190K / year

About Syllo Syllo is leading the Litigation AI category. In 2019, a team of litigators and engineers founded Syllo to redefine how complex litigation works.…

5 days ago DevOps and Sysadmin

Similar remote jobs

Browse all →

AI Safety Expert - Bilingual

mercor
Remote United States Contract $17 – $25 / hour

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter…

2h ago Data

Senior AI & Transformation Enablement Specialist

Datasite
Remote United States Full-time $83K – $141K / year

About us Datasite is the essential infrastructure for M&A. Also comprising Grata, Blueflame AI, and Sherpany, we help dealbreakers find opportunities, manage transactions, and make key…

2h ago Data

Business Analyst III Claims, DRG

Centene Corporation
Remote United States Full-time $70K – $126K / year

Position Purpose: Perform various analysis and interpretation to link business needs and objectives for assigned function. Key Details: Must be authorized to work in the U.S. without the…

2h ago Data

Functional Consultant – Epicor Kinetic (Operations & Supply Chain) – 100% Remote

TeccWeb
Remote United States Full-time

About Teccweb Teccweb is an Epicor Service Partner specializing in the implementation and optimization of Epicor Kinetic for mid-market manufacturers and distributors across North America.…

3h ago Data

Product Owner

Dev Partners
Remote Philippines Full-time

💻 We Are Hiring- Product Owner | 100% Remote We are seeking an experienced Product Owner to oversee and coordinate the ongoing maintenance, enhancement, and continuous improvement of an…

3h ago Data

Mechanical Engineer III

DLB Associates
Remote United States Full-time $105K – $135K / year

DLB Associates is a premier engineering and consulting firm specializing in innovative, mission-critical solutions across hyperscale data centers, advanced infrastructure, and…

3h ago Data

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.