caferemote
OneForma

Research Scientist, LLM Evaluation & Post-Training

Remote United States Full-time $150K – $300K / year Posted 2 days ago
Apply now
Work from
United States
Contract
Full-time
Salary
$150K – $300K / year
Posted
18 November 2026
Apply by
17 January 2027

As an Applied RL Engineer, you will design and build RL environments that simulate complex enterprise workflows and train intelligent agents within them. You'll work at the intersection of RL research and production systems, translating customer requirements into bespoke simulation environments and post-training pipelines that deliver measurable improvements to AI agent performance.

About the role

This role requires deep expertise in both classical RL methodologies and modern LLM-based agent architectures. You'll shape our product direction and help make RL accessible to enterprise customers who need safe, compliant ways to improve their AI systems.

Responsibilities

  • Design and build custom RL environments (digital twins) simulating enterprise workflows: document processing, compliance, onboarding, support automation

Post-train LLM-based agents on domain-specific tasks using PPO, GRPO, DPO, and RLHF

Build end-to-end pipelines converting human-labeled traces into RL training data

Architect multi-step reasoning agents with tool-calling and closed learning loops

Design reward functions, verifiers, and validation frameworks for pre-deployment testing

Translate cutting-edge RL research into production systems; contribute to publications

Requirements

Required Qualifications

  • Deep RL expertise: 3+ years hands-on experience with environment design, reward engineering, policy optimization

LLM post-training: Experience fine-tuning LLMs using RLHF, DPO, PPO, or similar

Production skills: Software engineering beyond research with scalable pipelines and training infrastructure

Agentic AI: Experience with LLM-based agents, tool use, multi-step reasoning

  • Technical stack: Strong Python
  • Gymnasium, RLlib, Stable Baselines
  • PyTorch/JAX/TensorFlow

Education

MS/PhD in CS, ML, or related field (or equivalent experience)

Nice to have

  • Publications at NeurIPS, ICML, ICLR, ACL, or similar venues

Enterprise workflow experience in healthcare, finance, logistics, or compliance

Open-source contributions to CleanRL, TRL, veRL, or agent frameworks

Experience with world models, synthetic data generation, and simulation

Distributed training and large-scale RL experimentation

Why Join Centific

  • Lead the frontier: Shape a new discipline at the intersection of RL, simulation, and enterprise AI

Ship your science: See your research power real systems across healthcare, finance, and safety

Collaborate with leaders: Work alongside NVIDIA, Microsoft, and the global AI community

Build what matters: Create governed, compliant AI systems enterprises can trust.

About OneForma

About Centific

Centific is a frontier AI data foundry that curates diverse, high-quality data, using our purpose-built technology platforms to empower the Magnificent Seven and our enterprise clients with safe, scalable AI deployment. Our team includes more than 150 PhDs and data scientists, along with more than 4,000 AI practitioners and engineers. We harness the power of an integrated solution ecosystem—comprising industry-leading partnerships and 1.8 million vertical domain experts in more than 230 markets—to create contextual, multilingual, pre-trained datasets; fine-tuned, industry-specific LLMs; and RAG pipelines supported by vector databases. Our zero-distance innovation™ solutions for GenAI can reduce GenAI costs by up to 80% and bring solutions to market 50% faster.

Our mission is to bridge the gap between AI creators and industry leaders by bringing best practices in GenAI to unicorn innovators and enterprise customers. We aim to help these organizations unlock significant business value by deploying GenAI at scale, helping to ensure they stay at the forefront of technological advancement and maintain a competitive edge in their respective markets.

About Job

Role: Senior Applied Reinforcement Learning Engineer

Location: Palo Alto, CA or Seattle, WA (Hybrid/Remote)

About the Team

Centific AI Research advances foundational AI models and applications through reinforcement learning, alignment, and human-centered intelligence. Our mission is to transform data, signals, and human insight into next-generation intelligent systems that redefine enterprise intelligence.

We're building a governed RL environment platform that enables enterprises to safely iterate and improve AI agent workflows through simulation-based learning, bridging human-labeled signal creation with automated RL training for high-stakes operations.

Core RL Competencies

Foundational RL

  • MDPs & value methods: State/action spaces, Q-learning, DQN, Double DQN, Dueling DQN

Policy gradient methods: REINFORCE, Actor-Critic, A2C/A3C, variance reduction

Advanced optimization: PPO, TRPO, SAC, trust regions, entropy regularization

TD learning: TD(0), TD(λ), eligibility traces, bootstrapping methods

LLM Alignment & Post-Training

  • RLHF pipelines: Reward model training, preference learning, human feedback integration

Direct optimization: DPO, IPO, KTO, offline preference optimization

Group-based methods: GRPO, RLOO, sample-efficient policy improvement

Reward modeling: Bradley-Terry models, reward hacking mitigation, KL constraints

Environment Design

  • Gymnasium/OpenAI Gym: Custom environments, observation/action spaces, wrapper patterns

Reward engineering: Sparse vs. dense rewards, potential-based shaping, intrinsic motivation

Verifier design: Programmatic reward functions, outcome verification, ground-truth evaluation

Simulation: Sim-to-real transfer, domain randomization, multi-agent dynamics

Advanced Techniques

  • Offline RL: CQL, BCQ, IQL for learning from fixed datasets without environment interaction

Model-based RL: World models, Dreamer, MuZero, learned dynamics

Hierarchical RL: Options framework, goal-conditioned policies, temporal abstraction

Imitation & exploration: Behavioral cloning, GAIL, curiosity-driven exploration, UCB

Salary: $150K - $300K Annually

Centific is an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, ancestry, citizenship status, age, mental or physical disability, medical condition, sex (including pregnancy), gender identity or expression, sexual orientation, marital status, familial status, veteran status, or any other characteristic protected by applicable law. We consider qualified applicants regardless of criminal histories, consistent with legal requirements.

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from OneForma

View company →

AI Research Engineer: Vision AI / VLM / Physical AI

OneForma
Remote United States Full-time $90K / year

About Centific Centific is a frontier AI data foundry that curates diverse, high-quality data, using our purpose-built technology platforms to empower the…

19h ago Data

Power BI Developer

OneForma
Remote United States Full-time $85K / year

About Centific Centific is a frontier AI data foundry that curates diverse, high-quality data, using our purpose-built technology platforms to empower the…

9 days ago Data

Principal Research Scientist – Vision AI, Simulation & Physical AI

OneForma
Remote United States Full-time $200K – $300K / year

About Centific Centific is a frontier AI data foundry that curates diverse, high-quality data, using our purpose-built technology platforms to empower the…

12 days ago Data

AI Research Engineer: Vision AI / VLM / Physical AI-1

OneForma
Remote United States Full-time $180K – $240K / year

About Centific Centific is a frontier AI data foundry that curates diverse, high-quality data, using our purpose-built technology platforms to empower the…

12 days ago Data

Similar remote jobs

Browse all →

AI Safety Expert - Bilingual

mercor
Remote United States Contract $17 – $25 / hour

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter…

1h ago Data

Senior AI & Transformation Enablement Specialist

Datasite
Remote United States Full-time $83K – $141K / year

About us Datasite is the essential infrastructure for M&A. Also comprising Grata, Blueflame AI, and Sherpany, we help dealbreakers find opportunities, manage transactions, and make key…

2h ago Data

Business Analyst III Claims, DRG

Centene Corporation
Remote United States Full-time $70K – $126K / year

Position Purpose: Perform various analysis and interpretation to link business needs and objectives for assigned function. Key Details: Must be authorized to work in the U.S. without the…

2h ago Data

Functional Consultant – Epicor Kinetic (Operations & Supply Chain) – 100% Remote

TeccWeb
Remote United States Full-time

About Teccweb Teccweb is an Epicor Service Partner specializing in the implementation and optimization of Epicor Kinetic for mid-market manufacturers and distributors across North America.…

2h ago Data

Product Owner

Dev Partners
Remote Philippines Full-time

💻 We Are Hiring- Product Owner | 100% Remote We are seeking an experienced Product Owner to oversee and coordinate the ongoing maintenance, enhancement, and continuous improvement of an…

3h ago Data

Mechanical Engineer III

DLB Associates
Remote United States Full-time $105K – $135K / year

DLB Associates is a premier engineering and consulting firm specializing in innovative, mission-critical solutions across hyperscale data centers, advanced infrastructure, and…

3h ago Data

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.