The role
- COMP
- $180K - $280K
- EQUITY
- Competitive equity
- LOCATION
- San Francisco
- WORKPLACE
- On-site
- EXPERIENCE
- 1 - 5 years
- VISA
- None, Visa transfers
- INDUSTRY
- AI, Data
/roles — ROLE_320
Member of Technical Staff, Head of Quality
Young applied research lab turning real-world data into simulated environments that train AI agents
The company
Applied AI research lab that converts real-world data into simulated training environments for AI agents, serving leading AI labs, large cloud providers, and enterprises that need models for high-stakes work.
- STAGE
- Series A-stage
- FUNDING
- $10M+ raised
- TEAM
- ~10 people
- FOUNDED
- 2025
JD — the work
About the role
As head of quality, you would own quality across all environments and datasets the company delivers, and build both the systems and the team that hold that bar at scale. The role is hands-on: expect to spend a lot of time in the data itself, reading samples and building automated checks, so that what ships genuinely teaches models something. You would also recruit and manage the reviewers who work alongside those systems. It suits someone who judges data by what a model actually learns from it, not by box-ticking.
What you'll do
- Spend a large share of your time personally reviewing human-generated data and environment results
- Create automated checks and grading agents to flag reward hacking, faulty verifiers, and distribution shifts ahead of delivery
- Define concrete quality measures and pass criteria covering tasks, verifiers, rewards, environments, and datasets
- Sign off on what ships to frontier lab, cloud, and enterprise customers
- Recruit and lead a growing group of QA engineers and data reviewers
What they're looking for
- 1 to 5 years of experience in data quality, ML evaluation, or closely related work
- Willingness to spend long stretches reading and analyzing raw data by hand
- Ability to build automated evaluation, grading, and QA systems
- Familiarity with RL training data pitfalls such as reward hacking and verifier failures
- Interest in hiring and managing a team as the company scales