Preference Model
About
Preference Model builds RL environments and reward functions for real-world machine-learning research tasks. Its goal is to automate ML research engineering by giving frontier models diverse, realistic tasks for post-training and evaluation.
What They Offer
Commercial or operational services this company provides.
Rubrics / verifiers
Custom RL environments
Products & Public Artifacts
Preference Model RL Environments
Environment · Access by request
Partner-built RL environments for real-world ML research and engineering tasks.
Visit artifact →Technical Capabilities
Programmatic Verifiers
Only publicly documented capabilities are shown. Absence does not imply the capability is unavailable.
Focus Areas
RL EnvironmentsRLHF / Post-trainingEvaluations
Domains
ScienceSoftware Engineering
Leadership
Ning Cao
Co-founder
Jennifer Zhou
Co-founder and CEO