Songyang Gao

Pre-Trained Policy Discriminators are General Reward Models

2025

We offer a novel perspective on reward modeling by formulating it as a policy discriminator, which quantifies the difference between two policies to generate a reward signal, guiding the training policy towards a target policy …