Yawen Duan

On The Fragility of Learned Reward Functions

2023 · arXiv (Cornell University)

Reward functions are notoriously difficult to specify, especially for tasks with complex goals. Reward learning approaches attempt to infer reward functions from human feedback and preferences. Prior works on reward learning have mainly focused on …