Gilles Bareilles

On Monotonicity in AI Alignment

2025 · arXiv (Cornell University)

Comparison-based preference learning has become central to the alignment of AI models with human preferences. However, these methods may behave counterintuitively. After empirically observing that, when accounting for a preference for response $y$ over $z$, …