Ash, Elliott

Variational Best-of-N Alignment

2024 · arXiv (Cornell University)

Best-of-N (BoN) is a popular and effective algorithm for aligning language models to human preferences. The algorithm works as follows: at inference time, N samples are drawn from the language model, and the sample with …