Hu, Tianhao

Adversarial Preference Optimization: Enhancing Your Alignment via RM-LLM Game

2023 · arXiv (Cornell University)

Human preference alignment is essential to improve the interaction quality of large language models (LLMs). Existing alignment methods depend on manually annotated preference data to guide the LLM optimization directions. However, continuously updating LLMs for …