Archit Sharma

A Critical Evaluation of AI Feedback for Aligning Large Language Models

2024 · arXiv (Cornell University)

Reinforcement learning with AI feedback (RLAIF) is a popular paradigm for improving the instruction-following abilities of powerful pre-trained language models. RLAIF first performs supervised fine-tuning (SFT) using demonstrations from a teacher model and then further …