Leitian Tao

Your Weak LLM is Secretly a Strong Teacher for Alignment

2024 · arXiv (Cornell University)

The burgeoning capabilities of large language models (LLMs) have underscored the need for alignment to ensure these models act in accordance with human values and intentions. Existing alignment frameworks present constraints either in the form …