Yujia Xie

DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models

2023 · arXiv (Cornell University)

Despite their impressive capabilities, large language models (LLMs) are prone to hallucinations, i.e., generating content that deviates from facts seen during pretraining. We propose a simple decoding strategy for reducing hallucinations with pretrained LLMs that …