Itay Dalmedigos

In-Context Retrieval-Augmented Language Models

2023 · Transactions of the Association for Computational Linguistics

Abstract Retrieval-Augmented Language Modeling (RALM) methods, which condition a language model (LM) on relevant documents from a grounding corpus during generation, were shown to significantly improve language modeling performance. In addition, they can mitigate the …