Tobias Norlund

Surface-Based Retrieval Reduces Perplexity of Retrieval-Augmented Language Models

2023

Augmenting language models with a retrieval mechanism has been shown to significantly improve their performance while keeping the number of parameters low. Retrieval-augmented models commonly rely on a semantic retrieval mechanism based on the similarity …