Ashwin Paranjape

Lost in the Middle: How Language Models Use Long Contexts

2024 · Transactions of the Association for Computational Linguistics

Abstract While recent language models have the ability to take long contexts as input, relatively little is known about how well they use longer context. We analyze the performance of language models on two tasks …