Tongyao Zhu

Beyond Memorization: The Challenge of Random Memory Access in Language Models

2024

Recent developments in Language Models (LMs) have shown their effectiveness in NLP tasks, particularly in knowledge-intensive tasks.However, the mechanisms underlying knowledge storage and memory access within their parameters remain elusive.In this paper, we investigate whether …