Zora Tung

REALM: Retrieval-Augmented Language Model Pre-Training

2020 · arXiv (Cornell University)

Language model pre-training has been shown to capture a surprising amount of world knowledge, crucial for NLP tasks such as question answering. However, this knowledge is stored implicitly in the parameters of a neural network, …