Shengyu Mao

Knowledge Rumination for Pre-trained Language Models

2023 · arXiv (Cornell University)

Previous studies have revealed that vanilla pre-trained language models (PLMs) lack the capacity to handle knowledge-intensive NLP tasks alone; thus, several works have attempted to integrate external knowledge into PLMs. However, despite the promising outcome, …