Ruize Wang

K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters

2021

We study the problem of injecting knowledge into large pre-trained models like BERT and RoBERTa. Existing methods typically update the original parameters of pre-trained models when injecting knowledge. However, when multiple kinds of knowledge are …