Jonas Wallat

BERTnesia: Investigating the capture and forgetting of knowledge in BERT

2020

Probing complex language models has recently revealed several insights into linguistic and semantic patterns found in the learned representations. In this paper, we probe BERT specifically to understand and measure the relational knowledge it captures. …