Vuli\'c, Ivan

Probing Pretrained Language Models for Lexical Semantics

2020 · arXiv (Cornell University)

The success of large pretrained language models (LMs) such as BERT and RoBERTa has sparked interest in probing their representations, in order to unveil what types of knowledge they implicitly capture. While prior research focused …