Roberto Carlini

On the evolution of syntactic information encoded by BERT’s contextualized representations

2021

The adaptation of pretrained language models to solve supervised tasks has become a baseline in NLP, and many recent works have focused on studying how linguistic information is encoded in the pretrained sentence representations. Among …