Yongjie Lin

Open Sesame: Getting inside BERT’s Linguistic Knowledge

2019

How and to what extent does BERT encode syntactically-sensitive hierarchical information or positionally-sensitive linear information? Recent work has shown that contextual representations like BERT perform well on tasks that require sensitivity to linguistic structure. We …