R Thomas McCoy

What do you learn from context? Probing for sentence structure in\n contextualized word representations

2019 · arXiv (Cornell University)

Contextualized representation models such as ELMo (Peters et al., 2018a) and\nBERT (Devlin et al., 2018) have recently achieved state-of-the-art results on a\ndiverse array of downstream NLP tasks. Building on recent token-level probing\nwork, we introduce a …