Dean L. Slack

On the Hierarchical Information in a Single Contextualised Word Representation (Student Abstract)

2020 · Proceedings of the AAAI Conference on Artificial Intelligence

Contextual word embeddings produced by neural language models, such as BERT or ELMo, have seen widespread application and performance gains across many Natural Language Processing tasks, suggesting rich linguistic features encoded in their representations. This …