Barry Devereux

Representation of Word Meaning in the Intermediate Projection Layer of a Neural Language Model

2018

Performance in language modelling has been significantly improved by training recurrent neural networks on large corpora. This progress has come at the cost of interpretability and an understanding of how these architectures function, making principled …