Rowan Hall Maudslay

Information-Theoretic Probing for Linguistic Structure

2020

The success of neural networks on a diverse set of NLP tasks has led researchers to question how much these networks actually "know" about natural language. Probes are a natural way of assessing this. When …