Niklas Stoehr

The Architectural Bottleneck Principle

2022

In this paper, we seek to measure how much information a component in a neural network could extract from the representations fed into it. Our work stands in contrast to prior probing work, most of …