Alessandro Achille

Usable Information and Evolution of Optimal Representations During Training

2021 · arXiv (Cornell University)

We introduce a notion of usable information contained in the representation learned by a deep network, and use it to study how optimal representations for the task emerge during training, and how they adapt to …