Mateusz Ostaszewski

The Tunnel Effect: Building Data Representations in Deep Neural Networks

2023 · arXiv (Cornell University)

Deep neural networks are widely known for their remarkable effectiveness across various tasks, with the consensus that deeper networks implicitly learn more complex data representations. This paper shows that sufficiently deep networks trained for supervised …