Stephan Wojtowytsch

On the emergence of tetrahedral symmetry in the final and penultimate layers of neural network classifiers.

2020 · arXiv (Cornell University)

A recent numerical study observed that neural network classifiers enjoy a large degree of symmetry in the penultimate layer. Namely, if $h(x) = Af(x) +b$ where $A$ is a linear map and $f$ is the …

On the emergence of simplex symmetry in the final and penultimate layers of neural network classifiers

2020 · arXiv (Cornell University)

A recent numerical study observed that neural network classifiers enjoy a large degree of symmetry in the penultimate layer. Namely, if $h(x) = Af(x) +b$ where $A$ is a linear map and $f$ is the …