Michael Field

On the Principle of Least Symmetry Breaking in Shallow ReLU Models

2019 · arXiv (Cornell University)

We consider the optimization problem associated with fitting two-layer ReLU networks with respect to the squared loss, where labels are assumed to be generated by a target network. Focusing first on standard Gaussian inputs, we …