David Gamarnik

Self-Regularity of Output Weights for Overparameterized Two-Layer Neural Networks

2021

We consider the problem of finding a two-layer neural network with sigmoid, rectified linear unit, or binary step activation functions that “fits” a training data set as accurately as possible as quantified by the training …