Arnaud Descours

Law of large numbers and central limit theorem for wide two-layer neural networks: the mini-batch and noisy case

2022 · arXiv (Cornell University)

In this work, we consider a wide two-layer neural network and study the behavior of its empirical weights under a dynamics set by a stochastic gradient descent along the quadratic loss with mini-batches and noise. …