Matthieu Wyart

Scaling description of generalization with number of parameters in deep learning

2020 · Journal of Statistical Mechanics Theory and Experiment

Abstract Supervised deep learning involves the training of neural networks with a large number N of parameters. For large enough N , in the so-called over-parametrized regime, one can essentially fit the training data points. …