Jonathan S. Rosenfeld

A Constructive Prediction of the Generalization Error Across Scales

2020 · International Conference on Learning Representations

The dependency of the generalization error of neural networks on model and dataset size is of critical importance both in practice and for understanding the theory of neural networks. Nevertheless, the functional form of this …