Chris Mingard

The Equilibrium Hypothesis: Rethinking implicit regularization in Deep Neural Networks.

2021 · arXiv (Cornell University)

Modern Deep Neural Networks (DNNs) exhibit impressive generalization properties on a variety of tasks without explicit regularization, suggesting the existence of hidden regularization effects. Recent work by Baratin et al. (2021) sheds light on an …