Pratik Patil

Revisiting Optimism and Model Complexity in the Wake of Overparameterized Machine Learning

2024 · arXiv (Cornell University)

Common practice in modern machine learning involves fitting a large number of parameters relative to the number of observations. These overparameterized models can exhibit surprising generalization behavior, e.g., ``double descent'' in the prediction error curve …