Researcher profile
Ryan J. Tibshirani
2 papers in the PaperMetrix corpus
Publications
Papers by this author
-
The Implicit Regularization of Stochastic Gradient Flow for Least Squares
2020 · arXiv (Cornell University)
We study the implicit regularization of mini-batch stochastic gradient descent, when applied to the fundamental problem of least squares regression. We leverage a continuous-time stochastic differential equation having the same moments as stochastic gradient descent, …
-
Revisiting Optimism and Model Complexity in the Wake of Overparameterized Machine Learning
2024 · arXiv (Cornell University)
Common practice in modern machine learning involves fitting a large number of parameters relative to the number of observations. These overparameterized models can exhibit surprising generalization behavior, e.g., ``double descent'' in the prediction error curve …