Researcher profile
Maksim Velikanov
2 papers in the PaperMetrix corpus
Publications
Papers by this author
-
Universal scaling laws in the gradient descent training of neural networks
2021 · arXiv (Cornell University)
Current theoretical results on optimization trajectories of neural networks trained by gradient descent typically have the form of rigorous but potentially loose bounds on the loss values. In the present work we take a different …
-
Embedded Ensembles: Infinite Width Limit and Operating Regimes
2022 · arXiv (Cornell University)
A memory efficient approach to ensembling neural networks is to share most weights among the ensembled models by means of a single reference network. We refer to this strategy as Embedded Ensembling (EE); its particular …