Edouard Oyallon

Online Regularized Nonlinear Acceleration

2018 · arXiv (Cornell University)

Regularized nonlinear acceleration (RNA) estimates the minimum of a function by post-processing iterates from an algorithm such as the gradient method. It can be seen as a regularized version of Anderson acceleration, a classical acceleration …