preprint Open access

Restarting accelerated gradient methods with a rough strong convexity estimate

  • arXiv (Cornell University)
  • Cornell University
Research footprint

At a glance

Citations
22
References
2
Comments
0
Paper overview

Abstract

We propose new restarting strategies for accelerated gradient and accelerated coordinate descent methods. Our main contribution is to show that the restarted method has a geometric rate of convergence for any restarting frequency, and so it allows us to take profit of restarting even when we do not know the strong convexity coefficient. The scheme can be combined with adaptive restarting, leading to the first provable convergence for adaptive restarting schemes with accelerated gradient methods. Finally, we illustrate the properties of the algorithm on a regularized logistic regression problem and on a Lasso problem.

Record transparency

Publication details

DOI
10.48550/arxiv.1609.07358
OpenAlex
W2524121306
Document type
preprint
Language
EN
Source
arXiv (Cornell University)
Last metadata update
Community

Comments

Log in to join the discussion.

  1. No comments yet. Start the discussion.