Chun Huang

Non-Ergodic Convergence Analysis of Heavy-Ball Algorithms

2019 · Proceedings of the AAAI Conference on Artificial Intelligence

In this paper, we revisit the convergence of the Heavy-ball method, and present improved convergence complexity results in the convex setting. We provide the first non-ergodic O(1/k) rate result of the Heavy-ball algorithm with constant …