Mikhail A. Bragin

Accelerating Level-Value Adjustment for the Polyak Stepsize

2023 · arXiv (Cornell University)

The Polyak stepsize has been widely used in subgradient methods for non-smooth convex optimization. However, calculating the stepsize requires the optimal value, which is generally unknown. Therefore, dynamic estimations of the optimal value are usually …