Matthew Faw

Beyond Uniform Smoothness: A Stopped Analysis of Adaptive SGD

2023 · arXiv (Cornell University)

This work considers the problem of finding a first-order stationary point of a non-convex function with potentially unbounded smoothness constant using a stochastic gradient oracle. We focus on the class of $(L_0,L_1)$-smooth functions proposed by …