Jing An

Convergence of stochastic gradient descent under a local Lojasiewicz condition for deep neural networks

2023 · arXiv (Cornell University)

We study the convergence of stochastic gradient descent (SGD) for non-convex objective functions. We establish the local convergence with positive probability under the local Łojasiewicz condition introduced by Chatterjee in \cite{chatterjee2022convergence} and an additional local …