Kushal Chakrabarti

Generalized AdaGrad (G-AdaGrad) and Adam: A State-Space Perspective

2021 · arXiv (Cornell University)

Accelerated gradient-based methods are being extensively used for solving non-convex machine learning problems, especially when the data points are abundant or the available data is distributed across several agents. Two of the prominent accelerated gradient …