Xiangyi Chen

On the Convergence of A Class of Adam-Type Algorithms for Non-Convex\n Optimization

2018 · arXiv (Cornell University)

This paper studies a class of adaptive gradient based momentum algorithms\nthat update the search directions and learning rates simultaneously using past\ngradients. This class, which we refer to as the "Adam-type", includes the\npopular algorithms such as …