Ya-xiang Yuan

Revisiting the acceleration phenomenon via high-resolution differential equations

2022 · arXiv (Cornell University)

Nesterov's accelerated gradient descent (NAG) is one of the milestones in the history of first-order algorithms. It was not successfully uncovered until the high-resolution differential equation framework was proposed in [Shi et al., 2022] that …