Philip Naveen

FASFA: A Novel Next-Generation Backpropagation Optimizer

2022

This paper introduces the fast adaptive stochastic function accelerator (FASFA) for gradient-based optimization of stochastic objective functions. It works based on Nesterov-enhanced first and second momentum estimates. The method is simple and effective during implementation …