Lukas Balles

Follow the Signs for Robust Stochastic Optimization.

2017 · arXiv (Cornell University)

Stochastic noise on gradients is now a common feature in machine learning. It complicates the design of optimization algorithms, and its effect can be unintuitive: We show that in some settings, particularly those of low …