Antti Honkela

Learning Rate Adaptation for Federated and Differentially Private Learning

2018 · arXiv (Cornell University)

We propose an algorithm for the adaptation of the learning rate for stochastic gradient descent (SGD) that avoids the need for validation set use. The idea for the adaptiveness comes from the technique of extrapolation: …