Shu‐Ching Chen

T-LRA: Trend-Based Learning Rate Annealing for Deep Neural Networks

2017

As deep learning has been widespread in a wide range of applications, its training speed and convergence have become crucial. Among different hyperparameters existed in the gradient descent algorithm, the learning rate has an essential …