Attilio Fiandrotti

Neural Velocity for hyperparameter tuning

2025

Hyperparameter tuning, such as learning rate decay and defining a stopping criterion, often relies on monitoring the validation loss. This paper presents NeVe, a dynamic training approach that adjusts the learning rate and defines the …