Junseok Kwon

Adaptive Regularization via Residual Smoothing in Deep Learning Optimization

2019 · arXiv (Cornell University)

We present an adaptive regularization algorithm that can be effectively applied to the optimization problem in deep learning framework. Our regularization algorithm aims to take into account the fitness of data to the current state …