Hideitsu Hino

Information Geometry of Dropout Training

2022 · arXiv (Cornell University)

Dropout is one of the most popular regularization techniques in neural network training. Because of its power and simplicity of idea, dropout has been analyzed extensively and many variants have been proposed. In this paper, …