César Laurent

Recurrent Batch Normalization

2016 · arXiv (Cornell University)

We propose a reparameterization of LSTM that brings the benefits of batch normalization to recurrent neural networks. Whereas previous works only apply batch normalization to the input-to-hidden transformation of RNNs, we demonstrate that it is …