Tim Cooijmans

Recurrent Batch Normalization

2016 · arXiv (Cornell University)

We propose a reparameterization of LSTM that brings the benefits of batch normalization to recurrent neural networks. Whereas previous works only apply batch normalization to the input-to-hidden transformation of RNNs, we demonstrate that it is …

Meta-Value Learning: a General Framework for Learning with Learning Awareness

2023 · arXiv (Cornell University)

Gradient-based learning in multi-agent systems is difficult because the gradient derives from a first-order model which does not account for the interaction between agents' learning processes. LOLA (arXiv:1709.04326) accounts for this by differentiating through one …