Juhan Bae

Eigenvalue Corrected Noisy Natural Gradient

2018 · arXiv (Cornell University)

Variational Bayesian neural networks combine the flexibility of deep learning with Bayesian uncertainty estimation. However, inference procedures for flexible variational posteriors are computationally expensive. A recently proposed method, noisy natural gradient, is a surprisingly simple …