Marin Soljačić

Tunable Efficient Unitary Neural Networks (EUNN) and their application to RNNs

2016 · arXiv (Cornell University)

Using unitary (instead of general) matrices in artificial neural networks (ANNs) is a promising way to solve the gradient explosion/vanishing problem, as well as to enable ANNs to learn long-term correlations in the data. This …