Melikasadat Emami

Implicit Bias of Linear RNNs

2021 · arXiv (Cornell University)

Contemporary wisdom based on empirical studies suggests that standard recurrent neural networks (RNNs) do not perform well on tasks requiring long-term memory. However, precise reasoning for this behavior is still unknown. This paper provides a …