Dokook Choe

Character-Level Language Modeling with Deeper Self-Attention

2019

LSTMs and other RNN variants have shown strong performance on character-level language modeling. These models are typically trained using truncated backpropagation through time, and it is common to assume that their success stems from their …