Aurko Roy

Fast Decoding in Sequence Models using Discrete Latent Variables

2018 · arXiv (Cornell University)

Autoregressive sequence models based on deep neural networks, such as RNNs, Wavenet and the Transformer attain state-of-the-art results on many tasks. However, they are difficult to parallelize and are thus slow at processing long sequences. …