Wangyou Zhang

A Comparative Study on Transformer vs RNN in Speech Applications

2019 · 2019 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU)

Sequence-to-sequence models have been widely used in end-to-end speech processing, for example, automatic speech recognition (ASR), speech translation (ST), and text-to-speech (TTS). This paper focuses on an emergent sequence-to-sequence model called Transformer, which achieves state-of-the-art …