Jingtong Sun

LRTD: A Low-rank Transformer with Dynamic Depth and Width for Speech Recognition

2022 · 2022 International Joint Conference on Neural Networks (IJCNN)

Though Transformer-based models have achieved great success in the automatic speech recognition (ASR) field, they are generally resource-hungry and computation-intensive which makes them difficult to deploy in resource-restricted devices. In this paper, we propose LRTD, …