Xin Lei

Knowledge Distillation for Recurrent Neural Network Language Modeling with Trust Regularization

2019

Recurrent Neural Networks (RNNs) have dominated language modeling because of their superior performance over traditional N-gram based models. In many applications, a large Recurrent Neural Network language model (RNNLM) or an ensemble of several RNNLMs …

WeNet: Production oriented Streaming and Non-streaming End-to-End Speech Recognition Toolkit

2021 · arXiv (Cornell University)

In this paper, we propose an open source, production first, and production ready speech recognition toolkit called WeNet in which a new two-pass approach is implemented to unify streaming and non-streaming end-to-end (E2E) speech recognition …