Guangsen Wang

Speech-XLNet: Unsupervised Acoustic Model Pretraining for Self-Attention Networks

2020

Self-attention network (SAN) can benefit significantly from the bi-directional representation learning through unsupervised pretraining paradigms such as BERT and XLNet.In this paper, we present an XLNet-like pretraining scheme "Speech-XLNet" to learn speech representations with self-attention …

Investigating End-to-end Speech Recognition for Mandarin-english Code-switching

2019

Code-switching is a common phenomenon in many multilingual communities and presents a challenge to automatic speech recognition (ASR). In this paper, three approaches are investigated to improve end-to-end speech recognition on Mandarin-English code-switching task. First, …