Heng-Jui Chang

Mandarin-English Code-switching Speech Recognition with Self-supervised Speech Representation Models

2021 · arXiv (Cornell University)

Code-switching (CS) is common in daily conversations where more than one language is used within a sentence. The difficulties of CS speech recognition lie in alternating languages and the lack of transcribed data. Therefore, this …

R-Spin: Efficient Speaker and Noise-invariant Representation Learning with Acoustic Pieces

2023 · arXiv (Cornell University)

This paper introduces Robust Spin (R-Spin), a data-efficient domain-specific self-supervision method for speaker and noise-invariant speech representations by learning discrete acoustic units with speaker-invariant clustering (Spin). R-Spin resolves Spin's issues and enhances content representations by …