Nicolas Hervé

ASR-Generated Text for Language Model Pre-training Applied to Speech Tasks

2022 · arXiv (Cornell University)

We aim at improving spoken language modeling (LM) using very large amount of automatically transcribed speech. We leverage the INA (French National Audiovisual Institute) collection and obtain 19GB of text after applying ASR on 350,000 …