Yosuke Higuchi

BERT Meets CTC: New Formulation of End-to-End Speech Recognition with Pre-trained Masked Language Model

2022 · arXiv (Cornell University)

This paper presents BERT-CTC, a novel formulation of end-to-end speech recognition that adapts BERT for connectionist temporal classification (CTC). Our formulation relaxes the conditional independence assumptions used in conventional CTC and incorporates linguistic knowledge through …