Peng Shen

Hierarchical Cross-Modality Knowledge Transfer with Sinkhorn Attention for CTC-based ASR

2023 · arXiv (Cornell University)

Due to the modality discrepancy between textual and acoustic modeling, efficiently transferring linguistic knowledge from a pretrained language model (PLM) to acoustic encoding for automatic speech recognition (ASR) still remains a challenging task. In this …