Yikun Lei

Towards a Deep Understanding of Multilingual End-to-End Speech Translation

2023 · arXiv (Cornell University)

In this paper, we employ Singular Value Canonical Correlation Analysis (SVCCA) to analyze representations learnt in a multilingual end-to-end speech translation model trained over 22 languages. SVCCA enables us to estimate representational similarity across languages …