Ayu Teramen

English-to-Japanese Multimodal Machine Translation Based on Image-Text Matching of Lecture Videos

2024

We work on a multimodal machine translation of the audio contained in English lecture videos to generate Japanese subtitles.Image-guided multimodal machine translation is promising for error correction in speech recognition and for text disambiguation.In our …