Jagadeesh Balam

Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data

2025

Recent end-to-end speech language models (SLMs) have expanded upon the capabilities of large language models (LLMs) by incorporating pre-trained speech models. However, these SLMs often undergo extensive speech instruction-tuning to bridge the gap between speech …

EMMeTT: Efficient Multimodal Machine Translation Training

2025

A rising interest in the modality extension of foundation language models warrants discussion on the most effective, and efficient, multimodal training approach. This work focuses on neural machine translation (NMT) and proposes a joint multimodal …