Michael G. Ryan

Distilling an End-to-End Voice Assistant Without Instruction Training Data

2024 · arXiv (Cornell University)

Voice assistants, such as Siri and Google Assistant, typically model audio and text separately, resulting in lost speech information and increased complexity. Recent efforts to address this with end-to-end Speech Large Language Models (LLMs) trained …