Yuan Shangguan

AudioChatLlama: Towards General-Purpose Speech Abilities for LLMs

2023 · arXiv (Cornell University)

In this work, we extend the instruction-tuned Llama-2 model with end-to-end general-purpose speech processing and reasoning abilities while maintaining the wide range of original LLM capabilities, without using any carefully curated paired data. The resulting …