Chunyang Wu

Deep Activation Mixture Model for Speech Recognition

2017

Deep learning approaches achieve state-of-the-art performance in a range of applications, including speech recognition. However, the parameters of the deep neural network (DNN) are hard to interpret, which makes regularisation and adaptation to speaker or …

AudioChatLlama: Towards General-Purpose Speech Abilities for LLMs

2023 · arXiv (Cornell University)

In this work, we extend the instruction-tuned Llama-2 model with end-to-end general-purpose speech processing and reasoning abilities while maintaining the wide range of original LLM capabilities, without using any carefully curated paired data. The resulting …