Huy Hoang Ha

Ichigo: Mixed-Modal Early-Fusion Realtime Voice Assistant

2024 · arXiv (Cornell University)

Large Language Models (LLMs) have revolutionized natural language processing, but their application to speech-based tasks remains challenging due to the complexities of integrating audio and text modalities. This paper introduces Ichigo, a mixed-modal model that …