Yizhi Li

MIO: A Foundation Model on Multimodal Tokens

2024 · arXiv (Cornell University)

In this paper, we introduce MIO, a novel foundation model built on multimodal tokens, capable of understanding and generating speech, text, images, and videos in an end-to-end, autoregressive manner. While the emergence of large language …