Biao Gong

Accelerating Pre-training of Multimodal LLMs via Chain-of-Sight

2024 · arXiv (Cornell University)

This paper introduces Chain-of-Sight, a vision-language bridge module that accelerates the pre-training of Multimodal Large Language Models (MLLMs). Our approach employs a sequence of visual resamplers that capture visual details at various spacial scales. This …