Xiangtai Li

Multi-Task Learning With Multi-Query Transformer for Dense Prediction

2023 · IEEE Transactions on Circuits and Systems for Video Technology

Previous multi-task dense prediction studies developed complex pipelines such as multi-modal distillations in multiple stages or searching for task relational contexts for each task. The core insight beyond these methods is to maximize the mutual …

The Scalability of Simplicity: Empirical Analysis of Vision-Language Learning with a Single Transformer

2025

This paper introduces SAIL, a single transformer unified multimodal large language model (MLLM) that integrates raw pixel encoding and language decoding within a singular architecture. Unlike existing modular MLLMs, which rely on a pre-trained vision …