Michal Klein

Multimodal Autoregressive Pre-training of Large Vision Encoders

2024 · arXiv (Cornell University)

We introduce a novel method for pre-training of large-scale vision encoders. Building on recent advancements in autoregressive pre-training of vision models, we extend this framework to a multimodal setting, i.e., images and text. In this …