Taiwei Cai

Two-stage self-supervised training vision transformers for small datasets

2024

After a series of achievements in the field of natural language processing, Transformers have shown promising results upon their introduction to computer vision, particularly under conditions of large-scale data. However, when faced with insufficient data, …