Mocho Go

GSWIN: Gated MLP Vision Model with Hierarchical Structure of Shifted Window

2023

Following the success in language domain, the self-attention mechanism (Transformer) has been adopted in the vision domain and achieving great success recently. Additionally, the use of multi-layer perceptron (MLP) is also explored in the vision …