Hengshuang Zhao

Exploring Self-Attention for Image Recognition

2020

Recent work has shown that self-attention can serve as a basic building block for image recognition models. We explore variations of self-attention and assess their effectiveness for image recognition. We consider two forms of self-attention. …