Hongwei Yu

Defending Against Universal Patch Attacks by Restricting Token Attention in Vision Transformers

2023

Previous works reveal that similar to CNNs, vision transformers (ViT) are also vulnerable to universal adversarial patch attacks. In this paper, we empirically reveal and mathematically explain that the shallow tokens in the transformer and …