Jianing Qiu

One Prompt Word is Enough to Boost Adversarial Robustness for Pre-trained Vision-Language Models

2024 · arXiv (Cornell University)

Large pre-trained Vision-Language Models (VLMs) like CLIP, despite having remarkable generalization ability, are highly vulnerable to adversarial examples. This work studies the adversarial robustness of VLMs from the novel perspective of the text prompt instead …