Jitao Sang

Attention, Please! Adversarial Defense via Activation Rectification and Preservation

2022 · ACM Transactions on Multimedia Computing Communications and Applications

This study provides a new understanding of the adversarial attack problem by examining the correlation between adversarial attack and visual attention change. In particular, we observed that: (1) images with incomplete attention regions are more …

Evaluation and Analysis of Hallucination in Large Vision-Language Models

2023 · arXiv (Cornell University)

Large Vision-Language Models (LVLMs) have recently achieved remarkable success. However, LVLMs are still plagued by the hallucination problem, which limits the practicality in many scenarios. Hallucination refers to the information of LVLMs' responses that does …