Sibei Yang

ConvNets vs. Transformers: Whose Visual Representations are More Transferable?

2021

Vision transformers have attracted much attention from computer vision researchers as they are not restricted to the spatial inductive bias of ConvNets. However, although Transformer-based backbones have achieved much progress on ImageNet classification, it is …

Dissecting and Mitigating Diffusion Bias via Mechanistic Interpretability

2025

Diffusion models have demonstrated impressive capabilities in synthesizing diverse content. However, despite their high-quality outputs, these models often perpetuate social biases, including those related to gender and race. These biases can potentially contribute to harmful …