Bingcong Li

VASSO: Variance Suppression for Sharpness-Aware Minimization

2025 · arXiv (Cornell University)

Sharpness-aware minimization (SAM) has well-documented merits in enhancing generalization of deep neural network models. Accounting for sharpness in the loss function geometry, where neighborhoods of `flat minima' heighten generalization ability, SAM seeks `flat valleys' by …