Hoang-Phi Nguyen

Sharpness-Aware Teleportation on Riemannian Manifolds

2023 · arXiv (Cornell University)

Recent studies highlight the effectiveness of flat minima in enhancing generalization, with sharpness-aware minimization (SAM) achieving state-of-the-art performance. Additionally, insights into the intrinsic geometry of the loss landscape have shown promise for improving model generalization. …