Francesco Bertolotti

A Survey on Grokking

2026 · ACM Computing Surveys

The phenomenon of Grokking, first reported by Power et al. [ 73 ], has gained significant attention for its unusual characteristics. Grokking is defined by a delay in generalization, during which the training loss reaches …