Xinyu Zhou

NeuralGrok: Accelerate Grokking by Neural Gradient Transformation

2025 · arXiv (Cornell University)

Grokking is proposed and widely studied as an intricate phenomenon in which generalization is achieved after a long-lasting period of overfitting. In this work, we propose NeuralGrok, a novel gradient-based approach that learns an optimal …