Simone Bombari

How Spurious Features Are Memorized: Precise Analysis for Random and NTK Features

2023 · arXiv (Cornell University)

Deep learning models are known to overfit and memorize spurious features in the training dataset. While numerous empirical studies have aimed at understanding this phenomenon, a rigorous theoretical framework to quantify it is still missing. …