Yizhe Zhu

Overparameterized random feature regression with nearly orthogonal data

2022 · arXiv (Cornell University)

We investigate the properties of random feature ridge regression (RFRR) given by a two-layer neural network with random Gaussian initialization. We study the non-asymptotic behaviors of the RFRR with nearly orthogonal deterministic unit-length input data …