Leonardo Defilippis

Fundamental computational limits of weak learnability in high-dimensional multi-index models

2024 · arXiv (Cornell University)

Multi-index models - functions which only depend on the covariates through a non-linear transformation of their projection on a subspace - are a useful benchmark for investigating feature learning with neural nets. This paper examines …