Bruno Loureiro

Learning curves of generic features maps for realistic datasets with a teacher-student model

2021 · Infoscience (Ecole Polytechnique Fédérale de Lausanne)

Teacher-student models provide a framework in which the typical-case performance of high-dimensional supervised learning can be described in closed form. The assumptions of Gaussian i.i.d. input data underlying the canonical teacher-student model may, however, be …

Fundamental computational limits of weak learnability in high-dimensional multi-index models

2024 · arXiv (Cornell University)

Multi-index models - functions which only depend on the covariates through a non-linear transformation of their projection on a subspace - are a useful benchmark for investigating feature learning with neural nets. This paper examines …