no code implementations • 24 May 2024 • Leonardo Defilippis, Bruno Loureiro, Theodor Misiakiewicz
Our main contribution is a general deterministic equivalent for the test error of RFRR.
1 code implementation • 24 May 2024 • Emanuele Troiani, Yatin Dandi, Leonardo Defilippis, Lenka Zdeborová, Bruno Loureiro, Florent Krzakala
Multi-index models -- functions which only depend on the covariates through a non-linear transformation of their projection on a subspace -- are a useful benchmark for investigating feature learning with neural networks.
no code implementations • 28 Sep 2023 • Urte Adomaityte, Leonardo Defilippis, Bruno Loureiro, Gabriele Sicuro
In particular, we provide a sharp asymptotic characterisation of M-estimators trained on a family of elliptical covariate and noise data distributions including cases where second and higher moments do not exist.