no code implementations • 15 Jun 2020 • V. Ros, G. Biroli, C. Cammarota
We select as initial condition for the dynamics one of the many unstable index-1 saddles in the vicinity of a reference local minimum.
Disordered Systems and Neural Networks Statistical Mechanics
1 code implementation • ICML 2018 • M. Baity-Jesi, L. Sagun, M. Geiger, S. Spigler, G. Ben Arous, C. Cammarota, Y. LeCun, M. Wyart, G. Biroli
We analyze numerically the training dynamics of deep neural networks (DNN) by using methods developed in statistical physics of glassy systems.