no code implementations • 11 Oct 2023 • Hannah Day, Yonatan Kahn, Daniel A. Roberts
Fully-connected deep neural networks with weights initialized from independent Gaussian distributions can be tuned to criticality, which prevents the exponential growth or decay of signals propagating through the network.
