no code implementations • 8 Apr 2023 • Alberto Bordino, Stefano Favaro, Sandra Fortini
There is a growing interest on large-width asymptotic properties of Gaussian neural networks (NNs), namely NNs whose weights are initialized according to Gaussian distributions.
no code implementations • 8 Apr 2023 • Alberto Bordino, Stefano Favaro, Sandra Fortini
As a novelty with respect to previous works, our results rely on the use of a generalized central limit theorem for heavy tails distributions, which allows for an interesting unified treatment of infinitely wide limits for deep Stable NNs.