Dropout is a special case of the stochastic delta rule: faster and more accurate deep learning

2 code implementations • 10 Aug 2018 • Noah Frazier-Logue, Stephen José Hanson

SDR redefines each weight in the network as a random variable with mean $\mu_{w_{ij}}$ and standard deviation $\sigma_{w_{ij}}$.