no code implementations • 24 Mar 2021 • Lu Xia, Martijn Anthonissen, Michiel Hochstenbach, Barry Koren
Conventional stochastic rounding (CSR) is widely employed in the training of neural networks (NNs), showing promising training results even in low-precision computations.
no code implementations • 31 May 2020 • Lu Xia, Martijn Anthonissen, Michiel Hochstenbach, Barry Koren
When a sequence of computations is implemented, round-off errors may be magnified or accumulated.