no code implementations • 17 Aug 2023 • Marcus Rüb, Daniel Maier, Daniel Mueller-Gritschneder, Axel Sikora
On average, TinyProp is 2. 9 times faster than existing, static sparse backpropagation algorithms and the accuracy loss is reduced on average by 6 % compared to a typical static setting of the back-propagation ratio.