no code implementations • 13 Dec 2023 • Jihao Xin, Ivan Ilin, Shunkang Zhang, Marco Canini, Peter Richtárik
In distributed training, communication often emerges as a bottleneck.
no code implementations • 29 May 2023 • Jihao Xin, Marco Canini, Peter Richtárik, Samuel Horváth
To obtain theoretical guarantees, we generalize the notion of standard unbiased compression operators to incorporate Global-QSGD.