1 code implementation • ICLR 2021 • Myeongjang Pyeon, Jihwan Moon, Taeyoung Hahn, Gunhee Kim
Backward locking and update locking are well-known sources of inefficiency in backpropagation that prevent from concurrently updating layers.
Ranked #25 on Neural Architecture Search on ImageNet