1 code implementation • 6 Jul 2023 • Xu Han, Anmin Liu, Chenxuan Yao, Yanbo Fan, Kun He
In either case, the common gradient-based methods generally use the sign function to generate perturbations on the gradient update, that offers a roughly correct direction and has gained great success.