1 code implementation • CVPR 2023 • Shikang Yu, Jiachen Chen, Hu Han, Shuqiang Jiang
Therefore, we propose mSARC to assure the student network can imitate not only the logit output but also the spatial activation region of the teacher network in order to alleviate the influence of unwanted noises in diverse synthetic images on distillation learning.