Adaptive Search-and-Training for Robust and Efficient Network Pruning

1 code implementation • PAMI 2023 • Lu Xiaotong, Dong Weisheng, Li Xin, Wu Jinjian, Li Leida, Shi Guangming

Using pruning as a search strategy, we advocate three new insights for network engineering: 1) to formulate adaptive search as a cold start strategy to find a compact subnetwork on the coarse scale; and 2) to automatically learn the threshold for network pruning; 3) to offer flexibility to choose between efficiency and robustness .

Knowledge Distillation Network Pruning +1