Faithful Knowledge Distillation

no code implementations • 7 Jun 2023 • Tom A. Lamb, Rudy Brunel, Krishnamurthy Dj Dvijotham, M. Pawan Kumar, Philip H. S. Torr, Francisco Eiras

To address these questions, we introduce a faithful imitation framework to discuss the relative calibration of confidences and provide empirical and certified methods to evaluate the relative calibration of a student w. r. t.

Adversarial Robustness Knowledge Distillation