Takumi Kobayashi

Extractive Knowledge Distillation

2022 · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)

Knowledge distillation (KD) transfers knowledge of a teacher model to improve performance of a student model which is usually equipped with lower capacity. In the KD framework, however, it is unclear what kind of knowledge …