Shuwen Tian

Self-Knowledge Distillation via Progressive Associative Learning

2024 · Electronics

As a specific form of knowledge distillation (KD), self-knowledge distillation enables a student network to progressively distill its own knowledge without relying on a pretrained, complex teacher network; however, recent studies of self-KD have discovered …