Maxim Henry

Online Distillation with Continual Learning for Cyclic Domain Shifts

2023

In recent years, online distillation has emerged as a powerful technique for adapting real-time deep neural networks on the fly using a slow, but accurate teacher model. However, a major challenge in online distillation is …