Peyman Moghadam

Subspace distillation for continual learning

2023 · Neural Networks

An ultimate objective in continual learning is to preserve knowledge learned in preceding tasks while learning new tasks. To mitigate forgetting prior knowledge, we propose a novel knowledge distillation technique that takes into the account …