Eugene Belilovsky

Prototype-Sample Relation Distillation: Towards Replay-Free Continual Learning

2023 · arXiv (Cornell University)

In Continual learning (CL) balancing effective adaptation while combating catastrophic forgetting is a central challenge. Many of the recent best-performing methods utilize various forms of prior task data, e.g. a replay buffer, to tackle the …

New Insights on Reducing Abrupt Representation Change in Online Continual Learning

2022 · arXiv (Cornell University)

In the online continual learning paradigm, agents must learn from a changing distribution while respecting memory and compute constraints. Experience Replay (ER), where a small subset of past data is stored and replayed alongside new …