Shiven Sinha

Random Representations Outperform Online Continually Learned Representations

2024 · arXiv (Cornell University)

Continual learning has primarily focused on the issue of catastrophic forgetting and the associated stability-plasticity tradeoffs. However, little attention has been paid to the efficacy of continually learned representations, as representations are learned alongside classifiers …