Arslan Chaudhry

Efficient Lifelong Learning with A-GEM

2018 · arXiv (Cornell University)

In lifelong learning, the learner is presented with a sequence of tasks, incrementally building a data-driven prior which may be leveraged to speed up learning of a new task. In this work, we investigate the …

Continual Learning in Low-rank Orthogonal Subspaces

2020 · arXiv (Cornell University)

In continual learning (CL), a learner is faced with a sequence of tasks, arriving one after the other, and the goal is to remember all the tasks once the continual learning experience is finished. The …

Wide Neural Networks Forget Less Catastrophically

2021 · arXiv (Cornell University)

A primary focus area in continual learning research is alleviating the "catastrophic forgetting" problem in neural networks by designing new algorithms that are more robust to the distribution shifts. While the recent progress in continual …

Architecture Matters in Continual Learning

2022 · arXiv (Cornell University)

A large body of research in continual learning is devoted to overcoming the catastrophic forgetting of neural networks by designing new algorithms that are robust to the distribution shifts. However, the majority of these works …