Sebastian Lee

Maslow's Hammer for Catastrophic Forgetting: Node Re-Use vs Node Activation

2022 · arXiv (Cornell University)

Continual learning - learning new tasks in sequence while maintaining performance on old tasks - remains particularly challenging for artificial neural networks. Surprisingly, the amount of forgetting does not increase with the dissimilarity between the …