Danielle Saunders

Domain adapted machine translation: What does catastrophic forgetting forget and why?

2024 · arXiv (Cornell University)

Neural Machine Translation (NMT) models can be specialized by domain adaptation, often involving fine-tuning on a dataset of interest. This process risks catastrophic forgetting: rapid loss of generic translation quality. Forgetting has been widely observed, …