Anton Alexandrov

Mitigating Catastrophic Forgetting in Language Transfer via Model Merging

2024 · arXiv (Cornell University)

As open-weight large language models (LLMs) achieve ever more impressive performances across a wide range of tasks in English, practitioners aim to adapt these models to different languages. However, such language adaptation is often accompanied …