Shihang Wang

More Than Catastrophic Forgetting: Integrating General Capabilities For Domain-Specific LLMs

2024 · arXiv (Cornell University)

The performance on general tasks decreases after Large Language Models (LLMs) are fine-tuned on domain-specific tasks, the phenomenon is known as Catastrophic Forgetting (CF). However, this paper presents a further challenge for real application of …