Terufumi Morishita

Adapting Chat Language Models Using Only Target Unlabeled Language Data

2024 · arXiv (Cornell University)

Vocabulary expansion (VE) is the de-facto approach to language adaptation of large language models (LLMs) by adding new tokens and continuing pre-training on target data. While this is effective for base models trained on unlabeled …