Gao, Luhui

LLaMA Beyond English: An Empirical Study on Language Capability Transfer

2024 · arXiv (Cornell University)

In recent times, substantial advancements have been witnessed in large language models (LLMs), exemplified by ChatGPT, showcasing remarkable proficiency across a range of complex tasks. However, many mainstream LLMs (e.g. LLaMA) are pretrained on English-dominant …