Wenyang Luo

Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models

2024 · arXiv (Cornell University)

Large language models (LLMs) demonstrate remarkable multilingual capabilities without being pre-trained on specially curated multilingual parallel corpora. It remains a challenging problem to explain the underlying mechanisms by which LLMs process multilingual texts. In this …