Gaëtan Caillaut

Scaling Laws of Decoder-Only Models on the Multilingual Machine Translation Task

2024 · arXiv (Cornell University)

Recent studies have showcased remarkable capabilities of decoder-only models in many NLP tasks, including translation. Yet, the machine translation field has been largely dominated by encoder-decoder models based on the Transformer architecture. As a consequence, …