Go Inoue

The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Models

2021 · arXiv (Cornell University)

In this paper, we explore the effects of language variants, data sizes, and fine-tuning task types in Arabic pre-trained language models. To do so, we build three pre-trained language models across three variants of Arabic: …