Sophie Rosset

mALBERT: Is a Compact Multilingual BERT Model Still Worth It?

2024 · arXiv (Cornell University)

Within the current trend of Pretained Language Models (PLM), emerge more and more criticisms about the ethical andecological impact of such models. In this article, considering these critical remarks, we propose to focus on smallermodels, …