Rodrigo Tufiño

Sequence-to-Sequence Spanish Pre-trained Language Models

2023 · arXiv (Cornell University)

In recent years, significant advancements in pre-trained language models have driven the creation of numerous non-English language variants, with a particular emphasis on encoder-only and decoder-only architectures. While Spanish language models based on BERT and …