Vladimir Araujo

Entropy-based Stability-Plasticity for Lifelong Learning

2022 · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)

The ability to continuously learn remains elusive for deep learning models. Unlike humans, models cannot accumulate knowledge in their weights when learning new tasks, mainly due to an excess of plasticity and the low incentive …

Sequence-to-Sequence Spanish Pre-trained Language Models

2023 · arXiv (Cornell University)

In recent years, significant advancements in pre-trained language models have driven the creation of numerous non-English language variants, with a particular emphasis on encoder-only and decoder-only architectures. While Spanish language models based on BERT and …