Giovanni Puccetti

The Invalsi Benchmarks: measuring Linguistic and Mathematical understanding of Large Language Models in Italian

2024 · arXiv (Cornell University)

While Italian is a high-resource language, there are few Italian-native benchmarks to evaluate generative Large Language Models (LLMs) in this language. This work presents three new benchmarks: Invalsi MATE to evaluate models performance on mathematical …