Alicia Parrish

BLiMP: The Benchmark of Linguistic Minimal Pairs for English (Electronic Resources)

2020 · Faculty Digital Archive (New York University Florence)

We introduce The Benchmark of Linguistic Minimal Pairs (BLiMP),1 a challenge set for evaluating the linguistic knowledge of language models (LMs) on major grammatical phenomena in English. BLiMP consists of 67 individual datasets, each containing …