Alex Warstadt

WhisBERT: Multimodal Text-Audio Language Modeling on 100M Words

2023 · arXiv (Cornell University)

Training on multiple modalities of input can augment the capabilities of a language model. Here, we ask whether such a training regime can improve the quality and efficiency of these systems as well. We focus …

Neural Network Acceptability Judgments

2019 · Transactions of the Association for Computational Linguistics

This paper investigates the ability of artificial neural networks to judge the grammatical acceptability of a sentence, with the goal of testing their linguistic competence. We introduce the Corpus of Linguistic Acceptability (CoLA), a set …