Tal Linzen
8 papers in the PaperMetrix corpus
Papers by this author
-
Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models
2021
Matthew Finlayson, Aaron Mueller, Sebastian Gehrmann, Stuart Shieber, Tal Linzen, Yonatan Belinkov. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume …
-
Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies
2016 · Transactions of the Association for Computational Linguistics
The success of long short-term memory (LSTM) neural networks in language processing is typically attributed to their ability to capture long-distance statistical regularities. Linguistic regularities are often sensitive to syntactic structure; can such dependencies be …
-
Targeted Syntactic Evaluation of Language Models
2018
We present a dataset for evaluating the grammaticality of the predictions of a language model. We automatically construct a large number of minimally different pairs of English sentences, each consisting of a grammatical and an …
-
Analyzing and interpreting neural networks for NLP: A report on the first BlackboxNLP workshop
2019 · Natural Language Engineering
Abstract The Empirical Methods in Natural Language Processing (EMNLP) 2018 workshop BlackboxNLP was dedicated to resources and techniques specifically developed for analyzing and understanding the inner-workings and representations acquired by neural models of language. Approaches …
-
Probing What Different NLP Tasks Teach Machines about Function Word Comprehension
2019
Najoung Kim, Roma Patel, Adam Poliak, Patrick Xia, Alex Wang, Tom McCoy, Ian Tenney, Alexis Ross, Tal Linzen, Benjamin Van Durme, Samuel R. Bowman, Ellie Pavlick. Proceedings of the Eighth Joint Conference on Lexical and …
-
Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference
2019
A machine learning system can score well on a given test set by relying on heuristics that are effective for frequent example types but break down in more challenging cases. We study this issue within …
-
Quantity doesn’t buy quality syntax with neural language models
2019
Marten van Schijndel, Aaron Mueller, Tal Linzen. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019.
-
BERTs of a feather do not generalize together: Large variability in generalization across models with similar test set performance
2020
If the same neural network architecture is trained multiple times on the same dataset, will it make similar linguistic generalizations across runs? To study this question, we finetuned 100 instances of BERT on the Multigenre …