Kevin Gimpel

Emergent Logical Structure in Vector Representations of Neural Readers.

2016 · arXiv (Cornell University)

Reading comprehension is a question answering task where the answer is to be found in a given passage about entities and events not mentioned in general knowledge sources. A significant number of neural architectures for …

PeTra: A Sparsely Supervised Memory Model for People Tracking

2020

We propose PeTra, a memory-augmented neural network designed to track entities in its memory slots. PeTra is trained using sparse annotation from the GAP pronoun resolution dataset and outperforms a prior memory model on the …

From Paraphrase Database to Compositional Paraphrase Model and Back

2015 · Transactions of the Association for Computational Linguistics

The Paraphrase Database (PPDB; Ganitkevitch et al., 2013) is an extensive semantic resource, consisting of a list of phrase pairs with (heuristic) confidence estimates. However, it is still unclear how it can best be used, …

Part-of-Speech Tagging for Twitter: Annotation, Features, and Experiments

2018 · Figshare

We address the problem of part-of-speech tagging for English data from the popular microblogging service Twitter. We develop a tagset, annotate data, develop features, and report tagging results nearing 90% accuracy. The data and tools …

Multi-Perspective Sentence Similarity Modeling with Convolutional Neural Networks

2015

Modeling sentence similarity is complicated by the ambiguity and variability of linguistic expression. To cope with these challenges, we propose a model for comparing sentences that uses a multiplicity of perspectives. We first model each …

Charagram: Embedding Words and Sentences via Character n-grams

2016

We present CHARAGRAM embeddings, a simple approach for learning character-based compositional models to embed textual sequences. A word or sentence is represented using a character n-gram count vector, followed by a single nonlinear transformation to …

Commonsense Knowledge Base Completion

2016

We enrich a curated resource of commonsense knowledge by formulating the problem as one of knowledge base completion (KBC). Most work in KBC focuses on knowledge bases like Freebase that relate entities drawn from a …

Adversarial Example Generation with Syntactically Controlled Paraphrase Networks

2018

Mohit Iyyer, John Wieting, Kevin Gimpel, Luke Zettlemoyer. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers). 2018.

Controllable Paraphrase Generation with a Syntactic Exemplar

2019

Prior work on controllable text generation usually assumes that the controlled attribute can take on one of a small set of values known a priori. In this work, we propose a novel task, where the …

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

2019 · arXiv (Cornell University)

Increasing model size when pretraining natural language representations often results in improved performance on downstream tasks. However, at some point further model increases become harder due to GPU/TPU memory limitations and longer training times. To …

Improved Part-of-Speech Tagging for Online Conversational Text with Word Clusters

2018 · Figshare

We consider the problem of part-of-speech tagging for informal, online conversational text. We systematically evaluate the use of large-scale unsupervised word clustering and new lexical features to improve tagging accuracy. With these features, our system …