Kevin B. Clark

Entity-Centric Coreference Resolution with Model Stacking

2015

Kevin Clark, Christopher D. Manning. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2015.

Semi-Supervised Sequence Modeling with Cross-View Training

2018

Unsupervised representation learning algorithms such as word2vec and ELMo improve the accuracy of many supervised NLP models, mainly because they can take advantage of large amounts of unlabeled text. However, the supervised models only learn …

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

2020 · arXiv (Cornell University)

Masked language modeling (MLM) pre-training methods such as BERT corrupt the input by replacing some tokens with [MASK] and then train a model to reconstruct the original tokens. While they produce good results when transferred …

Emergent linguistic structure in artificial neural networks trained by self-supervision

2020 · Proceedings of the National Academy of Sciences

This paper explores the knowledge of linguistic structure learned by large artificial neural networks, trained via self-supervision, whereby the model simply tries to predict a masked word in a given context. Human language communication is …