Robert Logan

Barack’s Wife Hillary: Using Knowledge Graphs for Fact-Aware Language Modeling

2019

Modeling human language requires the ability to not only generate fluent text but also encode factual knowledge. However, traditional language models are only capable of remembering facts seen at training time, and often have difficulty …

Knowledge Enhanced Contextual Word Representations

2019

Matthew E. Peters, Mark Neumann, Robert Logan, Roy Schwartz, Vidur Joshi, Sameer Singh, Noah A. Smith. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on …

Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language Models

2022 · Findings of the Association for Computational Linguistics: ACL 2022

Prompting language models (LMs) with training examples and task descriptions has been seen as critical to recent successes in few-shot learning. In this work, we show that finetuning LMs in the few-shot setting can considerably …