Albert Webson · PaperMetrix

Are "Undocumented Workers" the Same as "Illegal Aliens"? Disentangling\n Denotation and Connotation in Vector Spaces

2020 · arXiv (Cornell University)

In politics, neologisms are frequently invented for partisan objectives. For\nexample, "undocumented workers" and "illegal aliens" refer to the same group of\npeople (i.e., they have the same denotation), but they carry clearly different\nconnotations. Examples like these …

Multitask Prompted Training Enables Zero-Shot Task Generalization

2021 · arXiv (Cornell University)

Large language models have recently been shown to attain reasonable zero-shot generalization on a diverse set of tasks (Brown et al., 2020). It has been hypothesized that this is a consequence of implicit multitask learning …

PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts

2022

Stephen Bach, Victor Sanh, Zheng Xin Yong, Albert Webson, Colin Raffel, Nihal V. Nayak, Abheesht Sharma, Taewoon Kim, M Saiful Bari, Thibault Fevry, Zaid Alyafeai, Manan Dey, Andrea Santilli, Zhiqing Sun, Srulik Ben-david, Canwen Xu, …

Scaling Instruction-Finetuned Language Models

2022 · arXiv (Cornell University)

Finetuning language models on a collection of datasets phrased as instructions has been shown to improve model performance and generalization to unseen tasks. In this paper we explore instruction finetuning with a particular focus on …

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

2022 · arXiv (Cornell University)

Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to widespread adoption, most LLMs are developed …

Crosslingual Generalization through Multitask Finetuning

2023