Sinong Wang

Learning Easily Updated General Purpose Text Representations with Adaptable Task-Specific Prefixes

2023 · arXiv (Cornell University)

Many real-world applications require making multiple predictions from the same text. Fine-tuning a large pre-trained language model for each downstream task causes computational burdens in the inference time due to several times of forward passes. …

Entailment as Few-Shot Learner

2021 · arXiv (Cornell University)

Large pre-trained language models (LMs) have demonstrated remarkable ability as few-shot learners. However, their success hinges largely on scaling model parameters to a degree that makes it challenging to train and serve. In this paper, …