Weng Tam

P-Tuning: Prompt Tuning Can Be Comparable to Fine-tuning Across Scales and Tasks

2022

Prompt tuning, which only tunes continuous prompts with a frozen language model, substantially reduces per-task storage and memory usage at training. However, in the context of NLU, prior work reveals that prompt tuning does not …