Zujie Liang

Hierarchical Prompt Tuning for Few-Shot Multi-Task Learning

2023

Prompt tuning has enhanced the performance of Pre-trained Language Models for multi-task learning in few-shot scenarios. However, existing studies fail to consider that the prompts among different layers in Transformer are different due to the …

SEGMENT+: Long Text Processing with Short-Context Language Models

2024 · arXiv (Cornell University)

There is a growing interest in expanding the input capacity of language models (LMs) across various domains. However, simply increasing the context window does not guarantee robust performance across diverse long-input processing tasks, such as …