Yitong Li

PanGu-Bot: Efficient Generative Dialogue Pre-training from Pre-trained Language Model

2022 · arXiv (Cornell University)

In this paper, we introduce PanGu-Bot, a Chinese pre-trained open-domain dialogue generation model based on a large pre-trained language model (PLM) PANGU-alpha (Zeng et al.,2021). Different from other pre-trained dialogue models trained over a massive …

Concise and Precise Context Compression for Tool-Using Language Models

2024

Yang Xu, Yunlong Feng, Honglin Mu, Yutai Hou, Yitong Li, Xinghao Wang, Wanjun Zhong, Zhongyang Li, Dandan Tu, Qingfu Zhu, Min Zhang, Wanxiang Che. Findings of the Association for Computational Linguistics: ACL 2024. 2024.