Shizhe Diao

Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data

2023

Chain-of-thought (CoT) advances the reasoning abilities of large language models (LLMs) and achieves superior performance in complex reasoning tasks. However, most CoT studies rely on carefully designed human-annotated rational chains to prompt LLMs, posing challenges …

ZEN: Pre-training Chinese Text Encoder Enhanced by N-gram Representations

2020

The pre-training of text encoders normally processes text as a sequence of tokens corresponding to small text units, such as word pieces in English and characters in Chinese. It omits information carried by larger text …