Mengge Xue

Enhancing Pre-trained Chinese Character Representation with Word-aligned Attention

2019 · arXiv (Cornell University)

Most Chinese pre-trained models take character as the basic unit and learn representation according to character's external contexts, ignoring the semantics expressed in the word, which is the smallest meaningful utterance in Chinese. Hence, we …

Enhancing Pre-trained Chinese Character Representation with Word-aligned Attention

2020

Most Chinese pre-trained models take character as the basic unit and learn representation according to character's external contexts, ignoring the semantics expressed in the word, which is the smallest meaningful utterance in Chinese. Hence, we …