Danxiang Zhu

ERNIE: Enhanced Representation through Knowledge Integration

2019 · arXiv (Cornell University)

We present a novel language representation model enhanced by knowledge called ERNIE (Enhanced Representation through kNowledge IntEgration). Inspired by the masking strategy of BERT, ERNIE is designed to learn language representation enhanced by knowledge masking …