Hsiao-Wuen Hon

Unified Language Model Pre-training for Natural Language Understanding and Generation

2019 · arXiv (Cornell University)

This paper presents a new Unified pre-trained Language Model (UniLM) that can be fine-tuned for both natural language understanding and generation tasks. The model is pre-trained using three types of language modeling tasks: unidirectional, bidirectional, …