Jingqing Zhang

PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization

2019 · arXiv (Cornell University)

Recent work pre-training Transformers with self-supervised objectives on large text corpora has shown great success when fine-tuned on downstream NLP tasks including text summarization. However, pre-training objectives tailored for abstractive text summarization have not been …

PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization

2020 · International Conference on Machine Learning

Recent work pre-training Transformers with self-supervised objectives on large text corpora has shown great success when fine-tuned on downstream NLP tasks including text summarization. However, pre-training objectives tailored for abstractive text summarization have not been …