Ravi Kiran Selvam

Pre-training Text-to-Text Transformers for Concept-centric Common Sense

2021 · arXiv (Cornell University)

Pretrained language models (PTLM) have achieved impressive results in a range of natural language understanding (NLU) and generation (NLG) tasks that require a syntactic and semantic understanding of the text. However, current pre-training objectives such …