Wenbiao Ding

Long Text Generation by Modeling Sentence-Level and Discourse-Level Coherence

2021 · arXiv (Cornell University)

Generating long and coherent text is an important but challenging task, particularly for open-ended language generation tasks such as story generation. Despite the success in modeling intra-sentence coherence, existing generation models (e.g., BART) still struggle …

CTAL: Pre-training Cross-modal Transformer for Audio-and-Language Representations

2021 · arXiv (Cornell University)

Existing audio-language task-specific predictive approaches focus on building complicated late-fusion mechanisms. However, these models are facing challenges of overfitting with limited labels and low model generalization abilities. In this paper, we present a Cross-modal Transformer …