Elman Mansimov

Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue System

2022 · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Pre-trained language models have been recently shown to benefit task-oriented dialogue (TOD) systems. Despite their success, existing methods often formulate this task as a cascaded generation problem which can lead to error accumulation across different …

Label Semantic Aware Pre-training for Few-shot Text Classification

2022 · arXiv (Cornell University)

In text classification tasks, useful information is encoded in the label names. Label semantic aware systems have leveraged this information for improved text classification performance during fine-tuning and prediction. However, use of label-semantics during pre-training …

A Generalized Framework of Sequence Generation with Application to Undirected Sequence Models

2019 · arXiv (Cornell University)

Undirected neural sequence models such as BERT (Devlin et al., 2019) have received renewed interest due to their success on discriminative natural language understanding tasks such as question-answering and natural language inference. The problem of …