Xiaofei Ma

Learning Dialogue Representations from Consecutive Utterances

2022 · arXiv (Cornell University)

Learning high-quality dialogue representations is essential for solving a variety of dialogue-oriented tasks, especially considering that dialogue systems often suffer from data scarcity. In this paper, we introduce Dialogue Sentence Embedding (DSE), a self-supervised contrastive …

Efficient Shapley Values Estimation by Amortization for Text Classification

2023 · arXiv (Cornell University)

Despite the popularity of Shapley Values in explaining neural text classification models, computing them is prohibitive for large pretrained models due to a large number of model evaluations. In practice, Shapley Values are often estimated …

Multi-passage BERT: A Globally Normalized BERT Model for Open-domain Question Answering

2019

Zhiguo Wang, Patrick Ng, Xiaofei Ma, Ramesh Nallapati, Bing Xiang. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019.

Universal Text Representation from BERT: An Empirical Study

2019 · arXiv (Cornell University)

We present a systematic investigation of layer-wise BERT activations for general-purpose text representations to understand what linguistic information they capture and how transferable they are across different tasks. Sentence-level embeddings are evaluated against two state-of-the-art …