Wei-Cheng Chang

Pre-training Tasks for Embedding-based Large-scale Retrieval

2020 · arXiv (Cornell University)

We consider the large-scale query-document retrieval problem: given a query (e.g., a question), return the set of relevant documents (e.g., paragraphs containing the answer) from a large document corpus. This problem is often solved in …

Taming Pretrained Transformers for Extreme Multi-label Text Classification

2020

We consider the extreme multi-label text classification (XMC) problem: given an input text, return the most relevant labels from a large label collection. For example, the input text could be a product description on Amazon.com …