Zhiheng Huang

Embedding-based Zero-shot Retrieval through Query Generation

2020 · arXiv (Cornell University)

Passage retrieval addresses the problem of locating relevant passages, usually from a large corpus, given a query. In practice, lexical term-matching algorithms like BM25 are popular choices for retrieval owing to their efficiency. However, term-based …

Self-attention Networks for Connectionist Temporal Classification in Speech Recognition

2019

The success of self-attention in NLP has led to recent applications in end-to-end encoder-decoder architectures for speech recognition. Separately, connectionist temporal classification (CTC) has matured as an alignment-free, non-autoregressive approach to sequence transduction, either by …