Xubo Qin

An Empirical Study of Uniform-Architecture Knowledge Distillation in Document Ranking

2023 · arXiv (Cornell University)

Although BERT-based ranking models have been commonly used in commercial search engines, they are usually time-consuming for online ranking tasks. Knowledge distillation, which aims at learning a smaller model with comparable performance to a larger …