Huaipeng Zhao

Distilling Knowledge for Search-based Structured Prediction

2018 · arXiv (Cornell University)

Many natural language processing tasks can be modeled into structured prediction and solved as a search problem. In this paper, we distill an ensemble of multiple models trained with different initialization into a single model. …