Shigui Qiu

Token Drop mechanism for Neural Machine Translation

2020 · arXiv (Cornell University)

Neural machine translation with millions of parameters is vulnerable to unfamiliar inputs. We propose Token Drop to improve generalization and avoid overfitting for the NMT model. Similar to word dropout, whereas we replace dropped token …