Xiangyu Duan

Token Drop mechanism for Neural Machine Translation

2020 · arXiv (Cornell University)

Neural machine translation with millions of parameters is vulnerable to unfamiliar inputs. We propose Token Drop to improve generalization and avoid overfitting for the NMT model. Similar to word dropout, whereas we replace dropped token …

Exploring and Improving Consistency in Large Language Models for Multiple-Choice Question Assessment

2024

With the evolution of Large Language Models (LLMs), accurately evaluating their capabilities has become a critical focus. The Multi-choice Questions (MCQ) benchmark is widely adopted for its definitive answers and straightforward assessment approach. However, recent …