Hansen Lillemark

Simple and Effective Input Reformulations for Translation

2023 · arXiv (Cornell University)

Foundation language models learn from their finetuning input context in different ways. In this paper, we reformulate inputs during finetuning for challenging translation tasks, leveraging model strengths from pretraining in novel ways to improve downstream …