Zhaofeng Wu

Modeling Context With Linear Attention for Scalable Document-Level Translation

2022

Document-level machine translation leverages inter-sentence dependencies to produce more coherent and consistent translations. However, these models, predominantly based on transformers, are difficult to scale to long documents as their attention layers have quadratic complexity in …