Korawat Tanwisuth

Switchable Decision: Dynamic Neural Generation Networks

2024 · arXiv (Cornell University)

Auto-regressive generation models achieve competitive performance across many different NLP tasks such as summarization, question answering, and classifications. However, they are also known for being slow in inference, which makes them challenging to deploy in …