Patrick Kahardipraja

Towards Incremental Transformers: An Empirical Analysis of Transformer Models for Incremental NLU

2021 · arXiv (Cornell University)

Incremental processing allows interactive systems to respond based on partial inputs, which is a desirable property e.g. in dialogue agents. The currently popular Transformer architecture inherently processes sequences as a whole, abstracting away the notion …