Tanja Bunk

DIET: Lightweight Language Understanding for Dialogue Systems

2020 · arXiv (Cornell University)

Large-scale pre-trained language models have shown impressive results on language understanding benchmarks like GLUE and SuperGLUE, improving considerably over other pre-training methods like distributed representations (GloVe) and purely supervised approaches. We introduce the Dual Intent …