Haoqin Tu

AdaVAE: Exploring Adaptive GPT-2s in Variational Auto-Encoders for Language Modeling

2022 · arXiv (Cornell University)

Variational Auto-Encoder (VAE) has become the de-facto learning paradigm in achieving representation learning and generation for natural language at the same time. Nevertheless, existing VAE-based language models either employ elementary RNNs, which is not powerful …