Jan Buys

The Curious Case of Neural Text Degeneration

2019 · arXiv (Cornell University)

Despite considerable advancements with deep neural language models, the enigma of neural text degeneration persists when these models are tested as text generators. The counter-intuitive empirical observation is that even though the use of likelihood …

The Curious Case of Neural Text Degeneration

2020 · arXiv (Cornell University)

Despite considerable advances in neural language modeling, it remains an open question what the best decoding strategy is for text generation from a language model (e.g. to generate a story). The counter-intuitive empirical observation is …