Leo Du

The Curious Case of Neural Text Degeneration

2020 · arXiv (Cornell University)

Despite considerable advances in neural language modeling, it remains an open question what the best decoding strategy is for text generation from a language model (e.g. to generate a story). The counter-intuitive empirical observation is …