Wyatt, Charlie

What am I missing here?: Evaluating Large Language Models for Masked Sentence Prediction

2025 · arXiv (Cornell University)

Transformer-based models primarily rely on Next Token Prediction (NTP), which predicts the next token in a sequence based on the preceding context. However, NTP's focus on single-token prediction often limits a model's ability to plan …