Chris Wendler

Sketch-Guided Constrained Decoding for Boosting Blackbox Large Language Models without Logit Access

2024

Constrained decoding, a technique for enforcing constraints on language model outputs, offers a way to control text generation without retraining or architectural modifications.Its application is, however, typically restricted to models that give users access to …