Luca Beurer-Kellner

Guiding LLMs The Right Way: Fast, Non-Invasive Constrained Generation

2024 · arXiv (Cornell University)

To ensure that text generated by large language models (LLMs) is in an expected format, constrained decoding proposes to enforce strict formal language constraints during generation. However, as we show in this work, not only …