Matthew Broerman

Are LLM Belief Updates Consistent with Bayes' Theorem?

2025 · arXiv (Cornell University)

Do larger and more capable language models learn to update their "beliefs" about propositions more consistently with Bayes' theorem when presented with evidence in-context? To test this, we formulate a Bayesian Coherence Coefficient (BCC) metric …