Lucius Bynum

Language Models as Causal Effect Generators

2024 · arXiv (Cornell University)

In this work, we present sequence-driven structural causal models (SD-SCMs), a framework for specifying causal models with user-defined structure and language-model-defined mechanisms. We characterize how an SD-SCM enables sampling from observational, interventional, and counterfactual distributions …