Lei Cheng

Can the Inference Logic of Large Language Models be Disentangled into Symbolic Concepts?

2023 · arXiv (Cornell University)

In this paper, we explain the inference logic of large language models (LLMs) as a set of symbolic concepts. Many recent studies have discovered that traditional DNNs usually encode sparse symbolic concepts. However, because an …