Pengxiao Lin

Complexity Control Facilitates Reasoning-Based Compositional Generalization in Transformers

2025 · arXiv (Cornell University)

Transformers have demonstrated impressive capabilities across various tasks, yet their performance on compositional problems remains a subject of debate. In this study, we investigate the internal mechanisms underlying Transformers' behavior in compositional tasks. We find …