Julian Asilis

Resa: Transparent Reasoning Models via SAEs

2025 · arXiv (Cornell University)

How cost-effectively can we elicit strong reasoning in language models by leveraging their underlying representations? We answer this question with Resa, a family of 1.5B reasoning models trained via a novel and efficient sparse autoencoder …