Hugo Pitorro

LaTIM: Measuring Latent Token-to-Token Interactions in Mamba Models

2025 · arXiv (Cornell University)

State space models (SSMs), such as Mamba, have emerged as an efficient alternative to transformers for long-context sequence modeling. However, despite their growing adoption, SSMs lack the interpretability tools that have been crucial for understanding …