Clément Dumas

Overcoming Sparsity Artifacts in Crosscoders to Interpret Chat-Tuning

2025

Model diffing is the study of how fine-tuning changes a model’s representations and internal algorithms. Many behaviors of interest are introduced during fine-tuning, and model diffing offers a promising lens to interpret such behaviors. Crosscoders …