WriteSAE introduces sparse autoencoders with rank-1 matrix atoms for recurrent state updates, allowing replacement tests that outperform deletion on 92.4% of positions and a formula predicting logit changes with R²=0.98.
arXiv preprint arXiv:2406.17759 , year=
4 Pith papers cite this work. Polarity classification is still indexing.
citation-role summary
citation-polarity summary
years
2026 4verdicts
UNVERDICTED 4representative citing papers
Training-free mechanistic interpretability locates lexical-encoding attention heads in ViT and shows that targeted interventions on them improve robustness to typographic attacks in CLIP and downstream LVLMs.
An open-source tool is developed for mechanistic interpretability of AI weather models, demonstrated on GraphCast by identifying latent directions corresponding to interpretable weather features.
Causality resolves trade-offs in trustworthy AI by treating them as invariance conflicts under different data-generating process changes.
citing papers explorer
-
WriteSAE: Sparse Autoencoders for Recurrent State
WriteSAE introduces sparse autoencoders with rank-1 matrix atoms for recurrent state updates, allowing replacement tests that outperform deletion on 92.4% of positions and a formula predicting logit changes with R²=0.98.
-
Towards Robustness against Typographic Attack with Training-free Concept Localization
Training-free mechanistic interpretability locates lexical-encoding attention heads in ViT and shows that targeted interventions on them improve robustness to typographic attacks in CLIP and downstream LVLMs.
-
Mechanistic Interpretability Tool for AI Weather Models
An open-source tool is developed for mechanistic interpretability of AI weather models, demonstrated on GraphCast by identifying latent directions corresponding to interpretable weather features.
-
Trustworthy AI Suffers from Invariance Conflicts and Causality is The Solution
Causality resolves trade-offs in trustworthy AI by treating them as invariance conflicts under different data-generating process changes.