For normalized self-attention in the d ~ N limit, the overlap gap controls a manifold of clustered fixed points and a finite-sharpness dynamical attention-condensation transition.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cond-mat.dis-nn 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Clustered Attractor Manifolds and Dynamical Condensation in Self-Attention
For normalized self-attention in the d ~ N limit, the overlap gap controls a manifold of clustered fixed points and a finite-sharpness dynamical attention-condensation transition.