A minimal embedding model shows representation collapse arises from frustrated samples through slow dynamics and is prevented by stop-gradient.
Define global means and deviations across classes: ¯u≡ 1 n nX i=1 ¯ui,¯v≡ 1 n nX i=1 vi,(B10) δui ≡¯ui −¯u, δv i ≡v i −¯v, nX i=1 δui = nX i=1 δvi = 0
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cond-mat.dis-nn 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
A Minimal Model of Representation Collapse: Frustration, Stop-Gradient, and Dynamics
A minimal embedding model shows representation collapse arises from frustrated samples through slow dynamics and is prevented by stop-gradient.