A proposed O(N)-model reformulation of Transformers yields fitted estimates of an internal dimension near 6 and a claimed capability-emergence threshold near 7B parameters, though both rest on fragile fits.
Deepseek-r1-lite-preview is now live: unleashing supercharged reasoning power!, Nov 2024
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2025 1verdicts
REJECT 1representative citing papers
citing papers explorer
-
Phase Transitions in Large Language Models and the $O(N)$ Model
A proposed O(N)-model reformulation of Transformers yields fitted estimates of an internal dimension near 6 and a claimed capability-emergence threshold near 7B parameters, though both rest on fragile fits.