A proposed O(N)-model reformulation of Transformers yields fitted estimates of an internal dimension near 6 and a claimed capability-emergence threshold near 7B parameters, though both rest on fragile fits.
Percolation in neural networks
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2025 1verdicts
REJECT 1representative citing papers
citing papers explorer
-
Phase Transitions in Large Language Models and the $O(N)$ Model
A proposed O(N)-model reformulation of Transformers yields fitted estimates of an internal dimension near 6 and a claimed capability-emergence threshold near 7B parameters, though both rest on fragile fits.