The authors derive conditions under which a higher plateau learning rate accelerates LLM training convergence via the Mpemba effect, but the central derivative formula is incorrect.
Precooling strategy allows exponentially faster heating
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
background 1
citation-polarity summary
fields
cs.AI 1years
2025 1verdicts
REJECT 1roles
background 1polarities
background 1representative citing papers
citing papers explorer
-
Mpemba Effect in Large-Language Model Training Dynamics: A Minimal Analysis of the Valley-River model
The authors derive conditions under which a higher plateau learning rate accelerates LLM training convergence via the Mpemba effect, but the central derivative formula is incorrect.