A projection of LLM internal states, trained on some runs, predicts repetition on held-out runs and can be steered to change repetition; the headline entropy maximum is a reparameterization of an occupancy split.
States of LLM-generated Texts and Phase Transitions between them
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
It is known for some time that autocorrelations of words in human-written texts decay according to a power law. Recent works have also shown that the autocorrelations decay in texts generated by LLMs is qualitatively different from the literary texts. Solid state physics tie the autocorrelations decay laws to the states of matter. In this work, we empirically demonstrate that, depending on the temperature parameter, LLMs can generate text that can be classified as solid, critical state or gas.
citation-role summary
background 1
citation-polarity summary
fields
physics.soc-ph 1years
2026 1verdicts
REJECT 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
Temperature-driven inversion and nonlinear dynamics in ChatGPT-like AIs
A projection of LLM internal states, trained on some runs, predicts repetition on held-out runs and can be steered to change repetition; the headline entropy maximum is a reparameterization of an occupancy split.