Using a log-linear model and Jacobian analysis, the paper claims isotropy in LLM hidden embeddings stabilizes the softmax partition function and improves time-series forecasting, with illustrative experiments on five models and 22 datasets.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
REJECT 1representative citing papers
citing papers explorer
-
When can isotropy help adapt LLMs' next word prediction to numerical domains?
Using a log-linear model and Jacobian analysis, the paper claims isotropy in LLM hidden embeddings stabilizes the softmax partition function and improves time-series forecasting, with illustrative experiments on five models and 22 datasets.