pith:JBILANH5
Escaping Mode Collapse in LLM Generation via Geometric Regulation
Reinforced Mode Regulation uses low-rank damping in the value cache to prevent geometric collapse and sustain diverse LLM generation at entropy rates down to 0.8 nats per step.
arxiv:2605.00435 v2 · 2026-05-01 · cs.CL · cond-mat.dis-nn · cs.AI · nlin.CD
Add to your LaTeX paper
\usepackage{pith}
\pithnumber{JBILANH55GDATESG4NFMNVVH4Z}
Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge
Record completeness
Claims
RMR substantially reduces mode collapse and enables stable, high-quality generation at extremely low entropy rates (down to 0.8 nats/step), whereas standard decoding typically collapses near 2.0 nats/step.
That low-rank damping of dominant directions in the value cache directly counters geometric collapse in representation space without introducing new artifacts or quality loss, and that this intervention is sufficient across model scales and tasks.
Reinforced Mode Regulation (RMR) uses low-rank damping on the value cache to prevent geometric collapse and mode collapse in autoregressive LLM generation, supporting stable output down to 0.8 nats/step entropy.
Receipt and verification
| First computed | 2026-05-28T02:04:48.398722Z |
|---|---|
| Builder | pith-number-builder-2026-05-17-v1 |
| Signature | Pith Ed25519
(pith-v1-2026-05) · public key |
| Schema | pith-number/v1.0 |
Canonical hash
4850b034fde986099246e34ac6d6a7e64c961d35d29f0ac269864c56829f1299
Aliases
· · · · ·Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/JBILANH55GDATESG4NFMNVVH4Z \
| jq -c '.canonical_record' \
| python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 4850b034fde986099246e34ac6d6a7e64c961d35d29f0ac269864c56829f1299
Canonical record JSON
{
"metadata": {
"abstract_canon_sha256": "8bd2411a8632bd9034bbffdf416de4abef09be42b98fa1cdb0baa9a4f821f1ca",
"cross_cats_sorted": [
"cond-mat.dis-nn",
"cs.AI",
"nlin.CD"
],
"license": "http://creativecommons.org/licenses/by/4.0/",
"primary_cat": "cs.CL",
"submitted_at": "2026-05-01T06:12:05Z",
"title_canon_sha256": "79d4d23ee67ac94c33888fad6994faae624a2f901b8bbdfd89ac8e1f173d2a44"
},
"schema_version": "1.0",
"source": {
"id": "2605.00435",
"kind": "arxiv",
"version": 2
}
}