pith. sign in
Pith Number

pith:JBILANH5

pith:2026:JBILANH55GDATESG4NFMNVVH4Z
not attested not anchored not stored refs pending

Escaping Mode Collapse in LLM Generation via Geometric Regulation

Kumiko Tanaka-Ishii, Xin Du

Reinforced Mode Regulation uses low-rank damping in the value cache to prevent geometric collapse and sustain diverse LLM generation at entropy rates down to 0.8 nats per step.

arxiv:2605.00435 v2 · 2026-05-01 · cs.CL · cond-mat.dis-nn · cs.AI · nlin.CD

Add to your LaTeX paper
\usepackage{pith}
\pithnumber{JBILANH55GDATESG4NFMNVVH4Z}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp
2 Internet Archive
3 Author claim open · sign in to claim
4 Citations open
5 Replications open
Portable graph bundle live · download bundle · merged state
The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Claims

C1strongest claim

RMR substantially reduces mode collapse and enables stable, high-quality generation at extremely low entropy rates (down to 0.8 nats/step), whereas standard decoding typically collapses near 2.0 nats/step.

C2weakest assumption

That low-rank damping of dominant directions in the value cache directly counters geometric collapse in representation space without introducing new artifacts or quality loss, and that this intervention is sufficient across model scales and tasks.

C3one line summary

Reinforced Mode Regulation (RMR) uses low-rank damping on the value cache to prevent geometric collapse and mode collapse in autoregressive LLM generation, supporting stable output down to 0.8 nats/step entropy.

Receipt and verification
First computed 2026-05-28T02:04:48.398722Z
Builder pith-number-builder-2026-05-17-v1
Signature Pith Ed25519 (pith-v1-2026-05) · public key
Schema pith-number/v1.0

Canonical hash

4850b034fde986099246e34ac6d6a7e64c961d35d29f0ac269864c56829f1299

Aliases

arxiv: 2605.00435 · arxiv_version: 2605.00435v2 · doi: 10.48550/arxiv.2605.00435 · pith_short_12: JBILANH55GDA · pith_short_16: JBILANH55GDATESG · pith_short_8: JBILANH5
Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/JBILANH55GDATESG4NFMNVVH4Z \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 4850b034fde986099246e34ac6d6a7e64c961d35d29f0ac269864c56829f1299
Canonical record JSON
{
  "metadata": {
    "abstract_canon_sha256": "8bd2411a8632bd9034bbffdf416de4abef09be42b98fa1cdb0baa9a4f821f1ca",
    "cross_cats_sorted": [
      "cond-mat.dis-nn",
      "cs.AI",
      "nlin.CD"
    ],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2026-05-01T06:12:05Z",
    "title_canon_sha256": "79d4d23ee67ac94c33888fad6994faae624a2f901b8bbdfd89ac8e1f173d2a44"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2605.00435",
    "kind": "arxiv",
    "version": 2
  }
}