Pith Number

pith:3IZOUWCO

pith:2026:3IZOUWCOH56UNY56EWZPMJU3YK

not attested not anchored not stored refs pending

Policy Improvement Reinforcement Learning

Deqing Wang, Haoyi Zhou, Huaiyang Wang, Jianxin Li, Xiaojie Li, Yaodong Yang, Yikun Ban, Zixuan Huang

Reinforcement learning for language models can be made self-correcting by directly maximizing cumulative verified policy improvement across iterations.

arxiv:2604.00860 v3 · 2026-04-01 · cs.LG

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{3IZOUWCOH56UNY56EWZPMJU3YK}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Claims

C1strongest claim

we prove this temporal objective is perfectly aligned with maximizing final task performance... PIPO performs ascent on the PIRL objective in expectation

C2weakest assumption

that retrospective verification against a sliding-window historical baseline can reliably identify genuine policy improvement without bias from window size, data distribution, or the specific choice of baseline statistics

C3one line summary

PIRL maximizes cumulative policy improvement across iterations instead of surrogate rewards and is proven aligned with final performance; PIPO implements it via retrospective verification for stable closed-loop optimization.

Receipt and verification

First computed	2026-06-04T01:08:49.541977Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

da32ea584e3f7d46e3be25b2f6269bc2b9b5a1e5d49c2155e2d81a4205ba76e0

Aliases

arxiv: 2604.00860 · arxiv_version: 2604.00860v3 · doi: 10.48550/arxiv.2604.00860 · pith_short_12: 3IZOUWCOH56U · pith_short_16: 3IZOUWCOH56UNY56 · pith_short_8: 3IZOUWCO

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/3IZOUWCOH56UNY56EWZPMJU3YK \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: da32ea584e3f7d46e3be25b2f6269bc2b9b5a1e5d49c2155e2d81a4205ba76e0

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "e194dd37954f066a527aa0552404fb06e8bff06f7413b85038d88a665ebf4ae0",
    "cross_cats_sorted": [],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.LG",
    "submitted_at": "2026-04-01T13:10:20Z",
    "title_canon_sha256": "a2cd9e386953538d7261dc287c6ed1c4837d2d55f57212d33b2075867aa6df06"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2604.00860",
    "kind": "arxiv",
    "version": 3
  }
}