Pith Number

pith:W67GST2Z

pith:2025:W67GST2ZNKQZ3MTAQCT6K7YAOH

not attested not anchored not stored refs pending

Reward Shaping to Mitigate Reward Hacking in RLHF

Chengyuan Yao, Heng Wang, Jiayi Fu, Qi Han, Xuandong Zhao, Yanghua Xiao

arxiv:2502.18770 v6 · 2025-02-26 · cs.LG · cs.AI · cs.CL

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{W67GST2ZNKQZ3MTAQCT6K7YAOH}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

20 papers in Pith

OPERA: Aligning Open-Ended Reasoning via Objective Perplexity-based Reinforcement Learning

Uncertainty-Aware Reward Modeling for Stable RLHF

Representation-Aware Advantage Estimation: Your Reward Model Provides More Than A Scalar Output

Attention Amnesia in Hybrid LLMs: When CoT Fine-Tuning Breaks Long-Range Recall, and How to Fix It

From Trainee to Trainer: LLM-Designed Training Environment for RL with Multi-Agent Reasoning

Receipt and verification

First computed	2026-08-07T00:50:51.705601Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

b7be694f596aa19db26080a7e57f0071fd78eb526f89023c1d7e81a4f5a9fda8

Aliases

arxiv: 2502.18770 · arxiv_version: 2502.18770v6 · doi: 10.48550/arxiv.2502.18770 · pith_short_12: W67GST2ZNKQZ · pith_short_16: W67GST2ZNKQZ3MTA · pith_short_8: W67GST2Z

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/W67GST2ZNKQZ3MTAQCT6K7YAOH \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: b7be694f596aa19db26080a7e57f0071fd78eb526f89023c1d7e81a4f5a9fda8

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "ce461e7c445c3427ab55b16ceaaf18b50460ffe0062e3041f1cc8e7325f675b3",
    "cross_cats_sorted": [
      "cs.AI",
      "cs.CL"
    ],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.LG",
    "submitted_at": "2025-02-26T02:57:59Z",
    "title_canon_sha256": "15b3dec513e766d045e101841c86589e5f48ddfc14d9c0a1ce67e361334a0243"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2502.18770",
    "kind": "arxiv",
    "version": 6
  }
}