Pith Number

pith:T3CPF6FM

pith:2024:T3CPF6FMDSCLLXOAY3EJM76TLK

not attested not anchored not stored refs pending

Online Iterative Reinforcement Learning from Human Feedback with General Preference Model

Chenlu Ye, HanZe Dong, Nan Jiang, Tong Zhang, Wei Xiong, Yuheng Zhang

arxiv:2402.07314 v3 · 2024-02-11 · cs.LG · stat.ML

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{T3CPF6FMDSCLLXOAY3EJM76TLK}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

4 papers in Pith

Online KL-Regularized Reinforcement Learning with Function Approximation under Misspecification

Imitate, Explore, and Self-Improve: A Reproduction Report on Slow-thinking Reasoning Systems

Near-Optimal Last-Iterate Convergence for Zero-Sum Games with Bandit Feedback and Opponent Actions

Fast Rates for Offline Contextual Bandits with Forward-KL Regularization under Single-Policy Concentrability

Receipt and verification

First computed	2026-07-05T09:34:11.422939Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

9ec4f2f8ac1c84b5ddc0c6c8967fd35ab83ba8042c2c814224a228acb1b01862

Aliases

arxiv: 2402.07314 · arxiv_version: 2402.07314v3 · doi: 10.48550/arxiv.2402.07314 · pith_short_12: T3CPF6FMDSCL · pith_short_16: T3CPF6FMDSCLLXOA · pith_short_8: T3CPF6FM

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/T3CPF6FMDSCLLXOAY3EJM76TLK \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 9ec4f2f8ac1c84b5ddc0c6c8967fd35ab83ba8042c2c814224a228acb1b01862

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "a0cf55c17006fac0f8939ca45261d7d5014dcccee3acd1f11273dfe336b6d5ff",
    "cross_cats_sorted": [
      "stat.ML"
    ],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.LG",
    "submitted_at": "2024-02-11T21:44:21Z",
    "title_canon_sha256": "6bc8a4e8b396505d047129dc2602cc5f31387418a2e15d2cf7ed85386fbd48e7"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2402.07314",
    "kind": "arxiv",
    "version": 3
  }
}