Pith Number

pith:NY5J3X2R

pith:2023:NY5J3X2RVZHD5I6JMBDM5MN3NX

not attested not anchored not stored refs pending

A Survey of Temporal Credit Assignment in Deep Reinforcement Learning

Eduardo Pignatelli, Hado van Hasselt, Johan Ferret, Laura Toni, Matthieu Geist, Olivier Pietquin, Thomas Mesnard

arxiv:2312.01072 v2 · 2023-12-02 · cs.LG · cs.AI

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{NY5J3X2RVZHD5I6JMBDM5MN3NX}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

10 papers in Pith

World Value Models for Robotic Manipulation

Modularized Reinforcement Learning on LLMs: From MDP Creation to Exploration and Learning

When Denser Credit Is Not Enough: Evidence-Calibrated Policy Optimization for Long-Horizon LLM Agent Training

GRAIL: Gradient-Reweighted Advantages for Reinforcement Learning with Verifiable Rewards

SIRI: Self-Internalizing Reinforcement Learning with Intrinsic Skills for LLM Agent Training

Receipt and verification

First computed	2026-07-05T08:40:10.870521Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

6e3a9ddf51ae4e3ea3c96046ceb1bb6df27d775a9ddb37d907fbf5d2bb2bd9f3

Aliases

arxiv: 2312.01072 · arxiv_version: 2312.01072v2 · doi: 10.48550/arxiv.2312.01072 · pith_short_12: NY5J3X2RVZHD · pith_short_16: NY5J3X2RVZHD5I6J · pith_short_8: NY5J3X2R

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/NY5J3X2RVZHD5I6JMBDM5MN3NX \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 6e3a9ddf51ae4e3ea3c96046ceb1bb6df27d775a9ddb37d907fbf5d2bb2bd9f3

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "bb95c5618e6c02c9df629fbea2dbb643eba40dafd066f893b4a51ce717810865",
    "cross_cats_sorted": [
      "cs.AI"
    ],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.LG",
    "submitted_at": "2023-12-02T08:49:51Z",
    "title_canon_sha256": "3d34a020c04419a76a42a1f3f1dc47c6a4712b7ef003e2bf6e51f98a70b6f996"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2312.01072",
    "kind": "arxiv",
    "version": 2
  }
}