Pith Number

pith:RAJTRGZF

pith:2018:RAJTRGZF7NXD36QJPDMCDKHAOD

not attested not anchored not stored refs pending

Scalable agent alignment via reward modeling: a research direction

David Krueger, Jan Leike, Miljan Martic, Shane Legg, Tom Everitt, Vishal Maini

arxiv:1811.07871 v1 · 2018-11-19 · cs.LG · cs.AI · cs.NE · stat.ML

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{RAJTRGZF7NXD36QJPDMCDKHAOD}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

30 papers in Pith

Modeling AGI Safety Frameworks with Causal Influence Diagrams

Towards Empathic Deep Q-Learning

Requisite Variety in Ethical Utility Functions for AI Value Alignment

Universal and Transferable Adversarial Attacks on Aligned Language Models

Reinforcement Learning from Human Feedback

Receipt and verification

First computed	2026-05-18T00:00:23.246793Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

8813389b25fb6e3dfa0978d821a8e070ff09b23c11ea0cd2adf5ba406a352ec6

Aliases

arxiv: 1811.07871 · arxiv_version: 1811.07871v1 · doi: 10.48550/arxiv.1811.07871 · pith_short_12: RAJTRGZF7NXD · pith_short_16: RAJTRGZF7NXD36QJ · pith_short_8: RAJTRGZF

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/RAJTRGZF7NXD36QJPDMCDKHAOD \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 8813389b25fb6e3dfa0978d821a8e070ff09b23c11ea0cd2adf5ba406a352ec6

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "99e364a7b12594cea686a095c8b91340f1cdb3ba51f02d31a702967d9c98cb93",
    "cross_cats_sorted": [
      "cs.AI",
      "cs.NE",
      "stat.ML"
    ],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.LG",
    "submitted_at": "2018-11-19T18:48:04Z",
    "title_canon_sha256": "0e981f58147c8ecca45d1070525bd7b968b1695eb3fd0d49ccd5a4c6d5de8f7b"
  },
  "schema_version": "1.0",
  "source": {
    "id": "1811.07871",
    "kind": "arxiv",
    "version": 1
  }
}