Pith Number

pith:VHUKO2FR

pith:2024:VHUKO2FRS5VB3K24CAJBKZP2OU

not attested not anchored not stored refs pending

Black-box Uncertainty Quantification Method for LLM-as-a-Judge

Elizabeth M. Daly, James M. Johnson, Mart\'in Santill\'an Cooper, Michael Desmond, Nico Wagner, Qian Pan, Rahul Nair, Werner Geyer, Zahra Ashktorab

arxiv:2410.11594 v1 · 2024-10-15 · cs.LG · cs.AI

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{VHUKO2FRS5VB3K24CAJBKZP2OU}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

2 papers in Pith

Rating Roulette: Self-Inconsistency in LLM-As-A-Judge Frameworks

VLM Judges Can Rank but Cannot Score: Task-Dependent Uncertainty in Multimodal Evaluation

Receipt and verification

First computed	2026-07-05T09:20:56.287255Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

a9e8a768b1976a1dab5c10121565fa75185c4458a622a42b6e4e15498193aa13

Aliases

arxiv: 2410.11594 · arxiv_version: 2410.11594v1 · doi: 10.48550/arxiv.2410.11594 · pith_short_12: VHUKO2FRS5VB · pith_short_16: VHUKO2FRS5VB3K24 · pith_short_8: VHUKO2FR

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/VHUKO2FRS5VB3K24CAJBKZP2OU \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: a9e8a768b1976a1dab5c10121565fa75185c4458a622a42b6e4e15498193aa13

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "3318e6076144c1aaf1d09f84d252030750096378393fbeb0f9ee174ecad204cd",
    "cross_cats_sorted": [
      "cs.AI"
    ],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.LG",
    "submitted_at": "2024-10-15T13:29:22Z",
    "title_canon_sha256": "bf9483ce00da804308bbabb7f65f12491d51fc5b6ce18c33236d9b7759ebb29e"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2410.11594",
    "kind": "arxiv",
    "version": 1
  }
}