Pith Number

pith:AA4FMG4R

pith:2024:AA4FMG4RXCJ6YXBTZK7OVR4LFU

not attested not anchored not stored refs pending

Evaluating LLMs at Detecting Errors in LLM Responses

Arman Cohan, Jihyun Janice Ahn, Nan Zhang, Ranran Haoran Zhang, Renze Lou, Rui Zhang, Ryo Kamoi, Salika Dave, Sarkar Snigdha Sarathi Das, Shaobo Qin, Sujeeth Reddy Vummanthala, Wenpeng Yin, Xiaoxin Lu, Yilun Zhao, Yusen Zhang

arxiv:2404.03602 v2 · 2024-04-04 · cs.CL

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{AA4FMG4RXCJ6YXBTZK7OVR4LFU}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

2 papers in Pith

Catching One in Five: LLM-as-Judge Blind Spots in Production Multi-Turn Transaction Agents

From Cool Demos to Production-Ready FMware: Core Challenges and a Technology Roadmap

Receipt and verification

First computed	2026-07-05T08:49:32.640838Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

0038561b91b893ec5c33cabeeac78b2d081b0fccd0800e4f4894a6bc40e22e1a

Aliases

arxiv: 2404.03602 · arxiv_version: 2404.03602v2 · doi: 10.48550/arxiv.2404.03602 · pith_short_12: AA4FMG4RXCJ6 · pith_short_16: AA4FMG4RXCJ6YXBT · pith_short_8: AA4FMG4R

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/AA4FMG4RXCJ6YXBTZK7OVR4LFU \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 0038561b91b893ec5c33cabeeac78b2d081b0fccd0800e4f4894a6bc40e22e1a

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "a56c3ca30096ab2b619642fe128779b74fe8309f6a3d96c6f6c78066799c925e",
    "cross_cats_sorted": [],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2024-04-04T17:19:47Z",
    "title_canon_sha256": "8457f26997419f545c95a8664ea98543a123ce6337159ec4b1a249d3a93406a4"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2404.03602",
    "kind": "arxiv",
    "version": 2
  }
}