Pith Number

pith:ZVGSGVCI

pith:2024:ZVGSGVCIN6NYXA2OWOZXJYJHDX

not attested not anchored not stored refs pending

The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models

Bill Yuchen Lin, Chaeeun Kim, Dongkeun Yoon, Graham Neubig, Guijin Son, Haebin Shin, Hanseok Oh, Hyeonbin Hwang, Hyowon Cho, Hyungjoo Chae, Jamin Shin, Jinheon Baek, Jinkyung Jo, Ji Yong Cho, Joel Jang, Juyoung Suk, Kyungjae Lee, Minjoon Seo, Miyoung Ko, Moontae Lee, Namgyu Ho, Noah Lee, Sean Welleck, Se June Joo, Seonghyeon Ye, Seongyun Lee, Seungone Kim, Shayne Longpre, Sheikh Shafayat, Sue Hyun Park, Yejin Cho, Yoonjoo Lee

arxiv:2406.05761 v2 · 2024-06-09 · cs.CL

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{ZVGSGVCIN6NYXA2OWOZXJYJHDX}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

3 papers in Pith

CoEval: Ranking Language Models for Custom Tasks Without Labeled Data or Trustworthy Benchmarks

Detecting Unfaithful Chain-of-Thought via Circuit-Guided Internal-External Discrepancy

Evalet: Evaluating Large Language Models through Functional Fragmentation

Receipt and verification

First computed	2026-07-05T10:38:33.995845Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

cd4d2354486f9b8b834eb3b374e1271dd404a8c98ad6a6e70d4cfc5adc364686

Aliases

arxiv: 2406.05761 · arxiv_version: 2406.05761v2 · doi: 10.48550/arxiv.2406.05761 · pith_short_12: ZVGSGVCIN6NY · pith_short_16: ZVGSGVCIN6NYXA2O · pith_short_8: ZVGSGVCI

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/ZVGSGVCIN6NYXA2OWOZXJYJHDX \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: cd4d2354486f9b8b834eb3b374e1271dd404a8c98ad6a6e70d4cfc5adc364686

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "4906a09d6725b79b21d7307dfaa06b830229cac8b8af8b99b1722e101598437f",
    "cross_cats_sorted": [],
    "license": "http://creativecommons.org/licenses/by-nc-nd/4.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2024-06-09T12:30:30Z",
    "title_canon_sha256": "5bf2f5cf80d4abcdae595c65046311823276fc1a65313d7ba49bf3e960970b24"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2406.05761",
    "kind": "arxiv",
    "version": 2
  }
}