Pith Number

pith:654SBB7S

pith:2023:654SBB7SLKWPMSVJTE7QMKYBZD

not attested not anchored not stored refs pending

KoLA: Carefully Benchmarking World Knowledge of Large Language Models

Amy Xin, Bin Xu, Chunyang Li, Daniel Zhang-Li, Hailong Jin, Hanming Li, Hao Peng, Jianhui Chen, Jie Tang, Jifan Yu, Jinxin Liu, Ji Qi, Juanzi Li, Kaifeng Yun, Kaisheng Zeng, Lei Hou, Linlu Gong, Nianyi Lin, Ning Ding, Shangqing Tu, Shulin Cao, Weikai Li, Xiaohan Zhang, Xiaozhi Wang, Xin Lv, Yantao Liu, Yong Guan, Yuan Yao, Yu Gu, Yunjia Qi, Yushi Bai, Zheyuan Zhang, Zhili Wu, Zhiyuan Liu, Zijun Yao

arxiv:2306.09296 v3 · 2023-06-15 · cs.CL

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{654SBB7SLKWPMSVJTE7QMKYBZD}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

5 papers in Pith

Diagnosing LLM Arbitration Behavior over Pre-evidence Epistemic States in RAG-based Fact-Checking

LWGR: Lagrangian-Constrained Personalized World Knowledge for Generative Recommendation

Agent AI: Surveying the Horizons of Multimodal Interaction

WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generation

Trustworthy AI: Ensuring Reliability and Accountability from Models to Agents

Receipt and verification

First computed	2026-07-05T08:38:02.376798Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

f7792087f25aacf64aa9993f062b01c8fd3db0a2ecffcfa4c63ad674470e39c5

Aliases

arxiv: 2306.09296 · arxiv_version: 2306.09296v3 · doi: 10.48550/arxiv.2306.09296 · pith_short_12: 654SBB7SLKWP · pith_short_16: 654SBB7SLKWPMSVJ · pith_short_8: 654SBB7S

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/654SBB7SLKWPMSVJTE7QMKYBZD \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: f7792087f25aacf64aa9993f062b01c8fd3db0a2ecffcfa4c63ad674470e39c5

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "76ab1b7f3dbc30a038bb46b364698b2cd11d9dee48b1fd06843266371844eac7",
    "cross_cats_sorted": [],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2023-06-15T17:20:46Z",
    "title_canon_sha256": "8193e4b7b95963e4195edab98b71ebc73617a26f675fa65f0bc22c55ba086155"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2306.09296",
    "kind": "arxiv",
    "version": 3
  }
}