Pith Number

pith:UHXBMDQA

pith:2024:UHXBMDQASPG5XYGWXVOS6SX6RG

not attested not anchored not stored refs pending

Benchmark Data Contamination of Large Language Models: A Survey

Cheng Xu, Derek Greene, M-Tahar Kechadi, Shuhao Guan

arxiv:2406.04244 v1 · 2024-06-06 · cs.CL

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{UHXBMDQASPG5XYGWXVOS6SX6RG}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

25 papers in Pith

Guidelines for Empirical Studies in Software Engineering involving Large Language Models

A Study of LLMs' Preferences for Libraries and Programming Languages

The Illusion of Reasoning: Exposing Evasive Data Contamination in LLMs via Zero-CoT Truncation

Provable Joint Decontamination for Benchmarking Multiple Large Language Models

Fine-tuning vs. In-context Learning in Large Language Models: A Formal Language Learning Perspective

Receipt and verification

First computed	2026-05-22T23:03:43.311884Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

a1ee160e0093cddbe0d6bd5d2f4afe899f4f8a616859e8b6b59d1f38f69cac2f

Aliases

arxiv: 2406.04244 · arxiv_version: 2406.04244v1 · doi: 10.48550/arxiv.2406.04244 · pith_short_12: UHXBMDQASPG5 · pith_short_16: UHXBMDQASPG5XYGW · pith_short_8: UHXBMDQA

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/UHXBMDQASPG5XYGWXVOS6SX6RG \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: a1ee160e0093cddbe0d6bd5d2f4afe899f4f8a616859e8b6b59d1f38f69cac2f

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "bbd4335ebcbd8bfff3e05e631c12d0350c341ffbc1cef14a1b9a2650f73a44a5",
    "cross_cats_sorted": [],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2024-06-06T16:41:39Z",
    "title_canon_sha256": "d142bdb5ee38989c04bd7e0b7d4be8412f8d73f7813cb9772b1a7b3bc8be4eef"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2406.04244",
    "kind": "arxiv",
    "version": 1
  }
}