Pith. sign in
Pith Number

pith:E4DDR5BT

pith:2023:E4DDR5BT25EIN4D66KN57BK5T3
not attested not anchored not stored refs pending

CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation

Haitian Liu, Hari Sundaram, Li Zhu, Qian Chen, Shuiguang Deng, Tingyu Lin, Weishan Zhao, Weixiang Yan, Wen Wang, Yunkun Wang, Yunzhe Li

arxiv:2311.08588 v3 · 2023-11-14 · cs.CL · cs.AI · cs.SE

Add to your LaTeX paper
\usepackage{pith}
\pithnumber{E4DDR5BT25EIN4D66KN57BK5T3}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp
2 Internet Archive
3 Author claim open · sign in to claim
4 Citations open
5 Replications open
Portable graph bundle live · download bundle · merged state
The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

4 papers in Pith

Receipt and verification
First computed 2026-07-05T08:28:35.112895Z
Builder pith-number-builder-2026-05-17-v1
Signature Pith Ed25519 (pith-v1-2026-05) · public key
Schema pith-number/v1.0

Canonical hash

270638f433d74886f07ef29bdf855d9ec95cd94dfe3f96148cffcc44fb1916b5

Aliases

arxiv: 2311.08588 · arxiv_version: 2311.08588v3 · doi: 10.48550/arxiv.2311.08588 · pith_short_12: E4DDR5BT25EI · pith_short_16: E4DDR5BT25EIN4D6 · pith_short_8: E4DDR5BT
Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/E4DDR5BT25EIN4D66KN57BK5T3 \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 270638f433d74886f07ef29bdf855d9ec95cd94dfe3f96148cffcc44fb1916b5
Canonical record JSON
{
  "metadata": {
    "abstract_canon_sha256": "48d507cdf30547e847c931692f03c8e7b370452f1186de4688f1475d42bd0ef7",
    "cross_cats_sorted": [
      "cs.AI",
      "cs.SE"
    ],
    "license": "http://creativecommons.org/licenses/by-sa/4.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2023-11-14T23:18:52Z",
    "title_canon_sha256": "fc6a5427b8f88402a33b25dd1f35dc54b3adb3b187dea434bc14dcec5aa76b1b"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2311.08588",
    "kind": "arxiv",
    "version": 3
  }
}