pith. sign in
Pith Number

pith:D444WDHE

pith:2023:D444WDHETMPC3CLJSJAS2VCY5I
not attested not anchored not stored refs pending

A Static Evaluation of Code Completion by Large Language Models

Baishakhi Ray, Bing Xiang, Dan Roth, Hantian Ding, Murali Krishna Ramanathan, Parminder Bhatia, Rob Kwiatkowski, Sudipta Sengupta, Varun Kumar, Xiaopeng Li, Yuchen Tian, Zijian Wang

arxiv:2306.03203 v1 · 2023-06-05 · cs.CL · cs.SE

Add to your LaTeX paper
\usepackage{pith}
\pithnumber{D444WDHETMPC3CLJSJAS2VCY5I}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp
2 Internet Archive
3 Author claim open · sign in to claim
4 Citations open
5 Replications open
Portable graph bundle live · download bundle · merged state
The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.
Receipt and verification
First computed 2026-07-05T06:17:54.953819Z
Builder pith-number-builder-2026-05-17-v1
Signature Pith Ed25519 (pith-v1-2026-05) · public key
Schema pith-number/v1.0

Canonical hash

1f39cb0ce49b1e2d896992412d5458ea1b2fc8bba0506d16b5a13ac99931f202

Aliases

arxiv: 2306.03203 · arxiv_version: 2306.03203v1 · doi: 10.48550/arxiv.2306.03203 · pith_short_12: D444WDHETMPC · pith_short_16: D444WDHETMPC3CLJ · pith_short_8: D444WDHE
Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/D444WDHETMPC3CLJSJAS2VCY5I \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 1f39cb0ce49b1e2d896992412d5458ea1b2fc8bba0506d16b5a13ac99931f202
Canonical record JSON
{
  "metadata": {
    "abstract_canon_sha256": "93bc79e52610b073cf9f2627becd420b6497317759b0998699319158aabbe95c",
    "cross_cats_sorted": [
      "cs.SE"
    ],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2023-06-05T19:23:34Z",
    "title_canon_sha256": "83d824eebc43d9b3d7a751786a98dd0440b925242f8e9cb04939e53f3f997f42"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2306.03203",
    "kind": "arxiv",
    "version": 1
  }
}