Pith Number

pith:ERZNNMCP

pith:2023:ERZNNMCP2EQJSOSDFOXBNGGHPH

not attested not anchored not stored refs pending

Exploring the Robustness of Large Language Models for Solving Programming Problems

Atsushi Shirafuji, Jun Suzuki, Makoto Morishita, Takumi Ito, Yuki Nakamura, Yusuke Oda, Yutaka Watanobe

arxiv:2306.14583 v1 · 2023-06-26 · cs.CL · cs.AI · cs.SE

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{ERZNNMCP2EQJSOSDFOXBNGGHPH}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

2 papers in Pith

Qiskit Code Migration with LLMs

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis

Receipt and verification

First computed	2026-07-05T06:24:38.116993Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

2472d6b04fd120993a432bae1698c779d5bbd88cb00322cad09583d25498b791

Aliases

arxiv: 2306.14583 · arxiv_version: 2306.14583v1 · doi: 10.48550/arxiv.2306.14583 · pith_short_12: ERZNNMCP2EQJ · pith_short_16: ERZNNMCP2EQJSOSD · pith_short_8: ERZNNMCP

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/ERZNNMCP2EQJSOSDFOXBNGGHPH \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 2472d6b04fd120993a432bae1698c779d5bbd88cb00322cad09583d25498b791

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "22e265d326ba387a44975e48de68bcbafd5cb319d9b056b82bddc90e2543e541",
    "cross_cats_sorted": [
      "cs.AI",
      "cs.SE"
    ],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2023-06-26T10:48:50Z",
    "title_canon_sha256": "b96bfddc8b6cd1d92c6194d0c41d9d65c80585ab73d0802e1b39857c2ea33424"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2306.14583",
    "kind": "arxiv",
    "version": 1
  }
}