The reviewed record of science sign in
Pith
Pith Number

pith:DRT7NPV7

pith:2024:DRT7NPV73HASLB4SNEMPCUG36Q
not attested not anchored not stored refs pending

DevEval: Evaluating Code Generation in Practical Software Projects

Bin Gu, Ge Li, Hao Zhu, Huanyu Liu, Jia Li, Jiazheng Ding, Kaibo Liu, Lanshen Wang, Lecheng Wang, Mengfei Yang, Xuanming Zhang, Yihong Dong, Yongmin Li, Yunfei Zhao, Yuqi Zhu, Zheng Fang, Zhi Jin

arxiv:2401.06401 v4 · 2024-01-12 · cs.SE · cs.AI · cs.CL

Add to your LaTeX paper
\usepackage{pith}
\pithnumber{DRT7NPV73HASLB4SNEMPCUG36Q}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp
2 Internet Archive
3 Author claim open · sign in to claim
4 Citations open
5 Replications open
Portable graph bundle live · download bundle · merged state
The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

3 papers in Pith

Receipt and verification
First computed 2026-07-05T07:52:43.917669Z
Builder pith-number-builder-2026-05-17-v1
Signature Pith Ed25519 (pith-v1-2026-05) · public key
Schema pith-number/v1.0

Canonical hash

1c67f6bebfd9c12587926918f150dbf412bb2027f22c24fcb7e8bc93ef3fda75

Aliases

arxiv: 2401.06401 · arxiv_version: 2401.06401v4 · doi: 10.48550/arxiv.2401.06401 · pith_short_12: DRT7NPV73HAS · pith_short_16: DRT7NPV73HASLB4S · pith_short_8: DRT7NPV7
Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/DRT7NPV73HASLB4SNEMPCUG36Q \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 1c67f6bebfd9c12587926918f150dbf412bb2027f22c24fcb7e8bc93ef3fda75
Canonical record JSON
{
  "metadata": {
    "abstract_canon_sha256": "81bcd0c70bb6690643238c4e4adf41f425239bea260304291883a51ead233b79",
    "cross_cats_sorted": [
      "cs.AI",
      "cs.CL"
    ],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.SE",
    "submitted_at": "2024-01-12T06:51:30Z",
    "title_canon_sha256": "a87f7baea1a8e34d36ebe485409de7d829d6b7f951505d9b0fb312f9f2b40cc0"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2401.06401",
    "kind": "arxiv",
    "version": 4
  }
}