Pith Number

pith:B2YZHRCQ

pith:2025:B2YZHRCQSY2HJ66OSADTDU5YWB

not attested not anchored not stored refs pending

Evaluating Large Language Models for Code Review

Arda \.I\c{c}\"oz, Eray T\"uz\"un, Umut Cihan, Vahid Haratian

arxiv:2505.20206 v1 · 2025-05-26 · cs.SE · cs.AI

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{B2YZHRCQSY2HJ66OSADTDU5YWB}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

4 papers in Pith

SmartPatchLinker: An Open-Source Tool to Linked Changes Detection for Code Review

Understanding the Limits of Automated Evaluation for Code Review Bots in Practice

On the Footprints of Reviewer Bots Feedback on Agentic Pull Requests in OSS GitHub Repositories

Agentic Repository Mining: A Multi-Task Evaluation

Receipt and verification

First computed	2026-07-05T11:09:54.269736Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

0eb193c450963474fbce900731d3b8b054582de5c533ece5c8f5aea5b404fbc5

Aliases

arxiv: 2505.20206 · arxiv_version: 2505.20206v1 · doi: 10.48550/arxiv.2505.20206 · pith_short_12: B2YZHRCQSY2H · pith_short_16: B2YZHRCQSY2HJ66O · pith_short_8: B2YZHRCQ

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/B2YZHRCQSY2HJ66OSADTDU5YWB \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 0eb193c450963474fbce900731d3b8b054582de5c533ece5c8f5aea5b404fbc5

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "e3868af159987cf5d0f06e1d2f3437beae84a0dc2fda3350b512f746af9dbbe9",
    "cross_cats_sorted": [
      "cs.AI"
    ],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.SE",
    "submitted_at": "2025-05-26T16:47:29Z",
    "title_canon_sha256": "8250ab44b33ecd593530c46c671fb2305a33a22b1491801e763d0231fee3875b"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2505.20206",
    "kind": "arxiv",
    "version": 1
  }
}