Pith Number

pith:B4R6LZWI

pith:2025:B4R6LZWINJGNLOMI3NI33SPDFQ

not attested not anchored not stored refs pending

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas

Chenglei Si, Diyi Yang, Tatsunori Hashimoto

arxiv:2506.20803 v1 · 2025-06-25 · cs.CL · cs.AI · cs.CY · cs.HC · cs.LG

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{B4R6LZWINJGNLOMI3NI33SPDFQ}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

11 papers in Pith

Can AI Agents Synthesize Scientific Conclusions?

Measuring the Gap Between Human and LLM Research Ideas

SoundnessBench: Can Your AI Scientist Really Tell Good Research Ideas from Bad Ones?

Teaching Language Models to Forecast Research Success Through Comparative Idea Evaluation

AI for Auto-Research: Roadmap & User Guide

Receipt and verification

First computed	2026-07-05T11:27:34.304518Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

0f23e5e6c86a4cd5b988db51bdc9e32c18726e0aa789ce750ed52b0bc9d1a0c3

Aliases

arxiv: 2506.20803 · arxiv_version: 2506.20803v1 · doi: 10.48550/arxiv.2506.20803 · pith_short_12: B4R6LZWINJGN · pith_short_16: B4R6LZWINJGNLOMI · pith_short_8: B4R6LZWI

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/B4R6LZWINJGNLOMI3NI33SPDFQ \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 0f23e5e6c86a4cd5b988db51bdc9e32c18726e0aa789ce750ed52b0bc9d1a0c3

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "e05d2ac4e3bc6d0f2cb27f130f0f42386bd1399139cda891286e66d513be410b",
    "cross_cats_sorted": [
      "cs.AI",
      "cs.CY",
      "cs.HC",
      "cs.LG"
    ],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2025-06-25T19:47:23Z",
    "title_canon_sha256": "800fdf7346326e435780032bea20021688ab37726fb46e1b77331801b67e5108"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2506.20803",
    "kind": "arxiv",
    "version": 1
  }
}