Paper Citation Record · LEDGER

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research?

As of 22 August 2026, this Paper Citation Record lists 34 of 34 outbound references and 9 inbound Pith citation observations for arXiv:2507.18901.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.18901 v1

Coverage vector

measured 34 of 34 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-15T18:10:56.026499Z

measured 43 of 43 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-21T06:32:19.484+00:00

measured 9 of 9 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-02T16:27:43.416081Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T16:49:57.799465Z

Reference resolution

34 of 34 outbound references displayed

verified exact4
verified fuzzy0
unresolved29
parse uncertain0
malformed identifier1
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation ea1e96b4-b09d-47eb-bc70-35f470147dba · outbound

This paper cites online" 'onlinestring :=.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? online" 'onlinestring :=

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-15T18:10:55.896075Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7382867f-e924-453a-bb83-5f86a0d6a5c8 · outbound

This paper cites write newline.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? write newline

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-15T18:10:55.900306Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 329bbf8b-982b-4d4e-bb0b-6fe19d02cf09 · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 3

Resolution: unresolved; raw_fallback, observed 2026-08-15T18:10:56.551158Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 09622878-fa37-4b66-a0c2-6efb07294fcc · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 4

Resolution: unresolved; raw_fallback, observed 2026-08-15T18:10:56.539614Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 3c176eb7-f037-4c78-90cc-270d8152f0ba · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 5

Resolution: unresolved; raw_fallback, observed 2026-08-15T18:10:56.528336Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 990bb376-68b6-41a1-b564-d24a35d74dd6 · outbound

This paper cites Glenn Begley and John P.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Glenn Begley and John P

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-15T18:10:55.917646Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ae069e25-aab8-40b9-862e-f524dfb404a6 · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 7

Resolution: unresolved; raw_fallback, observed 2026-08-15T18:10:56.517599Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 0807bf2c-c61a-4738-aa61-bda4dc4cef08 · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 8

Resolution: unresolved; raw_fallback, observed 2026-08-15T18:10:56.507100Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 0b093a61-004d-43ca-9a5a-8a40560babb4 · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 9

Resolution: unresolved; raw_fallback, observed 2026-08-15T18:10:56.497184Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 90a0b766-aacc-4dd4-b9ac-4c4a0a31fb5b · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 10

Resolution: verified exact; doi, observed 2026-08-15T18:10:56.133388Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 49567a4b-09b0-4361-9f3c-e22fe9367f99 · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 11

Resolution: verified exact; doi, observed 2026-08-15T18:10:56.120237Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 154f31ad-aed6-44f3-9465-695dd48d0bb0 · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-15T18:10:55.943005Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 887b3925-2e3c-4d52-8a49-436a573aa808 · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 13

Resolution: unresolved; raw_fallback, observed 2026-08-15T18:10:56.487185Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation dd3ef7a5-4dc2-4cda-bf5a-e14bf50b40cb · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 14

Resolution: unresolved; raw_fallback, observed 2026-08-15T18:10:56.476490Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 3cc830dc-80af-422d-b6b3-c658ee2b42f3 · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 15

Resolution: unresolved; raw_fallback, observed 2026-08-15T18:10:56.465218Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation d3c9dcbf-a5e7-45a1-a2b8-7cbb3af8cf5e · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 16

Resolution: unresolved; raw_fallback, observed 2026-08-15T18:10:56.454614Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation e391fca4-8da3-4ace-9927-ad7fb1bbca11 · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 17

Resolution: unresolved; raw_fallback, observed 2026-08-15T18:10:56.442387Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 7dd6569a-144a-44b8-b3e3-6048dba42760 · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-15T18:10:55.965813Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c442840a-b1ce-4273-9bf8-0f0f3a753fb2 · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-15T18:10:55.969734Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 10663238-9612-4b31-9f55-fea0ac8f0db7 · outbound

This paper cites SWE-bench: Can Language Models Resolve Real-World GitHub Issues?.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-15T18:10:55.973679Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bc001c11-126b-4898-aca0-2667bf700dec · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 21

Resolution: unresolved; raw_fallback, observed 2026-08-15T18:10:56.430714Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 379e8abc-fb94-4114-a0e9-a697c942c1e3 · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 22

Resolution: verified exact; doi, observed 2026-08-15T18:10:56.089758Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 0313dd62-30cf-401f-a980-4b8d9f13b89b · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 23

Resolution: malformed identifier; no resolver link, observed 2026-08-15T18:10:55.986903Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dc5d01ff-997b-4ea2-ab31-70c5860c1ef9 · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 24

Resolution: unresolved; raw_fallback, observed 2026-08-15T18:10:56.420320Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 8668d874-7816-481c-8956-aad538eabcf5 · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 25

Resolution: verified exact; doi, observed 2026-08-15T18:10:56.064682Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 9582edb0-e9ef-4d60-b747-ab79c60b2b34 · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 26

Resolution: unresolved; raw_fallback, observed 2026-08-15T18:10:56.408746Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation ae3915ed-5323-4174-91b0-18dfdfc96f72 · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 27

Resolution: unresolved; raw_fallback, observed 2026-08-15T18:10:56.397383Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 06e64ad3-cc31-4502-90e9-7d30a2443f9a · outbound

This paper cites CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmark.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmark

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-15T18:10:56.005274Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5d404566-06a8-48c0-b7e8-c3185122411c · outbound

This paper cites Spearman.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Spearman

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-15T18:10:56.008737Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 77d651f9-7a20-4fa4-a664-e9bc10df5a61 · outbound

This paper cites an unresolved cited work.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? Unresolved cited work

Reference 30

Resolution: unresolved; raw_fallback, observed 2026-08-15T18:10:56.384864Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation f7fda4a5-6ebc-4439-b332-40874dc00de7 · outbound

This paper cites A Survey of Reasoning with Foundation Models.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? A Survey of Reasoning with Foundation Models

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-15T18:10:56.015039Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5d5402ac-4155-4cc6-9f1b-2d8d42e53bf9 · outbound

This paper cites SciCode: A Research Coding Benchmark Curated by Scientists.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? SciCode: A Research Coding Benchmark Curated by Scientists

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-15T18:10:56.018724Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 115c39d6-9580-4c0e-8d1a-86941e173cf5 · outbound

This paper cites SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-15T18:10:56.022260Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 97859b99-de3e-4a91-8729-a434d5684adf · outbound

This paper cites WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents.

REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-15T18:10:56.026499Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation 5be141c4-ce6b-4144-8d01-f5f93e41ed19 · inbound

Automating Computational Reproducibility in Social Science: Comparing Prompt-Based and Agent-Based Approaches cites this paper.

Automating Computational Reproducibility in Social Science: Comparing Prompt-Based and Agent-Based Approaches REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research?

Reference 16

Resolution: verified exact; arxiv_id, observed 2026-05-16T05:57:24.427600Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation f2f5e657-c8bd-42f2-a65f-e77a9cf33998 · inbound

Evaluating LLM Agents on Automated Software Analysis Tasks cites this paper.

Evaluating LLM Agents on Automated Software Analysis Tasks REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research?

Reference 27

Resolution: verified exact; arxiv_id, observed 2026-05-11T08:26:01.463800Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 5559c47e-6989-46c1-ae14-2bb1fbbfa186 · inbound

Evaluating LLM Agents on Automated Software Analysis Tasks cites this paper.

Evaluating LLM Agents on Automated Software Analysis Tasks REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research?

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-02T16:27:43.416081Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 16baa584-cb83-4130-bdaf-d2f614ca7697 · inbound

How to Interpret Agent Behavior cites this paper.

How to Interpret Agent Behavior REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research?

Reference 17

Resolution: verified exact; arxiv_id, observed 2026-05-14T18:29:22.767619Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 642998c8-295b-4c14-9c13-5bdacf0b66e9 · inbound

An Agentic Approach Towards Replication Package Quality Evaluation cites this paper.

An Agentic Approach Towards Replication Package Quality Evaluation REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research?

Reference 2025

Resolution: unresolved; no resolver link, observed 2026-08-02T12:35:18.951851Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fd73d74d-319b-4d83-9cfa-2d2ea70e16ba · inbound

NatureBench: Can Coding Agents Match the Published SOTA of Nature-Family Papers? cites this paper.

NatureBench: Can Coding Agents Match the Published SOTA of Nature-Family Papers? REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research?

Reference 32

Resolution: verified exact; arxiv_id, observed 2026-07-04T16:49:57.801054Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 0bbd57d4-c287-433a-b654-be9e226f1263 · inbound

NatureBench: Can Coding Agents Match the Published SOTA of Nature-Family Papers? cites this paper.

NatureBench: Can Coding Agents Match the Published SOTA of Nature-Family Papers? REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research?

Reference 32

Resolution: unresolved; no resolver link, observed 2026-07-12T12:32:39.706055Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6e67bed1-bb1e-413d-8b8e-af075f73cef3 · inbound

Towards Autonomous and Auditable Medical Imaging Model Development cites this paper.

Towards Autonomous and Auditable Medical Imaging Model Development REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research?

Reference 18

Resolution: unresolved; no resolver link, observed 2026-07-14T11:05:51.130839Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ea61383b-0b24-4a1e-872e-0305c8279d56 · inbound

Towards Autonomous and Auditable Medical Imaging Model Development cites this paper.

Towards Autonomous and Auditable Medical Imaging Model Development REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research?

Reference 19

Resolution: unresolved; no resolver link, observed 2026-07-14T11:05:51.130839Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.