Pith. sign in

Paper Citation Record · LEDGER

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review

As of 6 August 2026, this Paper Citation Record lists 62 of 62 outbound references and 0 inbound Pith citation observations for arXiv:2605.02651.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2605.02651 v2

Coverage vector

measured 62 of 62 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-05-19T17:14:18.558837Z

measured 62 of 62 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-05T06:32:48.257954+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

62 of 62 outbound references displayed

  • verified exact47
  • verified fuzzy8
  • unresolved0
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch6

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation aef62008-1ee7-4d8d-a569-f8ea26d71eb8 · outbound

This paper cites Publish or perish.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Publish or perish

Reference 1

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.647130Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:421e0d58bd084bd8b2d08be72d01ad90f93edd550639a71c13ac89de26ca37de

Observation 212454a1-7fd3-489a-8560-1d28071a2f0e · outbound

This paper cites Science in an exponential world.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Science in an exponential world

Reference 2

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.662929Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:855e0cd625853113f957d6e38af027bbe067f8837300467f3aad5635342c96af

Observation e58e1e0e-fd3c-488d-b5dd-6a631a21191e · outbound

This paper cites Distinguishing.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Distinguishing

Reference 3

Resolution
metadata mismatch
doi, observed 2026-05-19T17:17:42.685688Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:01aa2628602112420f3025dcf4588e83fe63817081cd41886e933d64d07750b5

Observation 1072c615-6d8f-4752-b394-55a73791afc2 · outbound

This paper cites Have AI-generated texts from LLM infiltrated the realm of scientific writing? a large-scale analysis of preprint platforms.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Have AI-generated texts from LLM infiltrated the realm of scientific writing? a large-scale analysis of preprint platforms

Reference 4

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.729435Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:ea63fc04af6cd61b90d31648dcfd4debf4f5068ff8b2a9243c95a5e4ec4685a4

Observation aec1adf6-c8c5-4e4f-888b-5d5eac52800d · outbound

This paper cites Is LLM a reliable reviewer? a comprehensive evaluation of LLM on automatic paper reviewing tasks.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Is LLM a reliable reviewer? a comprehensive evaluation of LLM on automatic paper reviewing tasks

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-05-19T17:17:43.531335Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:63b56e01d822cf0a376190a25324851b65c4bf6b0c01468c00814123942be624

Observation e9ba4ef6-553d-4565-812f-2b5f46e81d9f · outbound

This paper cites Is peer review in decline?.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Is peer review in decline?

Reference 6

Resolution
verified exact
arxiv_id, observed 2026-05-19T17:17:42.657920Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:4d297124e74546d7a9d37104ecaaa6ed27db713a28f16ae0b48a06b382f8e69b

Observation 6dbf92fd-70a0-4e65-a041-06bc2cb2dfa6 · outbound

This paper cites Position: The ML Community Must Build an AI-Augmented Peer-Review Ecosystem.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Position: The ML Community Must Build an AI-Augmented Peer-Review Ecosystem

Reference 7

Resolution
verified exact
arxiv_id, observed 2026-06-10T02:10:30.997109Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:3fcb15d47a27e2eecd3ae82359370beeb15f5a9ee449776d37c6b902581916bc

Observation 9657a55f-f82b-45b0-8181-c0bcf7c224f3 · outbound

This paper cites Popper,Logik der Forschung.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Popper,Logik der Forschung

Reference 8

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.649600Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:60f36bac69481f1e4dfeb024c543f9f3b235f81e29c0383e91ae823b6638dc9e

Observation a0f81cdf-8c1b-4f01-b151-74ef65f74264 · outbound

This paper cites London, UK: Hutchinson & Co.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review London, UK: Hutchinson & Co

Reference 9

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.665141Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:2a0f44c56c19d445c4855fa966873a33c663e7f4c3146003a8475f7c7c55b0a1

Observation d7b80a6b-5109-4f76-a2c3-e4b6aac53037 · outbound

This paper cites The replicability crisis and public trust in psychological sci- ence.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review The replicability crisis and public trust in psychological sci- ence

Reference 10

Resolution
verified exact
arxiv_id, observed 2026-05-19T17:17:42.547085Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:380b56916f5b1e14945faea279df641e10c44815b6a92f5903518b8ad8980def

Observation 40a9665a-46fe-4a75-bf91-c16859459f09 · outbound

This paper cites An open investi- gation of the reproducibility of cancer biology research.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review An open investi- gation of the reproducibility of cancer biology research

Reference 11

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.553238Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:1f6dc2dae4941374c782c2fb88f87c710d9eb677213a9a34edba8ece5db45a58

Observation 81781be7-32e2-4538-8542-8b94fb349881 · outbound

This paper cites The reproducibility crisis in the age of digital medicine.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review The reproducibility crisis in the age of digital medicine

Reference 12

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.605637Z

Source-reported events for the cited work

correction dated 2019-03-19. Source: crossref record 10.1038/s41746-019-0098-9->10.1038/s41746-019-0079-z:correction, observed 2026-07-11T03:07:00.225541+00:00. This notice travels one citation hop only.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:d27602cf092117179d4076afac4b1e918dd14d3a8ddb6569f8770dc2dc17d4e5

Observation b24a3527-45f2-4170-b086-b32ebf1dca25 · outbound

This paper cites No raw data, no science: another possible source of the reproducibility crisis.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review No raw data, no science: another possible source of the reproducibility crisis

Reference 13

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.640874Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:7ad9a34a700167d0b8dc1cfc89b96225470a7773ffa41c5e51fd3472beb76af9

Observation 41f60052-ee59-47d7-9b4a-998fa275030c · outbound

This paper cites Repro- ducibility in management science.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Repro- ducibility in management science

Reference 14

Resolution
verified exact
arxiv_id, observed 2026-05-19T17:17:42.668995Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:36b5b169f8ad005ee0a0c2526a9f42a1e535e606719bc75ff60344007cba50e3

Observation fdc5aa28-958a-4613-a1b8-dfb4df50a836 · outbound

This paper cites Investigating the replicability of the social and behavioural sciences.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Investigating the replicability of the social and behavioural sciences

Reference 15

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.590045Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:066f8cf02cbce87df87e23a3977181462c82ec9fdc7b844ade750bf6082adaeb

Observation d5c24350-85c4-4b36-b7e2-c33eb2a32803 · outbound

This paper cites Artificial intelligence faces reproducibility crisis.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Artificial intelligence faces reproducibility crisis

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-05-19T17:17:43.518512Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:c9ce7b3b7393982dedc50aadf7cce18e6ccd76bad09e75e08da41f87b4f4f305

Observation c7fda214-750e-4446-b0ca-5dd73115f659 · outbound

This paper cites Artificial intelligence faces reproducibility crisis.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Artificial intelligence faces reproducibility crisis

Reference 17

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.671696Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:27078b9503e14241996bce27b5176c6ee869c9f308fad3ea03d50172148c93f5

Observation de58af73-7927-4742-b58f-002b8d73e892 · outbound

This paper cites Revisiting reproducibility in transportation simulation studies.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Revisiting reproducibility in transportation simulation studies

Reference 18

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.674053Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:48174015a4f46e7204a683e9e23ede054a1d1b5b68b3a8ba085e2d8bce545dfb

Observation fbf49dcc-e9c6-4745-9b38-8a22f83de16c · outbound

This paper cites Reproducibility crisis.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Reproducibility crisis

Reference 19

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.710499Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:9575d97870b24f95aa2ca5bac108226d8bc547d7d851a21349ea364c869b87e1

Observation b9250b5b-9241-414d-ab28-5ca948c08e28 · outbound

This paper cites Is science really facing a reproducibility crisis, and do we need it to?.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Is science really facing a reproducibility crisis, and do we need it to?

Reference 20

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.634438Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:51886fa0c06e747cad809c30dd977f836613cf34dd85878d0d9c968d349992ef

Observation 19fb843c-86d8-40ba-bd24-8d81bec1bb36 · outbound

This paper cites Before reproducibility must come preproducibility.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Before reproducibility must come preproducibility

Reference 21

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.559980Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:94ca9deff666d8ef97dc8e5d15618b65c2051ad66ea30d82f9b0578976eaa221

Observation 1d65c982-a9ee-4737-b0b4-1b02a4823c56 · outbound

This paper cites National Academies Press.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review National Academies Press

Reference 22

Resolution
malformed identifier
doi_truncated, observed 2026-05-19T17:17:42.652543Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:a8f0bc58b9196259df25b20cd3635f61893bb17fbf9a0655246672d3bf7e2147

Observation 82340d20-57ee-4432-a5a7-01529bfde5ec · outbound

This paper cites Agentic AI: Autonomous Intelligence for Complex Goals—A Comprehensive Survey.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Agentic AI: Autonomous Intelligence for Complex Goals—A Comprehensive Survey

Reference 23

Resolution
metadata mismatch
arxiv_id, observed 2026-05-19T17:17:42.596376Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:cfa38cabea02812a7563052c9bcc40649d24cd07223f57c4aafb289084e6aa77

Observation 673bbea0-2a38-4653-92a5-292b581b74d5 · outbound

This paper cites From generation to judgment: Opportunities and challenges of LLM-as-a-judge.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review From generation to judgment: Opportunities and challenges of LLM-as-a-judge

Reference 24

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.602557Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:d1cf7fadbcbe0c82a5b43b0fb81a62f192fb6c228c0a1ed4a9202e62d4a9157a

Observation 497633d2-6cd5-4e87-9b82-ea111d31eef1 · outbound

This paper cites AgentReview: Exploring Peer Review Dynamics with.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review AgentReview: Exploring Peer Review Dynamics with

Reference 25

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.682560Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:7665f428912d5aaf65ff701616b0f1a69692140c5e28d4bb9bf2bbef0f81d45d

Observation 8cda4d67-4213-45da-b591-f87d436e9e81 · outbound

This paper cites Can LLM feedback enhance review quality? A randomized study of 20K reviews at ICLR 2025.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Can LLM feedback enhance review quality? A randomized study of 20K reviews at ICLR 2025

Reference 26

Resolution
verified exact
arxiv_id, observed 2026-05-19T17:17:42.717638Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:842c3ad7dde4f6b21017220d2ced46becdaf68d217fff8da671453f262368329

Observation 582f3849-92c6-43f1-a88a-65a9ff6cddec · outbound

This paper cites Can large language models provide useful feedback on research papers? a large-scale empirical analysis.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Can large language models provide useful feedback on research papers? a large-scale empirical analysis

Reference 27

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.621626Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:a9c5b4494215e09ad3baf56d0798f95743a9fac54d145601be9250089f036dff

Observation b465d3ae-24cd-49da-a1c7-1693b2442824 · outbound

This paper cites LLMs as meta-reviewers’ assistants: A case study.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review LLMs as meta-reviewers’ assistants: A case study

Reference 28

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.628663Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:deb6db7f824de51fbe0d076fa94a1eff9431350231e36b56e5a36576024b63a3

Observation e6ed954b-2acf-400d-b754-6132923cafa2 · outbound

This paper cites Large language models for automated scholarly paper review: A survey.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Large language models for automated scholarly paper review: A survey

Reference 29

Resolution
verified exact
arxiv_id, observed 2026-05-19T17:17:42.638087Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:a2b3f2d168eab29a97d1eab2fb39af72d41299a835f0a8982f1bc9701c667950

Observation 2a09d6c0-f660-4e67-9a41-187cee2a0f0a · outbound

This paper cites Repro-bench: Can agentic ai systems assess the reproducibility of social science research?.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Repro-bench: Can agentic ai systems assess the reproducibility of social science research?

Reference 30

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.550032Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:0def6b5c273a123ca7a36ad8ac4066ca3927aa202e22fea3fcdf0cf10d944af0

Observation b38edb3c-11a2-40da-8a0f-8921ed2ba1b8 · outbound

This paper cites ReplicatorBench: Benchmarking LLM Agents for Replicability in Social and Behavioral Sciences.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review ReplicatorBench: Benchmarking LLM Agents for Replicability in Social and Behavioral Sciences

Reference 31

Resolution
verified exact
local_arxiv, observed 2026-05-19T17:17:42.625324Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:96a84b150b98ea995f81db8a5823bbb5a5785d6f6fba3568becb249274d7a14f

Observation d3e4ec10-a122-4934-8313-995cc7272db8 · outbound

This paper cites Airs-bench: a suite of tasks for frontier ai research science agents.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Airs-bench: a suite of tasks for frontier ai research science agents

Reference 32

Resolution
verified exact
arxiv_id, observed 2026-05-19T17:17:42.563888Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:5f379e4089fabf805229e0718c13edb82a1411c6070ffa2e2837d1465d29a6eb

Observation 08e6f8e8-4af8-40bb-8597-57a8f9af6bec · outbound

This paper cites From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking

Reference 33

Resolution
metadata mismatch
arxiv_id, observed 2026-05-19T17:17:42.689492Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:e03b43c2add36c7daecbbd12c927b093c7bafdd36e6e88df7f1c7b657f0ec978

Observation 83c27c53-ada5-4c13-a904-025947946bfb · outbound

This paper cites Zachary S Siegel, Sayash Kapoor, Nitya Nagdir, Benedikt Stroebl, and Arvind Narayanan.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Zachary S Siegel, Sayash Kapoor, Nitya Nagdir, Benedikt Stroebl, and Arvind Narayanan

Reference 34

Resolution
metadata mismatch
arxiv_id, observed 2026-05-19T17:17:42.721577Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:a5b5d71d85c89be154c23af9bcc68546020ffbb80878bfaf35caa76995edda55

Observation 05335627-eafa-4673-a2a8-3ed0767c8922 · outbound

This paper cites Rescience c: a journal for reproducible replications in computa- tional science.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Rescience c: a journal for reproducible replications in computa- tional science

Reference 35

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.566608Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:cd331153e41eed1e4538857ac0a3405500868eadb1c06aeaecfa43d9217981a1

Observation 14fd027b-924f-4631-b780-5ec51578971a · outbound

This paper cites Assessing data availability and research reproducibility in hydrology and water resources.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Assessing data availability and research reproducibility in hydrology and water resources

Reference 36

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.587192Z

Source-reported events for the cited work

correction dated 2019-04-24. Source: crossref record 10.1038/s41597-019-0039-0->10.1038/sdata.2019.30:correction, observed 2026-07-11T03:01:42.144587+00:00. This notice travels one citation hop only.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:7bba7c09fb95087ed54fe81cee838bbfe8e93ccd565253b763a5c8a700a040b7

Observation fff27472-d22c-411f-a640-70e1a117e489 · outbound

This paper cites Reliability: on the reproducibility of assessment data.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Reliability: on the reproducibility of assessment data

Reference 37

Resolution
verified exact
arxiv_id, observed 2026-05-19T17:17:42.573695Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:bea2d86f22fc5fe1a8b35169423494a980d07855e518c22ef439087bb05e950c

Observation 3fb8a861-0544-4031-ba8e-faae328978a8 · outbound

This paper cites Accuracy, reproducibility and repeatability of ultrasonography in the assessment of abdominal adiposity.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Accuracy, reproducibility and repeatability of ultrasonography in the assessment of abdominal adiposity

Reference 38

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.592887Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:54c1572ad56393bc313bd21a34bd6c49bd84ca24776a85a83c73b103701ae7ae

Observation be224a15-22ed-4256-a7a8-817aa75031ad · outbound

This paper cites Critical review of current approaches for echocardiographic reproducibility and reliability assessment in clinical research.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Critical review of current approaches for echocardiographic reproducibility and reliability assessment in clinical research

Reference 39

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.614551Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:276b26ac6f44e608e370bb5178663f0a170d30402e7596e657da47dd0d6be5a8

Observation 4e9228ec-07b0-47a8-9b06-16d007cd6544 · outbound

This paper cites A practical guide to assess the reproducibility of echocardiographic measurements.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review A practical guide to assess the reproducibility of echocardiographic measurements

Reference 40

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.599483Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:02c25b64eb9b4650cee3c56934cd34fc1396db67bf06876223735e8bb5e288bc

Observation 786ec293-dd7e-49cb-bd37-67483c6249f4 · outbound

This paper cites Statistical methods for replicability assessment.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Statistical methods for replicability assessment

Reference 41

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.611555Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:e4643a7dcab4c6510dadcdc1eb4cc73cebdc42ada42ae2a6d905f452d049a2a4

Observation 925a6776-4362-49eb-b84e-0f65f8d4da8a · outbound

This paper cites The assessment of replicability using the sum of p-values.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review The assessment of replicability using the sum of p-values

Reference 42

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.708090Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:0400e25011c7164aaa1e6c88e712e56284c569f7a31f888fd2a5d623e243405c

Observation 1aa11151-2242-49dd-9ba3-4ac3da88fdb6 · outbound

This paper cites Systematic assessment of the replicability and generalizability of preclinical findings: Impact of protocol harmonization across laboratory sites.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Systematic assessment of the replicability and generalizability of preclinical findings: Impact of protocol harmonization across laboratory sites

Reference 43

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.713970Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:e18b094e6397c5b77e40c1d410ea58f3135e3c9006bd56c07f7a5c770ce9d160

Observation 096ccee8-75b1-4d24-8a48-8d6a2abf6fd6 · outbound

This paper cites Deepcode: Open agentic coding.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Deepcode: Open agentic coding

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-05-19T17:17:43.537031Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:0a8d776ac06963fce21bada615aeecd869743de6e359e1d68d539361cf3a6c73

Observation 24f182b8-2df4-4542-aa53-68064df04865 · outbound

This paper cites https: //arxiv.org/abs/2512.07921.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review https: //arxiv.org/abs/2512.07921

Reference 45

Resolution
verified exact
arxiv_id, observed 2026-05-19T17:17:42.557111Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:bcfbeb24546b6623f366feedd959ccff79a4e66eca36e6171d4e4d13924ff30e

Observation c0802c46-5ac9-428d-b93f-ae792626016e · outbound

This paper cites Replicationbench: Can AI agents replicate astrophysics research papers?.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Replicationbench: Can AI agents replicate astrophysics research papers?

Reference 46

Resolution
verified exact
arxiv_id, observed 2026-05-19T17:17:42.677953Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:3bf5ccb8e0a5ec54ae761ec4c7f344cb77adf37a8e205a7555433d4827d8169e

Observation 9e73d574-d455-423e-a21d-523752807a52 · outbound

This paper cites PaperBench: Evaluating AI's Ability to Replicate AI Research.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review PaperBench: Evaluating AI's Ability to Replicate AI Research

Reference 47

Resolution
metadata mismatch
local_arxiv, observed 2026-05-19T17:17:42.608991Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:c1077dd874f870755b70c30b810ddd1583dcde3bfa7048ecfada5721c2df540c

Observation f79221ea-2366-469f-97c8-1984d0a5d8c5 · outbound

This paper cites LLM-assisted replication for quantitative social science.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review LLM-assisted replication for quantitative social science

Reference 48

Resolution
verified exact
arxiv_id, observed 2026-05-19T17:17:42.576935Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:104315537eef48481f8506cd9550e4cf45f499fa12680b8068a68e63e2987a39

Observation 18ba462e-9292-44b2-a2dd-39975907ba7f · outbound

This paper cites LLM-assisted replication as scientific infrastructure.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review LLM-assisted replication as scientific infrastructure

Reference 49

Resolution
verified fuzzy
raw_fallback, observed 2026-05-19T17:17:43.534337Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:293130c566f5ecdb232a683d1d558f38181cd0a9700f287902d1b62a268a3d0e

Observation 6be7028c-01eb-49d9-9e36-34063937707b · outbound

This paper cites AI-Driven Review Systems: Evaluating LLMs in Scalable and Bias-Aware Academic Reviews.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review AI-Driven Review Systems: Evaluating LLMs in Scalable and Bias-Aware Academic Reviews

Reference 50

Resolution
verified exact
arxiv_id, observed 2026-05-19T17:17:42.570124Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:a7e0f6b6657ee847ea12796144e4d37b016648248cd696f700a69139d9811f40

Observation 0d8652f6-d694-4569-9631-1032e3f6356a · outbound

This paper cites From replication to redesign: Exploring pairwise comparisons for LLM-based peer review.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review From replication to redesign: Exploring pairwise comparisons for LLM-based peer review

Reference 51

Resolution
verified exact
arxiv_id, observed 2026-05-19T17:17:42.580541Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:174a9bbe5f662a3d8d1e6d08b3915a68bbc5e3d0cc0b1a117cff94c84b7a877c

Observation 03812ca5-de47-41d8-9691-b6ba6ea13c1f · outbound

This paper cites Ai is transforming peer review—and many scientists are worried.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Ai is transforming peer review—and many scientists are worried

Reference 52

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.660530Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:fdff9f3722153be62b460deabe5351ddb9cace025426fbcab7d7f749844c6857

Observation a339beed-f21b-46f0-9596-a70cf473ffaa · outbound

This paper cites More than half of researchers now use AI for peer review—often against guidance.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review More than half of researchers now use AI for peer review—often against guidance

Reference 53

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.680259Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:679a900f4223fb16d677d87c24a88d6451e06012fda5ed05d0b5fa51ba285819

Observation 7b64681f-fde3-4b2f-a507-b483da68ba29 · outbound

This paper cites Reproscreener: Leveraging LLMs for assessing computational reproducibility of machine learning pipelines.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Reproscreener: Leveraging LLMs for assessing computational reproducibility of machine learning pipelines

Reference 54

Resolution
metadata mismatch
arxiv_id, observed 2026-05-19T17:17:42.618694Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:167b0a5a0e3fff55581da42a3227b22ef6850bf22d0cca0878f90d1a03c1466e

Observation 20e0d459-80ca-4be3-abe0-1c86674ee17e · outbound

This paper cites Paper-snitch: A practical tool for evidence-based reproducibility assessment.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Paper-snitch: A practical tool for evidence-based reproducibility assessment

Reference 55

Resolution
verified fuzzy
raw_fallback, observed 2026-05-19T17:17:43.528865Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:837922fb1bbd1ad2747fb4da86cbd4ddc95ed19bdaed75ee736cb38a8b7e3f75

Observation 128090fa-89dd-4346-bb94-4f8af7db6f14 · outbound

This paper cites Assessing reproducibility in evolutionary computation: A case study using human-and LLM-based assessment.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Assessing reproducibility in evolutionary computation: A case study using human-and LLM-based assessment

Reference 56

Resolution
verified exact
arxiv_id, observed 2026-05-19T17:17:42.632032Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:52c80951402f01bb37a94297d5f6e090bc76d1fef2e602f4e30636040c86d471

Observation 2ae921f7-a45e-4961-a5d2-cb61eb686c47 · outbound

This paper cites Auto-metrics: LLM-assisted scientific quality control for radiomics research.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Auto-metrics: LLM-assisted scientific quality control for radiomics research

Reference 57

Resolution
verified exact
arxiv_id, observed 2026-05-19T17:17:42.726541Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:d977de0d1d827256a0a18ff2aba3a1a15df19d7c2cc94373993cb81cffac32f9

Observation 8e81159b-4a44-48c1-a3fe-062a26f33644 · outbound

This paper cites Mass reproducibility and replicability: A new hope.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Mass reproducibility and replicability: A new hope

Reference 58

Resolution
verified fuzzy
raw_fallback, observed 2026-05-19T17:17:43.526435Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:a0d69b416e6180d04a5bbafa0bc0b3eaaae9cf03929cd2ee00e5ad3094d7ba79

Observation 8a3a6f94-f50b-48e0-93ff-c46d68a644e0 · outbound

This paper cites State of the art: Reproducibility in artificial intelligence.Proceedings of the AAAI Conference on Artificial Intelligence, 32(1), April 2018.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review State of the art: Reproducibility in artificial intelligence.Proceedings of the AAAI Conference on Artificial Intelligence, 32(1), April 2018

Reference 59

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.583972Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:1b24c195d709014bce0581035ab32f7e7bc3a39b7e89b83a41786e07d685f8e3

Observation 0d56ecff-c5e4-4f45-b826-5cb90e5d6ab1 · outbound

This paper cites I4r discussion paper series, the institute for replication (i4r).

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review I4r discussion paper series, the institute for replication (i4r)

Reference 60

Resolution
verified fuzzy
raw_fallback, observed 2026-05-19T17:17:43.520908Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:733088aa32a9d554bd840b7938d822c772e5e5616828d573f4e7d972009046c0

Observation dcd0c530-1647-4d37-a534-9070edb41a24 · outbound

This paper cites Retraction watch – tracking retractions as a window into the scientific process.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Retraction watch – tracking retractions as a window into the scientific process

Reference 61

Resolution
verified exact
doi, observed 2026-05-19T17:17:42.654823Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:c2a1317e21520d57c7e5c92112edba15a05f6fdc8ba5a020896f02458d13b40a

Observation d280e570-2b88-4ffb-99b9-dffcb93683d6 · outbound

This paper cites Guidelines: • The answer [N/A] means that the paper does not involve crowdsourcing nor research with human subjects.

ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review Guidelines: • The answer [N/A] means that the paper does not involve crowdsourcing nor research with human subjects

Reference 62

Resolution
verified fuzzy
raw_fallback, observed 2026-05-19T17:17:43.523994Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T17:14:18.558837Z digest=sha256:6e14106fa1d2a2019cc3a24b60a08f9ad7672398386e95de56a92159d37f5686

Pith citing papers

No inbound Pith citation observations are available.