Pith. sign in

Paper Citation Record · LEDGER

AI Scientists Fail Without Strong Implementation Capability

As of 8 August 2026, this Paper Citation Record lists 65 of 65 outbound references and 3 inbound Pith citation observations for arXiv:2506.01372.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.01372 v2

Coverage vector

measured 65 of 65 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T11:49:08.589917Z

measured 68 of 68 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-01T12:50:06.841591Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-20T20:03:44.060778Z

Reference resolution

65 of 65 outbound references displayed

  • verified exact1
  • verified fuzzy5
  • unresolved59
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 585cbaa4-8e54-47fb-9164-e43527107246 · outbound

This paper cites The relationship between reasoning and performance in large language models--o3 (mini) thinks harder, not longer.

AI Scientists Fail Without Strong Implementation Capability The relationship between reasoning and performance in large language models--o3 (mini) thinks harder, not longer

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:00.983368Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:00.983368Z digest=sha256:c46e378ffc0cb075c6972adad31a7ff71bbf31472be099541cb4494153d767cb

Observation 455fb266-b19a-4eb2-9f40-29ccbf107ead · outbound

This paper cites Superintelligent Agents Pose Catastrophic Risks: Can Scientist AI Offer a Safer Path?.

AI Scientists Fail Without Strong Implementation Capability Superintelligent Agents Pose Catastrophic Risks: Can Scientist AI Offer a Safer Path?

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:01.121192Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:01.121192Z digest=sha256:ce0a88ff831aed6494be4986c8607107ecb4e5571f492dae502a34f13a9399cf

Observation 6207316a-2237-4f4b-a5fe-c563dc2dee76 · outbound

This paper cites Why Do Multi-Agent LLM Systems Fail?.

AI Scientists Fail Without Strong Implementation Capability Why Do Multi-Agent LLM Systems Fail?

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:01.392416Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:01.392416Z digest=sha256:7650742f9bed31cd160c5b40a81111ad00ff440e66d3b02acf0d9b5abdd61203

Observation 089f937e-d284-4d45-9032-4f160e40483b · outbound

This paper cites MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering.

AI Scientists Fail Without Strong Implementation Capability MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:01.526190Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:01.526190Z digest=sha256:7ef28adfc196697c436805d00b44656eeb29fd610bf1e2b9ea5378c36c0e73ce

Observation 876f5b07-7c47-418d-aa72-f9fd5c158357 · outbound

This paper cites Evaluating Large Language Models Trained on Code.

AI Scientists Fail Without Strong Implementation Capability Evaluating Large Language Models Trained on Code

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:01.642722Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:01.642722Z digest=sha256:d69d7e4be5f9ea3e52b9ba6b87d96c766cb0c99eddca0a89d803bf0a901e7e4e

Observation eacc1515-4c04-404b-8f86-dd730f5c796a · outbound

This paper cites Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment.

AI Scientists Fail Without Strong Implementation Capability Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:01.756223Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:01.756223Z digest=sha256:1db9e4caea61780438b483d57445843696e3ae3e156f4f1e7b93226e9d6206f4

Observation c24984a8-a972-4069-9cd9-29a63c0180ac · outbound

This paper cites IRIS: Interactive Research Ideation System for Accelerating Scientific Discovery.

AI Scientists Fail Without Strong Implementation Capability IRIS: Interactive Research Ideation System for Accelerating Scientific Discovery

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:01.877094Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:01.877094Z digest=sha256:e0ab1b6444214b6b1f8a9a985a2b029046362e729559889fb73128a3c4c38c60

Observation 241d67cb-b175-4b1e-a3be-e5dc6f1f587a · outbound

This paper cites SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoning.

AI Scientists Fail Without Strong Implementation Capability SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoning

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.009902Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.009902Z digest=sha256:629781bd5890497ab903a3b4202d19dcb48a87c5c19a1650ce32d1f69eb81385

Observation e2855918-989d-414d-9544-9df08d6fe3ee · outbound

This paper cites Towards an AI co-scientist.

AI Scientists Fail Without Strong Implementation Capability Towards an AI co-scientist

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.170925Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.170925Z digest=sha256:974476b9069121d206747758ed5c273f776df759f570ac33cb192b3a16440b4b

Observation 60bd406f-dec0-4d74-b55c-44969e5dc4f0 · outbound

This paper cites LLMs can Realize Combinatorial Creativity: Generating Creative Ideas via LLMs for Scientific Research.

AI Scientists Fail Without Strong Implementation Capability LLMs can Realize Combinatorial Creativity: Generating Creative Ideas via LLMs for Scientific Research

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.277328Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.277328Z digest=sha256:f15791895609ab7f03f19c0059581c9ba6560704791c21a585eca9045d4b924e

Observation 11fd7b30-7776-474d-914b-ffb838c06046 · outbound

This paper cites Large Language Model based Multi-Agents: A Survey of Progress and Challenges.

AI Scientists Fail Without Strong Implementation Capability Large Language Model based Multi-Agents: A Survey of Progress and Challenges

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.382812Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.382812Z digest=sha256:d1877961c05ff400fa554e403d323490bb5eac8dc383928615a5431f31505017

Observation cc8fcd72-2d9b-4c9e-9ac9-88fbd7848eca · outbound

This paper cites PaSa: An LLM Agent for Comprehensive Academic Paper Search.

AI Scientists Fail Without Strong Implementation Capability PaSa: An LLM Agent for Comprehensive Academic Paper Search

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.520844Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.520844Z digest=sha256:e6b999f26a87cb5afe21cec329f7da35b78cf50b4bb56ca15f73e2d8fd3dc69a

Observation 9c3c27de-bd74-4666-b467-a0261a7fe174 · outbound

This paper cites Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directions.

AI Scientists Fail Without Strong Implementation Capability Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directions

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.632210Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.632210Z digest=sha256:f001279e0bc39bc9473a9f59d14102e7b8cce86baa194af7c526facc2ed2aba3

Observation 6ac99bae-9e1e-44f1-a113-6689bd9d5262 · outbound

This paper cites Nova: An Iterative Planning and Search Approach to Enhance Novelty and Diversity of LLM Generated Ideas.

AI Scientists Fail Without Strong Implementation Capability Nova: An Iterative Planning and Search Approach to Enhance Novelty and Diversity of LLM Generated Ideas

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.748535Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.748535Z digest=sha256:cf15ee3bc9d581409b9cda55a14310c275ba8418af8d87ac20b9644bd0e736f9

Observation f6d4187c-14cb-48e7-9afa-2a8043bb77aa · outbound

This paper cites LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code.

AI Scientists Fail Without Strong Implementation Capability LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:02.892900Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:02.892900Z digest=sha256:5e2d76a2cd8650f45dadb993063458271e84934e671597d3aa5b9eed83c2aeb7

Observation a76b139d-8395-4ad3-bb58-e36029c73cb7 · outbound

This paper cites CodeScientist: End-to-End Semi-Automated Scientific Discovery with Code-based Experimentation.

AI Scientists Fail Without Strong Implementation Capability CodeScientist: End-to-End Semi-Automated Scientific Discovery with Code-based Experimentation

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.018962Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.018962Z digest=sha256:8b38e5035d8bd1159b958f32d69507468e5f3e90263f687ca93919752cd1e55e

Observation c02ca024-d610-4280-b654-bec0e03fb7f3 · outbound

This paper cites AIDE: AI-Driven Exploration in the Space of Code.

AI Scientists Fail Without Strong Implementation Capability AIDE: AI-Driven Exploration in the Space of Code

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.119196Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.119196Z digest=sha256:89b81cd03b7bc2fd2c3b774e9804f1f28a04a7e5b4d1f2dfd5d117ff3c8e04dc

Observation 204eeaaa-4a33-449e-8507-3885c6d0c685 · outbound

This paper cites LLMs Get Lost In Multi-Turn Conversation.

AI Scientists Fail Without Strong Implementation Capability LLMs Get Lost In Multi-Turn Conversation

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.467915Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.467915Z digest=sha256:61f6c01de88eb4d9ed4fc9c15e583e3c25bc8b064611e92c629150baa69aae1a

Observation a2d5485d-3adc-4870-9c40-39e4f57dea87 · outbound

This paper cites DrugAgent: Automating AI-aided Drug Discovery Programming through LLM Multi-Agent Collaboration.

AI Scientists Fail Without Strong Implementation Capability DrugAgent: Automating AI-aided Drug Discovery Programming through LLM Multi-Agent Collaboration

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.711750Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.711750Z digest=sha256:8695d5719fd5e5933a768ee519bad78190ee718a05d41e2c0aa528da048e1fc3

Observation 6a05857c-d6ba-441d-967d-6954f3293163 · outbound

This paper cites AIGS: Generating Science from AI-Powered Automated Falsification.

AI Scientists Fail Without Strong Implementation Capability AIGS: Generating Science from AI-Powered Automated Falsification

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.834636Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.834636Z digest=sha256:0a2953ad36888e954bcc4ae5e5b8a40ca5c708f4d810e3f3cc31541798a521a3

Observation 235aaf50-4cd0-46de-b0e1-be7201172ac7 · outbound

This paper cites The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery.

AI Scientists Fail Without Strong Implementation Capability The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.993632Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.993632Z digest=sha256:78c12161f03d804103d0aee87417ebd0cc611bf9beb7fdebd28f8438c3c8f08d

Observation aded90f8-1b0e-468e-93ab-0942d7935376 · outbound

This paper cites Sparks of Science: Hypothesis Generation Using Structured Paper Data.

AI Scientists Fail Without Strong Implementation Capability Sparks of Science: Hypothesis Generation Using Structured Paper Data

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:04.355306Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:04.355306Z digest=sha256:0dd2dec4848ff06d4084ad414e0753a0ab1f0bd1b75c2cc15ebb867714ffe9ed

Observation 0beef106-8e32-460f-ac4f-fb8be80c23bf · outbound

This paper cites ML-Dev-Bench: Comparative Analysis of AI Agents on ML development workflows.

AI Scientists Fail Without Strong Implementation Capability ML-Dev-Bench: Comparative Analysis of AI Agents on ML development workflows

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:04.506588Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:04.506588Z digest=sha256:2358bff62e94b6758b648e0d9fe1626ae0ff3a775cc2a6059030ce618c424ab7

Observation 2361c1dc-27d8-4b59-8ae5-bf3f0db8e94a · outbound

This paper cites Ideasynth: Iterative research idea development through evolving and composing idea facets with literature-grounded feedback.

AI Scientists Fail Without Strong Implementation Capability Ideasynth: Iterative research idea development through evolving and composing idea facets with literature-grounded feedback

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:04.638623Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:04.638623Z digest=sha256:9bfd9f38047b9b15f09d4eb2cbcd479b135f38d691efa2ee984edda496195583

Observation 6c18ebcd-7e77-4f2e-aa9a-5068916d1ea1 · outbound

This paper cites Iterative Hypothesis Generation for Scientific Discovery with Monte Carlo Nash Equilibrium Self-Refining Trees.

AI Scientists Fail Without Strong Implementation Capability Iterative Hypothesis Generation for Scientific Discovery with Monte Carlo Nash Equilibrium Self-Refining Trees

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:04.767680Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:04.767680Z digest=sha256:5e51362ebad938526097c9fd7d60a5e5ba0ed1d1d13f5588ff8d27c10301f07f

Observation e6c7066e-a501-4827-89d2-c129711fd55f · outbound

This paper cites Human-LLM Compound System for Scientific Ideation through Facet Recombination and Novelty Evaluation.

AI Scientists Fail Without Strong Implementation Capability Human-LLM Compound System for Scientific Ideation through Facet Recombination and Novelty Evaluation

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:04.917967Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:04.917967Z digest=sha256:c25f1a96288e2f3c1475dcec38c83e8684fabda29c1dda354d9afd78f894ac07

Observation 39e3ba0f-4d41-4365-b62e-6c2cc684661d · outbound

This paper cites AstroAgents: A Multi-Agent AI for Hypothesis Generation from Mass Spectrometry Data.

AI Scientists Fail Without Strong Implementation Capability AstroAgents: A Multi-Agent AI for Hypothesis Generation from Mass Spectrometry Data

Reference 34

Resolution
verified exact
local_arxiv, observed 2026-08-07T11:49:09.076092Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T11:49:05.074678Z digest=sha256:8569cf98f7e3740ff98417cba42ec52bf1b202a34ed990d21ca7aec393829b44

Observation 7d38d89a-c551-41ae-b75d-4196d32e43b5 · outbound

This paper cites Spark: A System for Scientifically Creative Idea Generation.

AI Scientists Fail Without Strong Implementation Capability Spark: A System for Scientifically Creative Idea Generation

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.153250Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.153250Z digest=sha256:8cc96719601abcf9e01be70419754ae24f6f6cab02546dba353de195c6cb46db

Observation cc5ffc26-7b64-4ee9-a7e9-e83c1cd9c747 · outbound

This paper cites Agent Laboratory: Using LLM Agents as Research Assistants.

AI Scientists Fail Without Strong Implementation Capability Agent Laboratory: Using LLM Agents as Research Assistants

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.207479Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.207479Z digest=sha256:d426ee50e2c84d5debef315758d5688390ae149f6edbf56d6b5b2090efb2e557

Observation 30edacd1-f051-4d43-991f-dc5313864317 · outbound

This paper cites Paper2code: Automating code generation from scientific papers in machine learning.arXiv preprint arXiv:2504.17192,.

AI Scientists Fail Without Strong Implementation Capability Paper2code: Automating code generation from scientific papers in machine learning.arXiv preprint arXiv:2504.17192,

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.244211Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.244211Z digest=sha256:3745b06d094f76d34c0aa590ed3ee81f4b3b1eecfa66ca573313df718ad96e49

Observation 73dccdd8-c7f9-4942-a0aa-e64bb379a31b · outbound

This paper cites ShortcutsBench: A Large-Scale Real-world Benchmark for API-based Agents.

AI Scientists Fail Without Strong Implementation Capability ShortcutsBench: A Large-Scale Real-world Benchmark for API-based Agents

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.401684Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.401684Z digest=sha256:e08e705e1d2459c7828920ab33e61dcd596691d4f81e760681465f11057f9cc5

Observation 45f7760b-c717-4a88-9d42-87d77cc67b1e · outbound

This paper cites Canllmsgeneratenovelresearchideas? Alarge-scalehuman study with 100+ NLP researchers.

AI Scientists Fail Without Strong Implementation Capability Canllmsgeneratenovelresearchideas? Alarge-scalehuman study with 100+ NLP researchers

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T11:49:12.287112Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T11:49:05.535880Z digest=sha256:2bd80ee36fdabf830d3171cdf7de4d3e67610049997d00b824b957fcd7d54bf5

Observation 02fe6701-6a4d-4a7d-9d10-30c697994b52 · outbound

This paper cites CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmark.

AI Scientists Fail Without Strong Implementation Capability CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmark

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.670557Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.670557Z digest=sha256:7bd6fd097dc99f5237c2ae7a958b96bd887e13b91351092fe3e069caa72cb0f2

Observation 697ba589-c9bd-428e-9c24-33fdf2a7200f · outbound

This paper cites PaperBench: Evaluating AI's Ability to Replicate AI Research.

AI Scientists Fail Without Strong Implementation Capability PaperBench: Evaluating AI's Ability to Replicate AI Research

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.813810Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.813810Z digest=sha256:f7987ef224bf6b1101c445887278718ab78a6b21a922aa785bb470e19cb30773

Observation de0a2467-344b-4148-9fc7-a3d9826f11f3 · outbound

This paper cites ZeroSearch: Incentivize the Search Capability of LLMs without Searching.

AI Scientists Fail Without Strong Implementation Capability ZeroSearch: Incentivize the Search Capability of LLMs without Searching

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.037989Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.037989Z digest=sha256:7a81d99578b6d1db273423d8f0ba69426e0a2c1291d81596868465f357248478

Observation 84be6792-5dfa-49f8-92da-dcfd78801cc6 · outbound

This paper cites SciPIP: An LLM-based Scientific Paper Idea Proposer.

AI Scientists Fail Without Strong Implementation Capability SciPIP: An LLM-based Scientific Paper Idea Proposer

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.160799Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.160799Z digest=sha256:dea65dd12707e9974d98064e019fe28002b0c28ff9e9151fce50caff56e82edb

Observation 43e630c0-337e-430f-94d1-27ccad2cdf6e · outbound

This paper cites Large language models are better reasoners with self-verification.

AI Scientists Fail Without Strong Implementation Capability Large language models are better reasoners with self-verification

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.281808Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.281808Z digest=sha256:85d19033b626729ed84c37a2535d870f047c8783bfd5c0bc2a793e31a7ee2a9e

Observation b3a60b3c-a999-42e4-8cf4-12660257330c · outbound

This paper cites Shifting Long-Context LLMs Research from Input to Output.

AI Scientists Fail Without Strong Implementation Capability Shifting Long-Context LLMs Research from Input to Output

Reference 46

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.406833Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.406833Z digest=sha256:5038f6056cb3a524a649c0a861d96b32f6a441733a0c1e559f2084a8f68b6779

Observation 8fdc8173-864d-447b-9033-9030ba33c6ee · outbound

This paper cites Improving Scientific Hypothesis Generation with Knowledge Grounded Large Language Models.

AI Scientists Fail Without Strong Implementation Capability Improving Scientific Hypothesis Generation with Knowledge Grounded Large Language Models

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.537534Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.537534Z digest=sha256:e5607a3394b3185da41b9dd0192a152fb47c0a665ecf28c446ec6e8d42b8adcf

Observation 3749524d-2ac7-4278-af41-25adaf01aefa · outbound

This paper cites The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search.

AI Scientists Fail Without Strong Implementation Capability The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.629089Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.629089Z digest=sha256:9053ef183b89fa3f0f550c13c00374a3f13a238ebe920a16de883665b10b1326

Observation 2e2b4c57-17d5-4d04-b0f0-534c632e87cc · outbound

This paper cites Qwen3 Technical Report.

AI Scientists Fail Without Strong Implementation Capability Qwen3 Technical Report

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.712106Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.712106Z digest=sha256:9bf44e58801d54c9e33507b8795212d0c311aa5000114f0237f7f4d8ea788aca

Observation ac39e507-a84f-499d-85d7-57c8fcc4520f · outbound

This paper cites ResearchTown: Simulator of Human Research Community.

AI Scientists Fail Without Strong Implementation Capability ResearchTown: Simulator of Human Research Community

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.773231Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.773231Z digest=sha256:f22a91a24a8a06301ecd426597901ef08b7e718bbcea80753e7cc517601cc1c8

Observation bd66b695-43eb-4d03-a77a-27df4917229c · outbound

This paper cites Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback.

AI Scientists Fail Without Strong Implementation Capability Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback

Reference 51

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.874611Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.874611Z digest=sha256:c626b54476c4ecbafbcfc1379065725f735e294952bedb4a09ab3feebabbc3d9

Observation c0e1b13b-fb6f-4693-bfb9-df451bed8998 · outbound

This paper cites A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?.

AI Scientists Fail Without Strong Implementation Capability A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?

Reference 52

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:06.967707Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:06.967707Z digest=sha256:89d5c3eae9cf6b5bad1c2829c42cb992938682fa8ffff2589f7b9d06ee274ae4

Observation ac38bdae-467d-4f26-842e-a8c00a2581cc · outbound

This paper cites OpenResearcher: Unleashing AI for Accelerated Scientific Research.

AI Scientists Fail Without Strong Implementation Capability OpenResearcher: Unleashing AI for Accelerated Scientific Research

Reference 53

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:07.021150Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:07.021150Z digest=sha256:ded85b7ea82bf1d6227ff6fd901b962a5a27fe6121eebcc6ec622751e50ac563

Observation 65160443-072e-4bf0-b947-7d4a503fc407 · outbound

This paper cites DeepReview: Improving LLM-based Paper Review with Human-like Deep Thinking Process.

AI Scientists Fail Without Strong Implementation Capability DeepReview: Improving LLM-based Paper Review with Human-like Deep Thinking Process

Reference 54

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:07.108809Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:07.108809Z digest=sha256:5bf04de2c338f9b2750c0497563a8128e6d58c0e4012e088d4edc9b2bd3e24c2

Observation 22ce0db0-4cfd-4eba-9b78-1bf14c45e807 · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 55

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:12.017902Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T11:49:07.196636Z digest=sha256:7c3ecff40ef5fc14ee74abbe6a81b4302a9b7e82759b99b40fa8d4521330aa09

Observation 9f75f9e0-8ad2-49d0-9c37-ae48a51465cb · outbound

This paper cites 20 AI Scientists Fail Without Strong Implementation Capability.

AI Scientists Fail Without Strong Implementation Capability 20 AI Scientists Fail Without Strong Implementation Capability

Reference 56

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T11:49:11.816501Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T11:49:07.292111Z digest=sha256:99011665b1894ea820cdaa7cb3f8972300806b8b4b6bfb32877960082dba4189

Observation da08517b-7ead-4848-8887-6e2a8692ecee · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 57

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:11.589600Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T11:49:07.393120Z digest=sha256:26bfce5ccbe224797324db7de7197f4be84f9f4d9799187ba0484f4821d4139d

Observation 915f0bc9-9492-486b-b8a0-8002cdd1da20 · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 58

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:11.299542Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T11:49:07.495776Z digest=sha256:d79d30b16bf45eae2a9eba48cb1aa062e61fd9d6693194d3637f6931f2c2cb86

Observation de53a12d-9fb8-474d-accd-d93fc7eb84f1 · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 59

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:11.107790Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T11:49:07.630519Z digest=sha256:f74c808de44b92ad77b8c6cbae1f0a5f319756c77f5e30137be0b8da8b6d8432

Observation fcf12ab1-8867-44de-bf73-2ff2ea178a2e · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 60

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:10.828847Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T11:49:07.747320Z digest=sha256:7255a794352260ad63a573f5e7c6b495e795472c662fc3b8c327db9479118c6d

Observation e9a5207f-ab4c-4ab9-bb35-e21f6bb3a22d · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 61

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:10.568651Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T11:49:07.952347Z digest=sha256:7d2921f74f5bf934919137569306ef403939b8ee144702ac42c13f06b0a7867c

Observation 7891ea88-2462-4c41-9c95-90195d0ccbbb · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 62

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:10.280713Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T11:49:08.144957Z digest=sha256:6ab597d173f20eae970b806826e4e4398fadf58606176d600a874d4f86e560fd

Observation d31021fc-58fb-40a7-bf35-a0eb1c798360 · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 63

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:10.030667Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T11:49:08.278926Z digest=sha256:9ba7f18d4b94fa6f8710a7abde8965ba29c66444d92aeb935ca69c5e48291959

Observation a58418a2-43df-4c82-8413-ba25425592fb · outbound

This paper cites an unresolved cited work.

AI Scientists Fail Without Strong Implementation Capability Unresolved cited work

Reference 64

Resolution
unresolved
raw_fallback, observed 2026-08-07T11:49:09.735966Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T11:49:08.400971Z digest=sha256:e3bb02489e1be95700ad3382a8cef7464732a287f30dc4ad56ed9cea726c621b

Observation 25f635d1-381d-415d-9193-43ec5624fd91 · outbound

This paper cites Regarding the statistics for the papers We have conducted a comprehensive search on arXiv to gather relevant publications in the AI Scientist field.

AI Scientists Fail Without Strong Implementation Capability Regarding the statistics for the papers We have conducted a comprehensive search on arXiv to gather relevant publications in the AI Scientist field

Reference 65

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T11:49:09.569047Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T11:49:08.589917Z digest=sha256:7861f84c24c887a5ed997daa14bf353e2ae1db7f40411441226ebd5c18a14f01

Observation 31bcb75f-f68b-4ef5-a051-1338c4ea2a27 · outbound

This paper cites Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents.

AI Scientists Fail Without Strong Implementation Capability Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents

Reference 1987

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.588515Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.588515Z digest=sha256:fe3da2224148c5b5980541655dbe756a0c1de8a695700737003f7a57ad80be0e

Observation 50602bd2-cd08-49dd-99ad-4b24cadfc3b9 · outbound

This paper cites Curie: Toward Rigorous and Automated Scientific Experimentation with AI Agents.

AI Scientists Fail Without Strong Implementation Capability Curie: Toward Rigorous and Automated Scientific Experimentation with AI Agents

Reference 2009

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.336587Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.336587Z digest=sha256:617fa996bdaa3a90ae27f3e3981d2a0a2b2b437634dad7271293a9f458d653bc

Observation 8a0a26d8-9c2c-4f9e-96fc-38ad2251bbf6 · outbound

This paper cites s1: Simple test-time scaling.

AI Scientists Fail Without Strong Implementation Capability s1: Simple test-time scaling

Reference 2013

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:04.160309Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:04.160309Z digest=sha256:e6fab3139c3c06e2b64868069800b492c915e203344a5d01d17a0a8a917d57e7

Observation e8702435-4ef3-41b9-805c-cb0e4c488351 · outbound

This paper cites Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent System.

AI Scientists Fail Without Strong Implementation Capability Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent System

Reference 2020

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:05.903065Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:05.903065Z digest=sha256:62c4f67505ca74805dc9df75cac5d272944d9f18b7cab2f8daae1aff73ead2ab

Observation c8c668d9-075d-4330-9d09-355f19274d50 · outbound

This paper cites Scaling Laws for Neural Language Models.

AI Scientists Fail Without Strong Implementation Capability Scaling Laws for Neural Language Models

Reference 2021

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:03.210248Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:03.210248Z digest=sha256:a0625bdb2437784f80914d53b393ab4a6fc4677c884e2c61a09f179c4961cff6

Observation db1dceec-20e1-46cb-88b5-1ec12348c48d · outbound

This paper cites Genome modeling and design across all domains of life with evo 2.BioRxiv, pages 2025–02,.

AI Scientists Fail Without Strong Implementation Capability Genome modeling and design across all domains of life with evo 2.BioRxiv, pages 2025–02,

Reference 2023

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T11:49:12.529426Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T11:49:01.262343Z digest=sha256:6ed4f0c976784609183110e742818cc376d07c622ed4d0095a767bf7027b08c7

Observation e37c7520-1da2-45ef-b12a-a850c6209bd6 · outbound

This paper cites Muhammad Arslan, Hussam Ghanem, Saba Munawar, and Christophe Cruz.

AI Scientists Fail Without Strong Implementation Capability Muhammad Arslan, Hussam Ghanem, Saba Munawar, and Christophe Cruz

Reference 2024

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T11:49:12.763454Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T11:49:00.848110Z digest=sha256:5e3100c9fbb17fe0ef68dc69d69a614f75086aa3c6b6c06340f9f0688ce7b6a1

Observation 03c1fc2a-f737-4294-88ae-31b39d749740 · outbound

This paper cites SWE-Bench+: Enhanced Coding Benchmark for LLMs.

AI Scientists Fail Without Strong Implementation Capability SWE-Bench+: Enhanced Coding Benchmark for LLMs

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-07T11:49:00.759281Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:49:00.759281Z digest=sha256:26e084fdc1bd037a3e2322b4570578b4f5a42309eb551afb3897defa3747b93a

Pith citing papers

Observation 97cfaa6a-2bb8-435e-9301-ba03667c0551 · inbound

NanoResearch: Co-Evolving Skills, Memory, and Policy for Personalized Research Automation cites this paper.

NanoResearch: Co-Evolving Skills, Memory, and Policy for Personalized Research Automation AI Scientists Fail Without Strong Implementation Capability

Reference 37

Resolution
metadata mismatch
arxiv_id, observed 2026-05-12T06:31:27.256386Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-12T04:12:49.742272Z digest=sha256:2027ccdc597d2679b7d37dfa5041edcf6c1a6a3f4945fe5a40c90e161721d005

Observation f88f855f-8dd1-40e0-8d56-2bd040ecf91c · inbound

MLReplicate: Benchmarking Autonomous Research Systems for Machine Learning Reproducibility cites this paper.

MLReplicate: Benchmarking Autonomous Research Systems for Machine Learning Reproducibility AI Scientists Fail Without Strong Implementation Capability

Reference 41

Resolution
verified exact
arxiv_id, observed 2026-05-20T20:03:44.063892Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-20T19:59:40.519962Z digest=sha256:c27b81f0e86dba223a65839ea554510d0aac28c9eb4218a6b8ebfa83350029e7

Observation 86739275-b7ef-446e-9e91-d13888aeffe3 · inbound

One Run Is Not an Idea: The Implementation Lottery in Automated Research cites this paper.

One Run Is Not an Idea: The Implementation Lottery in Automated Research AI Scientists Fail Without Strong Implementation Capability

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-01T12:50:06.841591Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T12:50:06.841591Z digest=sha256:5ae09ca1a0821b3ae1f28403b69f18dcce40cbf7adf77c94ab3a8518c6575ff9