Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-07T11:49:08.589917Z
Paper Citation Record · LEDGER
As of 8 August 2026, this Paper Citation Record lists 65 of 65 outbound references and 3 inbound Pith citation observations for arXiv:2506.01372.
A citation records a reference. It does not transfer a finding from one paper to another.
Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-07T11:49:08.589917Z
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links, observed 2026-08-01T12:50:06.841591Z
A source-named dated measurement, never combined with another source.
Source: arxiv_reference, observed 2026-05-20T20:03:44.060778Z
65 of 65 outbound references displayed
External citation measurements
No source-named external measurement is stored.
Observation 585cbaa4-8e54-47fb-9164-e43527107246 · outbound
AI Scientists Fail Without Strong Implementation Capability The relationship between reasoning and performance in large language models--o3 (mini) thinks harder, not longer
Reference 3
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 455fb266-b19a-4eb2-9f40-29ccbf107ead · outbound
AI Scientists Fail Without Strong Implementation Capability Superintelligent Agents Pose Catastrophic Risks: Can Scientist AI Offer a Safer Path?
Reference 4
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6207316a-2237-4f4b-a5fe-c563dc2dee76 · outbound
AI Scientists Fail Without Strong Implementation Capability Why Do Multi-Agent LLM Systems Fail?
Reference 6
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 089f937e-d284-4d45-9032-4f160e40483b · outbound
AI Scientists Fail Without Strong Implementation Capability MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering
Reference 7
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 876f5b07-7c47-418d-aa72-f9fd5c158357 · outbound
AI Scientists Fail Without Strong Implementation Capability Evaluating Large Language Models Trained on Code
Reference 8
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation eacc1515-4c04-404b-8f86-dd730f5c796a · outbound
AI Scientists Fail Without Strong Implementation Capability Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment
Reference 9
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c24984a8-a972-4069-9cd9-29a63c0180ac · outbound
AI Scientists Fail Without Strong Implementation Capability IRIS: Interactive Research Ideation System for Accelerating Scientific Discovery
Reference 10
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 241d67cb-b175-4b1e-a3be-e5dc6f1f587a · outbound
AI Scientists Fail Without Strong Implementation Capability SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoning
Reference 11
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e2855918-989d-414d-9544-9df08d6fe3ee · outbound
AI Scientists Fail Without Strong Implementation Capability Towards an AI co-scientist
Reference 12
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 60bd406f-dec0-4d74-b55c-44969e5dc4f0 · outbound
AI Scientists Fail Without Strong Implementation Capability LLMs can Realize Combinatorial Creativity: Generating Creative Ideas via LLMs for Scientific Research
Reference 13
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 11fd7b30-7776-474d-914b-ffb838c06046 · outbound
AI Scientists Fail Without Strong Implementation Capability Large Language Model based Multi-Agents: A Survey of Progress and Challenges
Reference 14
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation cc8fcd72-2d9b-4c9e-9ac9-88fbd7848eca · outbound
AI Scientists Fail Without Strong Implementation Capability PaSa: An LLM Agent for Comprehensive Academic Paper Search
Reference 15
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9c3c27de-bd74-4666-b467-a0261a7fe174 · outbound
AI Scientists Fail Without Strong Implementation Capability Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directions
Reference 16
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6ac99bae-9e1e-44f1-a113-6689bd9d5262 · outbound
AI Scientists Fail Without Strong Implementation Capability Nova: An Iterative Planning and Search Approach to Enhance Novelty and Diversity of LLM Generated Ideas
Reference 17
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f6d4187c-14cb-48e7-9afa-2a8043bb77aa · outbound
AI Scientists Fail Without Strong Implementation Capability LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
Reference 18
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a76b139d-8395-4ad3-bb58-e36029c73cb7 · outbound
AI Scientists Fail Without Strong Implementation Capability CodeScientist: End-to-End Semi-Automated Scientific Discovery with Code-based Experimentation
Reference 19
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c02ca024-d610-4280-b654-bec0e03fb7f3 · outbound
AI Scientists Fail Without Strong Implementation Capability AIDE: AI-Driven Exploration in the Space of Code
Reference 20
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 204eeaaa-4a33-449e-8507-3885c6d0c685 · outbound
AI Scientists Fail Without Strong Implementation Capability LLMs Get Lost In Multi-Turn Conversation
Reference 23
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a2d5485d-3adc-4870-9c40-39e4f57dea87 · outbound
AI Scientists Fail Without Strong Implementation Capability DrugAgent: Automating AI-aided Drug Discovery Programming through LLM Multi-Agent Collaboration
Reference 25
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6a05857c-d6ba-441d-967d-6954f3293163 · outbound
AI Scientists Fail Without Strong Implementation Capability AIGS: Generating Science from AI-Powered Automated Falsification
Reference 26
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 235aaf50-4cd0-46de-b0e1-be7201172ac7 · outbound
AI Scientists Fail Without Strong Implementation Capability The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
Reference 27
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation aded90f8-1b0e-468e-93ab-0942d7935376 · outbound
AI Scientists Fail Without Strong Implementation Capability Sparks of Science: Hypothesis Generation Using Structured Paper Data
Reference 29
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0beef106-8e32-460f-ac4f-fb8be80c23bf · outbound
AI Scientists Fail Without Strong Implementation Capability ML-Dev-Bench: Comparative Analysis of AI Agents on ML development workflows
Reference 30
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2361c1dc-27d8-4b59-8ae5-bf3f0db8e94a · outbound
AI Scientists Fail Without Strong Implementation Capability Ideasynth: Iterative research idea development through evolving and composing idea facets with literature-grounded feedback
Reference 31
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6c18ebcd-7e77-4f2e-aa9a-5068916d1ea1 · outbound
AI Scientists Fail Without Strong Implementation Capability Iterative Hypothesis Generation for Scientific Discovery with Monte Carlo Nash Equilibrium Self-Refining Trees
Reference 32
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e6c7066e-a501-4827-89d2-c129711fd55f · outbound
AI Scientists Fail Without Strong Implementation Capability Human-LLM Compound System for Scientific Ideation through Facet Recombination and Novelty Evaluation
Reference 33
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 39e3ba0f-4d41-4365-b62e-6c2cc684661d · outbound
AI Scientists Fail Without Strong Implementation Capability AstroAgents: A Multi-Agent AI for Hypothesis Generation from Mass Spectrometry Data
Reference 34
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 7d38d89a-c551-41ae-b75d-4196d32e43b5 · outbound
AI Scientists Fail Without Strong Implementation Capability Spark: A System for Scientifically Creative Idea Generation
Reference 35
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation cc5ffc26-7b64-4ee9-a7e9-e83c1cd9c747 · outbound
AI Scientists Fail Without Strong Implementation Capability Agent Laboratory: Using LLM Agents as Research Assistants
Reference 36
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 30edacd1-f051-4d43-991f-dc5313864317 · outbound
AI Scientists Fail Without Strong Implementation Capability Paper2code: Automating code generation from scientific papers in machine learning.arXiv preprint arXiv:2504.17192,
Reference 37
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 73dccdd8-c7f9-4942-a0aa-e64bb379a31b · outbound
AI Scientists Fail Without Strong Implementation Capability ShortcutsBench: A Large-Scale Real-world Benchmark for API-based Agents
Reference 38
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 45f7760b-c717-4a88-9d42-87d77cc67b1e · outbound
AI Scientists Fail Without Strong Implementation Capability Canllmsgeneratenovelresearchideas? Alarge-scalehuman study with 100+ NLP researchers
Reference 39
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 02fe6701-6a4d-4a7d-9d10-30c697994b52 · outbound
AI Scientists Fail Without Strong Implementation Capability CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmark
Reference 40
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 697ba589-c9bd-428e-9c24-33fdf2a7200f · outbound
AI Scientists Fail Without Strong Implementation Capability PaperBench: Evaluating AI's Ability to Replicate AI Research
Reference 41
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation de0a2467-344b-4148-9fc7-a3d9826f11f3 · outbound
AI Scientists Fail Without Strong Implementation Capability ZeroSearch: Incentivize the Search Capability of LLMs without Searching
Reference 43
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 84be6792-5dfa-49f8-92da-dcfd78801cc6 · outbound
AI Scientists Fail Without Strong Implementation Capability SciPIP: An LLM-based Scientific Paper Idea Proposer
Reference 44
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 43e630c0-337e-430f-94d1-27ccad2cdf6e · outbound
AI Scientists Fail Without Strong Implementation Capability Large language models are better reasoners with self-verification
Reference 45
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b3a60b3c-a999-42e4-8cf4-12660257330c · outbound
AI Scientists Fail Without Strong Implementation Capability Shifting Long-Context LLMs Research from Input to Output
Reference 46
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 8fdc8173-864d-447b-9033-9030ba33c6ee · outbound
AI Scientists Fail Without Strong Implementation Capability Improving Scientific Hypothesis Generation with Knowledge Grounded Large Language Models
Reference 47
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 3749524d-2ac7-4278-af41-25adaf01aefa · outbound
AI Scientists Fail Without Strong Implementation Capability The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search
Reference 48
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2e2b4c57-17d5-4d04-b0f0-534c632e87cc · outbound
AI Scientists Fail Without Strong Implementation Capability Qwen3 Technical Report
Reference 49
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ac39e507-a84f-499d-85d7-57c8fcc4520f · outbound
AI Scientists Fail Without Strong Implementation Capability ResearchTown: Simulator of Human Research Community
Reference 50
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation bd66b695-43eb-4d03-a77a-27df4917229c · outbound
AI Scientists Fail Without Strong Implementation Capability Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback
Reference 51
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c0e1b13b-fb6f-4693-bfb9-df451bed8998 · outbound
AI Scientists Fail Without Strong Implementation Capability A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?
Reference 52
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ac38bdae-467d-4f26-842e-a8c00a2581cc · outbound
AI Scientists Fail Without Strong Implementation Capability OpenResearcher: Unleashing AI for Accelerated Scientific Research
Reference 53
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 65160443-072e-4bf0-b947-7d4a503fc407 · outbound
AI Scientists Fail Without Strong Implementation Capability DeepReview: Improving LLM-based Paper Review with Human-like Deep Thinking Process
Reference 54
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 22ce0db0-4cfd-4eba-9b78-1bf14c45e807 · outbound
AI Scientists Fail Without Strong Implementation Capability Unresolved cited work
Reference 55
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 9f75f9e0-8ad2-49d0-9c37-ae48a51465cb · outbound
AI Scientists Fail Without Strong Implementation Capability 20 AI Scientists Fail Without Strong Implementation Capability
Reference 56
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation da08517b-7ead-4848-8887-6e2a8692ecee · outbound
AI Scientists Fail Without Strong Implementation Capability Unresolved cited work
Reference 57
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 915f0bc9-9492-486b-b8a0-8002cdd1da20 · outbound
AI Scientists Fail Without Strong Implementation Capability Unresolved cited work
Reference 58
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation de53a12d-9fb8-474d-accd-d93fc7eb84f1 · outbound
AI Scientists Fail Without Strong Implementation Capability Unresolved cited work
Reference 59
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation fcf12ab1-8867-44de-bf73-2ff2ea178a2e · outbound
AI Scientists Fail Without Strong Implementation Capability Unresolved cited work
Reference 60
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation e9a5207f-ab4c-4ab9-bb35-e21f6bb3a22d · outbound
AI Scientists Fail Without Strong Implementation Capability Unresolved cited work
Reference 61
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 7891ea88-2462-4c41-9c95-90195d0ccbbb · outbound
AI Scientists Fail Without Strong Implementation Capability Unresolved cited work
Reference 62
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation d31021fc-58fb-40a7-bf35-a0eb1c798360 · outbound
AI Scientists Fail Without Strong Implementation Capability Unresolved cited work
Reference 63
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation a58418a2-43df-4c82-8413-ba25425592fb · outbound
AI Scientists Fail Without Strong Implementation Capability Unresolved cited work
Reference 64
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 25f635d1-381d-415d-9193-43ec5624fd91 · outbound
AI Scientists Fail Without Strong Implementation Capability Regarding the statistics for the papers We have conducted a comprehensive search on arXiv to gather relevant publications in the AI Scientist field
Reference 65
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 31bcb75f-f68b-4ef5-a051-1338c4ea2a27 · outbound
AI Scientists Fail Without Strong Implementation Capability Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents
Reference 1987
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 50602bd2-cd08-49dd-99ad-4b24cadfc3b9 · outbound
AI Scientists Fail Without Strong Implementation Capability Curie: Toward Rigorous and Automated Scientific Experimentation with AI Agents
Reference 2009
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 8a0a26d8-9c2c-4f9e-96fc-38ad2251bbf6 · outbound
AI Scientists Fail Without Strong Implementation Capability s1: Simple test-time scaling
Reference 2013
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e8702435-4ef3-41b9-805c-cb0e4c488351 · outbound
AI Scientists Fail Without Strong Implementation Capability Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent System
Reference 2020
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c8c668d9-075d-4330-9d09-355f19274d50 · outbound
AI Scientists Fail Without Strong Implementation Capability Scaling Laws for Neural Language Models
Reference 2021
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation db1dceec-20e1-46cb-88b5-1ec12348c48d · outbound
AI Scientists Fail Without Strong Implementation Capability Genome modeling and design across all domains of life with evo 2.BioRxiv, pages 2025–02,
Reference 2023
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation e37c7520-1da2-45ef-b12a-a850c6209bd6 · outbound
AI Scientists Fail Without Strong Implementation Capability Muhammad Arslan, Hussam Ghanem, Saba Munawar, and Christophe Cruz
Reference 2024
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 03c1fc2a-f737-4294-88ae-31b39d749740 · outbound
AI Scientists Fail Without Strong Implementation Capability SWE-Bench+: Enhanced Coding Benchmark for LLMs
Reference 2025
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 97cfaa6a-2bb8-435e-9301-ba03667c0551 · inbound
NanoResearch: Co-Evolving Skills, Memory, and Policy for Personalized Research Automation AI Scientists Fail Without Strong Implementation Capability
Reference 37
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation f88f855f-8dd1-40e0-8d56-2bd040ecf91c · inbound
MLReplicate: Benchmarking Autonomous Research Systems for Machine Learning Reproducibility AI Scientists Fail Without Strong Implementation Capability
Reference 41
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 86739275-b7ef-446e-9e91-d13888aeffe3 · inbound
One Run Is Not an Idea: The Implementation Lottery in Automated Research AI Scientists Fail Without Strong Implementation Capability
Reference 27
Source-reported events for the cited work
Unavailable: canonical work link unavailable.