Paper Citation Record · LEDGER

Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

As of 21 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 27 inbound Pith citation observations for arXiv:2503.15223.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2503.15223 v2

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 27 of 27 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-21T06:32:19.484+00:00

measured 27 of 27 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-15T14:19:13.956774Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-05T02:28:24.338817Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

0
pith, observed 2026-08-05T02:28:24.338817Z

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation d89b4802-2211-4cec-8568-d7359c9aa919 · inbound

Trae Agent: An LLM-based Agent for Software Engineering with Test-time Scaling cites this paper.

Trae Agent: An LLM-based Agent for Software Engineering with Test-time Scaling Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-06T10:53:18.510011Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4cee0014-9392-4f07-9982-04ee7f154975 · inbound

Agentic Software Engineering: Foundational Pillars and a Research Roadmap cites this paper.

Agentic Software Engineering: Foundational Pillars and a Research Roadmap Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-04T23:57:08.447520Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 181e0df5-ae8d-493e-befe-a87d3bf1337b · inbound

Can Old Tests Do New Tricks for Resolving SWE Issues? cites this paper.

Can Old Tests Do New Tricks for Resolving SWE Issues? Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 40

Resolution: verified exact; arxiv_id, observed 2026-05-18T05:30:55.273906Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 88ccafba-5760-4efb-9404-32d69b56285e · inbound

Agentic Much? Adoption of Coding Agents on GitHub cites this paper.

Agentic Much? Adoption of Coding Agents on GitHub Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 40

Resolution: verified exact; arxiv_id, observed 2026-05-16T11:00:52.322201Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 46f7fdbd-3369-4292-9950-60479aea3380 · inbound

Automated Table Reproduction via Code Generation cites this paper.

Automated Table Reproduction via Code Generation Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-03T02:41:37.325201Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 564bc2f0-c49f-4060-9b4c-43c2a8c511e9 · inbound

Debug2Fix: Can Interactive Debugging Help Coding Agents Fix More Bugs? cites this paper.

Debug2Fix: Can Interactive Debugging Help Coding Agents Fix More Bugs? Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 11

Resolution: verified exact; arxiv_id, observed 2026-05-15T20:20:17.814417Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 09fb02dc-7eb1-461b-a44f-76cfed4d9d77 · inbound

Beyond Fixed Tests: Repository-Level Issue Resolution as Coevolution of Code and Behavioral Constraints cites this paper.

Beyond Fixed Tests: Repository-Level Issue Resolution as Coevolution of Code and Behavioral Constraints Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 48

Resolution: verified exact; arxiv_id, observed 2026-05-10T22:10:47.901901Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 991f3fe1-2101-4642-8c1d-f6678b76a275 · inbound

SOCIA-EVO: Automated Simulator Construction via Dual-Anchored Bi-Level Optimization cites this paper.

SOCIA-EVO: Automated Simulator Construction via Dual-Anchored Bi-Level Optimization Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 110

Resolution: verified exact; arxiv_id, observed 2026-05-10T06:41:36.200720Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 149e70fb-444d-4d18-b185-b3524a546178 · inbound

LLM-Oriented Information Retrieval: A Denoising-First Perspective cites this paper.

LLM-Oriented Information Retrieval: A Denoising-First Perspective Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 189

Resolution: verified exact; arxiv_id, observed 2026-05-11T16:01:20.242371Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 18153e72-f5a4-4250-86cd-c4f2f0fd02de · inbound

LLM-Oriented Information Retrieval: A Denoising-First Perspective cites this paper.

LLM-Oriented Information Retrieval: A Denoising-First Perspective Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 196

Resolution: verified exact; arxiv_id, observed 2026-05-21T00:19:16.514700Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 96da9926-0689-40ad-96b1-0a91b4a23dc7 · inbound

Can Agent Benchmarks Support Their Scores? Evidence-Supported Bounds for Interactive-Agent Evaluation cites this paper.

Can Agent Benchmarks Support Their Scores? Evidence-Supported Bounds for Interactive-Agent Evaluation Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 24

Resolution: verified exact; arxiv_id, observed 2026-05-12T05:41:24.023340Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 5c3613a1-fbce-4235-a046-17d859a9b48d · inbound

From Patches to Trajectories: Privileged Process Supervision for Software-Engineering Agents cites this paper.

From Patches to Trajectories: Privileged Process Supervision for Software-Engineering Agents Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 19

Resolution: verified exact; arxiv_id, observed 2026-05-22T05:14:37.662764Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation e02f9660-9386-4a51-b5a6-4bdbdcfededb · inbound

Design and Report Benchmarks for Knowledge Work cites this paper.

Design and Report Benchmarks for Knowledge Work Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 131

Resolution: verified exact; arxiv_id, observed 2026-05-25T04:40:22.746489Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 88721836-3b9e-40f8-91fc-804bd5dd121a · inbound

Reducing Token Usage of State-in-Context Agents using Minification cites this paper.

Reducing Token Usage of State-in-Context Agents using Minification Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 17

Resolution: verified exact; arxiv_id, observed 2026-06-28T16:42:23.385812Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 5e51bc8d-0825-41f2-bac9-128311e28b91 · inbound

Human oversight of agentic systems in practice: Examining the oversight work, challenges, and heuristics of developers using software agents cites this paper.

Human oversight of agentic systems in practice: Examining the oversight work, challenges, and heuristics of developers using software agents Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 141

Resolution: verified exact; arxiv_id, observed 2026-06-28T05:01:39.791579Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation e8564adc-8dce-48fa-9c9e-eb3602eb9791 · inbound

Position: Coding Benchmarks Are Misaligned with Agentic Software Engineering cites this paper.

Position: Coding Benchmarks Are Misaligned with Agentic Software Engineering Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 46

Resolution: verified exact; arxiv_id, observed 2026-07-03T22:08:58.910015Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation b8f73a78-f93c-42a8-9cff-9f445b744dff · inbound

Position: Coding Benchmarks Are Misaligned with Agentic Software Engineering cites this paper.

Position: Coding Benchmarks Are Misaligned with Agentic Software Engineering Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 46

Resolution: unresolved; no resolver link, observed 2026-08-02T11:06:03.705479Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6838def5-60ba-4936-92a0-f57cfaefa223 · inbound

Agentic Hardware Design as Repository-Level Code Evolution cites this paper.

Agentic Hardware Design as Repository-Level Code Evolution Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 20

Resolution: metadata mismatch; arxiv_id, observed 2026-07-01T18:45:58.316125Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 0525c222-92df-4326-a555-5af6b5b84fee · inbound

Benchmarking Code Improvement with Progressive, Adaptive, and Interactive Feedback cites this paper.

Benchmarking Code Improvement with Progressive, Adaptive, and Interactive Feedback Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 8

Resolution: verified exact; arxiv_id, observed 2026-07-03T19:28:51.859271Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation f9d4c3f7-8477-4a86-ab49-eb5f2c3cf23c · inbound

Benchmarking Code Improvement with Progressive, Adaptive, and Interactive Feedback cites this paper.

Benchmarking Code Improvement with Progressive, Adaptive, and Interactive Feedback Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 9

Resolution: metadata mismatch; arxiv_id, observed 2026-07-03T19:28:51.387866Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 7a51405c-e9df-4c7c-8bd5-6549ae43b2ec · inbound

What Resolve Rate Hides: Trajectory Structure Diagnostics for Coding Agents cites this paper.

What Resolve Rate Hides: Trajectory Structure Diagnostics for Coding Agents Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 5

Resolution: verified exact; local_arxiv, observed 2026-07-08T14:25:02.498286Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 45b64a01-6d10-4c11-a845-3caf0c5b2861 · inbound

What Resolve Rate Hides: Trajectory Structure Diagnostics for Coding Agents cites this paper.

What Resolve Rate Hides: Trajectory Structure Diagnostics for Coding Agents Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 6

Resolution: metadata mismatch; local_arxiv, observed 2026-07-08T14:25:02.402763Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 19872504-8901-4ccb-8c45-a316ec55e1b2 · inbound

Know Before Fix: QA-Driven Repository Knowledge Acquisition for Software Issue Resolution cites this paper.

Know Before Fix: QA-Driven Repository Knowledge Acquisition for Software Issue Resolution Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 37

Resolution: unresolved; no resolver link, observed 2026-07-14T06:59:44.621968Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0803f7ff-2a2c-40da-beff-7aa357dc0ccd · inbound

How Benchmarks Mis-Score Computer-Use Agents cites this paper.

How Benchmarks Mis-Score Computer-Use Agents Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 8

Resolution: unresolved; no resolver link, observed 2026-07-31T09:36:42.713914Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ae50e4a3-a343-4070-b4b9-e100bc33a25c · inbound

PAIChecker: Uncovering and Checking PR-Issue Misalignment in SWE-Bench-Like Benchmarks cites this paper.

PAIChecker: Uncovering and Checking PR-Issue Misalignment in SWE-Bench-Like Benchmarks Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-05T04:24:46.132778Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9a2f02d2-5ee1-4303-83f9-b10ec55959bb · inbound

The Horizon Gap: Planning, Memory, Execution, Training, and Evaluation for Long-Horizon LLM Agents cites this paper.

The Horizon Gap: Planning, Memory, Execution, Training, and Evaluation for Long-Horizon LLM Agents Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-10T23:01:35.474552Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7c35d54b-82b3-4d5d-85f2-ddb367d14286 · inbound

Agent Safety Should Be a Runtime Contract cites this paper.

Agent Safety Should Be a Runtime Contract Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Study

Reference 93

Resolution: unresolved; no resolver link, observed 2026-08-15T14:19:13.956774Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.