Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-05-13T03:53:45.241047Z
Paper Citation Record · LEDGER
Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues
As of 6 August 2026, this Paper Citation Record lists 19 of 19 outbound references and 0 inbound Pith citation observations for arXiv:2605.12270.
A citation records a reference. It does not transfer a finding from one paper to another.
Coverage vector
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-06T06:34:29.942622+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links
A source-named dated measurement, never combined with another source.
Source: cited_works
Reference resolution
19 of 19 outbound references displayed
- verified exact1
- verified fuzzy10
- unresolved8
- parse uncertain0
- malformed identifier0
- metadata mismatch0
External citation measurements
No source-named external measurement is stored.
Outbound references
Observation bb4887ac-9f07-49ac-ad6d-f599b2fe86a8 · outbound
This paper cites This reduces context switching and allows reviewers to develop a repository- specific understanding of coding conventions, architectural patterns, and implicit design assumptions.
Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues This reduces context switching and allows reviewers to develop a repository- specific understanding of coding conventions, architectural patterns, and implicit design assumptions
Reference 1
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-13T12:17:44.092045Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 1cd26b34-1829-44dc-88b0-a6bedc90e291 · outbound
This paper cites Within each repository, tasks are analyzed in ascending order of total failure count, starting from tasks with fewer failed attempts and progressing to more difficult ones.
Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues Within each repository, tasks are analyzed in ascending order of total failure count, starting from tasks with fewer failed attempts and progressing to more difficult ones
Reference 2
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-13T12:17:44.125361Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation d6fae161-c64b-46e8-9f5a-1c5cfaafee22 · outbound
This paper cites an unresolved cited work.
Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues Unresolved cited work
Reference 3
- Resolution
- unresolved
- raw_fallback, observed 2026-05-13T12:17:44.113600Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation ad4304b4-da3a-490e-b00d-d96730776a5a · outbound
This paper cites This enables analysis of sur- rounding control flow, hidden dependencies, and framework- specific constraints that may not be visible from the patch alone.
Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues This enables analysis of sur- rounding control flow, hidden dependencies, and framework- specific constraints that may not be visible from the patch alone
Reference 4
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-13T12:17:44.121433Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 4d57a5bf-a7cf-4d3b-b5b4-715008703ac1 · outbound
This paper cites an unresolved cited work.
Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues Unresolved cited work
Reference 5
- Resolution
- unresolved
- raw_fallback, observed 2026-05-13T12:17:44.096620Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 6e1b7457-a4c2-4598-bc13-9dbeba8ae6b1 · outbound
This paper cites A patch is considered semantically correct only when multiple reviewers confirm that it satisfies the issue description and aligns with the intent of the reference solution.
Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues A patch is considered semantically correct only when multiple reviewers confirm that it satisfies the issue description and aligns with the intent of the reference solution
Reference 6
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-13T12:17:44.115775Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 29a91f0b-c931-4c37-b20f-b00ff4c66c22 · outbound
This paper cites strict format mismatch.
Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues strict format mismatch
Reference 7
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-13T12:17:44.103891Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 04e95f74-7aad-4005-9b88-2614533b521f · outbound
This paper cites an unresolved cited work.
Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues Unresolved cited work
Reference 9
- Resolution
- unresolved
- raw_fallback, observed 2026-05-13T12:17:44.094622Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 699a339d-a534-4810-89aa-44bf73264049 · outbound
This paper cites an unresolved cited work.
Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues Unresolved cited work
Reference 10
- Resolution
- unresolved
- raw_fallback, observed 2026-05-13T12:17:44.127873Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 008e55d2-26c6-4865-8710-6bf13fb204a8 · outbound
This paper cites Abstract Large language models are increasingly employed for repository- level coding tasks, yet the root causes of their failures remain poorly understood.
Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues Abstract Large language models are increasingly employed for repository- level coding tasks, yet the root causes of their failures remain poorly understood
Reference 11
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-13T12:17:44.101889Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 916d06bb-5e6e-46cb-84bc-63040c22d300 · outbound
This paper cites Immediate eval in__init__ Backups original ref.
Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues Immediate eval in__init__ Backups original ref
Reference 12
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-13T12:17:44.105849Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 98257028-136b-4604-b5c5-55b8b4d8bb1f · outbound
This paper cites 3Pass: Accesses instance.
Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues 3Pass: Accesses instance
Reference 13
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-13T12:17:44.099773Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 658b4d49-d98d-4606-8073-774d0da594d6 · outbound
This paper cites 3Pass: Uses backup ref.
Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues 3Pass: Uses backup ref
Reference 14
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-13T12:17:44.108058Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation bf19c86b-8971-4b03-8bbf-468430d54d3f · outbound
This paper cites an unresolved cited work.
Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues Unresolved cited work
Reference 15
- Resolution
- unresolved
- raw_fallback, observed 2026-05-13T12:17:44.111807Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation b2dbbee5-575e-4ac2-8b6b-d65448080bab · outbound
This paper cites an unresolved cited work.
Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues Unresolved cited work
Reference 16
- Resolution
- unresolved
- raw_fallback, observed 2026-05-13T12:17:44.119419Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 9c20316b-d17b-45a4-9767-3d12656899d6 · outbound
This paper cites an unresolved cited work.
Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues Unresolved cited work
Reference 17
- Resolution
- unresolved
- raw_fallback, observed 2026-05-13T12:17:44.123201Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation efff0b30-a677-46c7-91ec-2d0bbf4c7495 · outbound
This paper cites Failures often manifest as isolated crashes far from the root cause.
Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues Failures often manifest as isolated crashes far from the root cause
Reference 18
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-13T12:17:44.117743Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 8d4f184c-c73c-47f2-ada2-04322e0650d3 · outbound
This paper cites an unresolved cited work.
Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues Unresolved cited work
Reference 19
- Resolution
- unresolved
- raw_fallback, observed 2026-05-13T12:17:44.109936Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 9c98e5a7-ec9b-4e35-8e0d-8f4694c944de · outbound
This paper cites SWE-bench: Can Language Models Resolve Real-World GitHub Issues?.
Characterizing the Failure Modes of LLMs in Resolving Real-World GitHub Issues SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
Reference 20
- Resolution
- verified exact
- local_arxiv, observed 2026-05-13T03:57:13.570757Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Pith citing papers
No inbound Pith citation observations are available.