Paper Citation Record · LEDGER

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities

As of 8 August 2026, this Paper Citation Record lists 38 of 38 outbound references and 3 inbound Pith citation observations for arXiv:2509.03331.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2509.03331 v1

Coverage vector

measured 38 of 38 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-05T11:02:54.374219Z

measured 41 of 41 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-05T00:36:36.484575Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T21:10:09.278283Z

Reference resolution

38 of 38 outbound references displayed

verified exact2
verified fuzzy6
unresolved28
parse uncertain0
malformed identifier0
metadata mismatch2

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 1fe78373-78ef-4580-897d-c3f6e6f9c67d · outbound

This paper cites git-apply Documentation.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities git-apply Documentation

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T11:02:55.504115Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation aae13449-36d6-4e44-82e8-f001940e9357 · outbound

This paper cites patch Command – IBM AIX Documentation.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities patch Command – IBM AIX Documentation

Reference 2

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T11:02:55.489752Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 3335d6c9-997a-4a55-abf1-39b619b0fd84 · outbound

This paper cites SecVulEval: Benchmarking LLMs for Real-World C/C++ Vulnerability Detection.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities SecVulEval: Benchmarking LLMs for Real-World C/C++ Vulnerability Detection

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-05T11:02:54.227103Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6aa13417-3567-4b24-87c2-647a4f7da1e2 · outbound

This paper cites an unresolved cited work.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Unresolved cited work

Reference 4

Resolution: unresolved; raw_fallback, observed 2026-08-05T11:02:55.474274Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation fcf7e0e2-84fd-43bc-b1f0-4d209fe7434f · outbound

This paper cites an unresolved cited work.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Unresolved cited work

Reference 5

Resolution: metadata mismatch; raw_fallback, observed 2026-08-05T11:02:55.159079Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 2160a1e4-ca25-49b7-84aa-d9015e8f31ae · outbound

This paper cites Smith, Donald Stufft.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Smith, Donald Stufft

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T11:02:55.457829Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 51f3abce-3622-4da9-baa8-ec4d4fca65e7 · outbound

This paper cites Díaz Ferreyra.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Díaz Ferreyra

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T11:02:55.441769Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation fa455ae8-adb9-4dee-9914-3948c20a4cd3 · outbound

This paper cites Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-05T11:02:54.257899Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 32531a87-5e05-4bb2-9c9f-a93a7e93b598 · outbound

This paper cites an unresolved cited work.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Unresolved cited work

Reference 9

Resolution: unresolved; raw_fallback, observed 2026-08-05T11:02:55.426094Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation ccacb866-ac59-4ebe-a5de-aad7dd7a32c3 · outbound

This paper cites 2024.{PentestGPT}: Evaluating and harnessing large language models for automated penetration testing.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities 2024.{PentestGPT}: Evaluating and harnessing large language models for automated penetration testing

Reference 10

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T11:02:55.410264Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 9975aef7-e0ce-43ae-bcf8-fa8bb060bcba · outbound

This paper cites DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-05T11:02:54.270368Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation eda7427e-65f4-4ccb-a686-4742b5b712b8 · outbound

This paper cites SoK: Automated Vulnerability Repair: Methods, Tools, and Assessments.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities SoK: Automated Vulnerability Repair: Methods, Tools, and Assessments

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-05T11:02:54.274440Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 78c2840b-a16b-462f-8517-8453d680abe7 · outbound

This paper cites GPT-4o System Card.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities GPT-4o System Card

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-05T11:02:54.278555Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fa2a095b-71c5-4e85-9e5c-17d13bc37afb · outbound

This paper cites SWE-bench: Can Language Models Resolve Real-World GitHub Issues?.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-05T11:02:54.282800Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c5ce7e3e-d9f2-482e-8a85-40c6ff2a6991 · outbound

This paper cites an unresolved cited work.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Unresolved cited work

Reference 15

Resolution: verified exact; doi, observed 2026-08-05T11:02:54.433629Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 94b8e3ec-25f3-4208-a029-5e9f5af06b14 · outbound

This paper cites DeepSeek-V3 Technical Report.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities DeepSeek-V3 Technical Report

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-05T11:02:54.290488Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b19cda7d-ec03-4ea9-a087-29efc38f48da · outbound

This paper cites an unresolved cited work.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Unresolved cited work

Reference 17

Resolution: verified exact; raw_fallback, observed 2026-08-05T11:02:54.868133Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation daf00636-cbd1-45d5-af4b-823bc58e582e · outbound

This paper cites an unresolved cited work.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Unresolved cited work

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-05T11:02:54.298556Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5c25037c-6566-4125-9537-c9bb6f45048b · outbound

This paper cites an unresolved cited work.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Unresolved cited work

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-05T11:02:54.302738Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f87cfc28-6fc0-4aef-b2b0-e21b1884ea57 · outbound

This paper cites an unresolved cited work.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Unresolved cited work

Reference 20

Resolution: unresolved; raw_fallback, observed 2026-08-05T11:02:55.394487Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 638c9e38-958c-4a99-8720-cfd443933dee · outbound

This paper cites an unresolved cited work.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Unresolved cited work

Reference 21

Resolution: unresolved; raw_fallback, observed 2026-08-05T11:02:55.378799Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation dd2a5acd-51d3-4125-9988-298a3e56e04c · outbound

This paper cites an unresolved cited work.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Unresolved cited work

Reference 22

Resolution: unresolved; raw_fallback, observed 2026-08-05T11:02:55.360546Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation dae2b195-b9f8-4b0a-bf7a-c0d0fe8dace1 · outbound

This paper cites an unresolved cited work.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Unresolved cited work

Reference 23

Resolution: unresolved; raw_fallback, observed 2026-08-05T11:02:55.345392Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 894ea19f-28fb-40ab-82a3-0d38da2b47f9 · outbound

This paper cites an unresolved cited work.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Unresolved cited work

Reference 24

Resolution: unresolved; raw_fallback, observed 2026-08-05T11:02:55.330514Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation d68be404-6158-48e5-84aa-bd3386653d12 · outbound

This paper cites Are Large Language Models Robust in Understanding Code Against Semantics-Preserving Mutations?.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Are Large Language Models Robust in Understanding Code Against Semantics-Preserving Mutations?

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-05T11:02:54.326649Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4027879f-411b-4ce2-82d8-470bf078a7db · outbound

This paper cites PoCGen: Generating Proof-of-Concept Exploits for Vulnerabilities in Npm Packages.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities PoCGen: Generating Proof-of-Concept Exploits for Vulnerabilities in Npm Packages

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-05T11:02:54.330975Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 93938fae-9036-4db6-8c12-d5deee521d12 · outbound

This paper cites an unresolved cited work.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Unresolved cited work

Reference 27

Resolution: unresolved; raw_fallback, observed 2026-08-05T11:02:55.314977Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation d0b7014b-3e98-4d3c-af4d-aa9436733ee1 · outbound

This paper cites an unresolved cited work.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Unresolved cited work

Reference 28

Resolution: unresolved; raw_fallback, observed 2026-08-05T11:02:55.296795Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 8a98f66b-e71a-4e1a-ac0c-fdf38f97bfa9 · outbound

This paper cites an unresolved cited work.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Unresolved cited work

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-05T11:02:54.344033Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9cd4b76a-358a-491e-9a76-0e1296531cd4 · outbound

This paper cites an unresolved cited work.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Unresolved cited work

Reference 30

Resolution: metadata mismatch; raw_fallback, observed 2026-08-05T11:02:54.738213Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation fbd3072f-6bfa-4d4c-a6dc-f74e563abc10 · outbound

This paper cites Chi, Quoc V.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Chi, Quoc V

Reference 31

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T11:02:55.268973Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 9acab7d4-dcaa-44f8-956e-afa3feefab96 · outbound

This paper cites SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-05T11:02:54.356699Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4510945b-4e26-41f5-82ba-5f17b02228d2 · outbound

This paper cites an unresolved cited work.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Unresolved cited work

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-05T11:02:54.361313Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6bec30c8-092d-490b-9c66-b16ad0df4e5b · outbound

This paper cites Qwen3 Technical Report.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Qwen3 Technical Report

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-05T11:02:54.365718Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 70468bcb-b603-4346-9b14-e217fe97db3e · outbound

This paper cites SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-05T11:02:54.369975Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4eee2536-09a9-429d-a48e-5bb0e504d29c · outbound

This paper cites BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-05T11:02:54.374219Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5ae84726-e274-437f-98ff-e1aace6cfe89 · outbound

This paper cites an unresolved cited work.

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities Unresolved cited work

Reference 468

Resolution: unresolved; no resolver link, observed 2026-08-05T11:02:54.253699Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0e0f64d6-918a-46ff-974b-6e73324bd0a2 · outbound

This paper cites In Proceedings of the 20th International Confer- ence on Predictive Models and Data Analytics in Software Engineering (PROMISE 2024).

VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities In Proceedings of the 20th International Confer- ence on Predictive Models and Data Analytics in Software Engineering (PROMISE 2024)

Reference 2024

Resolution: unresolved; no resolver link, observed 2026-08-05T11:02:54.236609Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation b7c6bc9d-3adf-4169-8b9d-9aa773a4d679 · inbound

Towards Demystifying and Repairing LLM-in-the-Loop Vulnerabilities cites this paper.

Towards Demystifying and Repairing LLM-in-the-Loop Vulnerabilities VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities

Reference 53

Resolution: verified exact; arxiv_id, observed 2026-06-29T11:23:20.652423Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation d7933b54-82de-45c3-a3a0-052065f36990 · inbound

Helpful or Harmful? Evaluating LLM-Assisted Vulnerability Patching via a Human Study cites this paper.

Helpful or Harmful? Evaluating LLM-Assisted Vulnerability Patching via a Human Study VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities

Reference 3

Resolution: verified exact; arxiv_id, observed 2026-07-04T21:10:09.279825Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 61821484-3ea5-4605-8978-8c3a73778f7f · inbound

Vul4Py: Benchmarking Automated Vulnerability Repair in Python with Paired Exploit and Functional Oracles cites this paper.

Vul4Py: Benchmarking Automated Vulnerability Repair in Python with Paired Exploit and Functional Oracles VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-05T00:36:36.484575Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.