Paper Citation Record · LEDGER

Specification Grounding Drives Test Effectiveness for LLM Code

As of 21 August 2026, this Paper Citation Record lists 23 of 23 outbound references and 0 inbound Pith citation observations for arXiv:2607.06636.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2607.06636 v1

Coverage vector

measured 23 of 23 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-07-11T00:51:00.099499Z

measured 23 of 23 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-21T06:32:19.484+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

23 of 23 outbound references displayed

verified exact5
verified fuzzy17
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 18ced049-54cc-44bf-bc4b-dfa73f6dbd16 · outbound

This paper cites Program Synthesis with Large Language Models.

Specification Grounding Drives Test Effectiveness for LLM Code Program Synthesis with Large Language Models

Reference 1

Resolution: verified exact; local_arxiv, observed 2026-07-11T00:57:42.229796Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 90c7f3e3-64d8-498e-b576-77bada4def34 · outbound

This paper cites Barr, Mark Harman, Phil McMinn, Muzammil Shahbaz, and Shin Yoo.

Specification Grounding Drives Test Effectiveness for LLM Code Barr, Mark Harman, Phil McMinn, Muzammil Shahbaz, and Shin Yoo

Reference 2

Resolution: verified fuzzy; raw_fallback, observed 2026-07-11T00:57:44.742097Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 807c3622-8771-43fa-a43e-2ec72e5c3cc3 · outbound

This paper cites CodeT : Code generation with generated tests.

Specification Grounding Drives Test Effectiveness for LLM Code CodeT : Code generation with generated tests

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-07-11T00:57:44.703171Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation fe755f8a-0428-42ba-813c-7b741e59448b · outbound

This paper cites Evaluating Large Language Models Trained on Code.

Specification Grounding Drives Test Effectiveness for LLM Code Evaluating Large Language Models Trained on Code

Reference 4

Resolution: verified exact; local_arxiv, observed 2026-07-11T00:57:42.209053Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation a3ccc7b2-b11d-4d14-bf6c-7c921931fd59 · outbound

This paper cites Teaching large language models to self-debug.

Specification Grounding Drives Test Effectiveness for LLM Code Teaching large language models to self-debug

Reference 5

Resolution: verified fuzzy; raw_fallback, observed 2026-07-11T00:57:44.741578Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation f1ea7651-03d9-4a73-9fb4-9dcaf485e75b · outbound

This paper cites QuickCheck : A lightweight tool for random testing of Haskell programs.

Specification Grounding Drives Test Effectiveness for LLM Code QuickCheck : A lightweight tool for random testing of Haskell programs

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-07-11T00:57:44.698325Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation a8227cb4-ac82-4173-b9ef-77f670e0dccb · outbound

This paper cites Selective classification for deep neural networks.

Specification Grounding Drives Test Effectiveness for LLM Code Selective classification for deep neural networks

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-07-11T00:57:44.511296Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 0fccd5ac-d18c-44ee-8079-a754ac592f49 · outbound

This paper cites Large language models cannot self-correct reasoning yet.

Specification Grounding Drives Test Effectiveness for LLM Code Large language models cannot self-correct reasoning yet

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-07-11T00:57:44.762344Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation ec7bdfc3-b19b-4762-86ec-ac971b864a55 · outbound

This paper cites Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik Narasimhan.

Specification Grounding Drives Test Effectiveness for LLM Code Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik Narasimhan

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-07-11T00:57:44.634363Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation c6a1faa0-07e3-4cef-a5a1-8a6c36dcc17c · outbound

This paper cites Interactive Code Generation via Test-Driven User-Intent Formalization.

Specification Grounding Drives Test Effectiveness for LLM Code Interactive Code Generation via Test-Driven User-Intent Formalization

Reference 10

Resolution: metadata mismatch; local_arxiv, observed 2026-07-11T00:57:42.220834Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 2a9b4abe-73fb-48cb-a49b-66ffcca98aa0 · outbound

This paper cites Automated program repair.

Specification Grounding Drives Test Effectiveness for LLM Code Automated program repair

Reference 11

Resolution: verified fuzzy; raw_fallback, observed 2026-07-11T00:57:44.553040Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation f269747e-b7cb-4d24-beff-d11f6b30e62a · outbound

This paper cites Rustan M.

Specification Grounding Drives Test Effectiveness for LLM Code Rustan M

Reference 12

Resolution: verified fuzzy; raw_fallback, observed 2026-07-11T00:57:44.784593Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 3139d840-7ad2-42c9-ad15-c3628af7a3b6 · outbound

This paper cites Is your code generated by ChatGPT really correct? rigorous evaluation of large language models for code generation.

Specification Grounding Drives Test Effectiveness for LLM Code Is your code generated by ChatGPT really correct? rigorous evaluation of large language models for code generation

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-07-11T00:57:44.634836Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 6eed79ab-7505-46bd-b8ab-837fab07b990 · outbound

This paper cites Self-refine: Iterative refinement with self-feedback.

Specification Grounding Drives Test Effectiveness for LLM Code Self-refine: Iterative refinement with self-feedback

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-07-11T00:57:44.720664Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 2ec58a2c-4985-4b4e-b380-d6db75aa6e2d · outbound

This paper cites Applying ``design by contract''.

Specification Grounding Drives Test Effectiveness for LLM Code Applying ``design by contract''

Reference 15

Resolution: verified fuzzy; raw_fallback, observed 2026-07-11T00:57:44.804671Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation e853258a-e462-4993-a42f-33d620cb5a45 · outbound

This paper cites Wang, and Xi Victoria Lin.

Specification Grounding Drives Test Effectiveness for LLM Code Wang, and Xi Victoria Lin

Reference 16

Resolution: verified fuzzy; raw_fallback, observed 2026-07-11T00:57:44.592151Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 4feb195b-af34-4dce-86cf-ab60336b8493 · outbound

This paper cites Code as Agent Harness.

Specification Grounding Drives Test Effectiveness for LLM Code Code as Agent Harness

Reference 17

Resolution: verified exact; local_arxiv, observed 2026-07-11T00:57:42.254847Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 81295b76-5c62-4e3f-b36f-b14811dfe54e · outbound

This paper cites Olausson, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao, and Armando Solar-Lezama.

Specification Grounding Drives Test Effectiveness for LLM Code Olausson, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao, and Armando Solar-Lezama

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-07-11T00:57:44.526191Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 6b10baaa-6987-44a3-8794-10622ec23b9a · outbound

This paper cites Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering.

Specification Grounding Drives Test Effectiveness for LLM Code Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering

Reference 19

Resolution: verified exact; local_arxiv, observed 2026-07-11T00:57:42.166859Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation c8778059-64eb-4452-a5a7-bd69056e1f59 · outbound

This paper cites Code Llama: Open Foundation Models for Code.

Specification Grounding Drives Test Effectiveness for LLM Code Code Llama: Open Foundation Models for Code

Reference 20

Resolution: verified exact; local_arxiv, observed 2026-07-11T00:57:42.187173Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 68c6b764-5532-43f4-beb9-f94e534058ed · outbound

This paper cites Reflexion: Language agents with verbal reinforcement learning.

Specification Grounding Drives Test Effectiveness for LLM Code Reflexion: Language agents with verbal reinforcement learning

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-07-11T00:57:44.656740Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation d029648e-9111-4ca8-9ccf-0cac2dc62982 · outbound

This paper cites Jimenez, Alexander Wettig, Kilian Lieret, Shunyu Yao, Karthik Narasimhan, and Ofir Press.

Specification Grounding Drives Test Effectiveness for LLM Code Jimenez, Alexander Wettig, Kilian Lieret, Shunyu Yao, Karthik Narasimhan, and Ofir Press

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-07-11T00:57:44.762741Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 420a1065-235d-4494-83c1-cabb7bf434e4 · outbound

This paper cites Judging LLM -as-a-judge with MT -bench and chatbot arena.

Specification Grounding Drives Test Effectiveness for LLM Code Judging LLM -as-a-judge with MT -bench and chatbot arena

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-07-11T00:57:44.784278Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Pith citing papers

No inbound Pith citation observations are available.