Paper Citation Record · LEDGER

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch

As of 23 August 2026, this Paper Citation Record lists 32 of 32 outbound references and 0 inbound Pith citation observations for arXiv:2608.01715.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2608.01715 v1

Coverage vector

measured 32 of 32 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-04T22:23:18.449185Z

measured 32 of 32 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-23T06:30:58.430688+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

32 of 32 outbound references displayed

verified exact5
verified fuzzy16
unresolved9
parse uncertain0
malformed identifier1
metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 1846ae45-7404-433a-90a5-9fe986ed1d3e · outbound

This paper cites ClaudeCode:AnAgenticCodingToolfortheTerminal.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch ClaudeCode:AnAgenticCodingToolfortheTerminal

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-04T22:23:23.078822Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 79ac956d-89ca-4ca7-974c-917cf0afda1f · outbound

This paper cites Claude Opus 4.8.https://www.anthropic.com/news/claude-opus-4-8, 2026.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Claude Opus 4.8.https://www.anthropic.com/news/claude-opus-4-8, 2026

Reference 2

Resolution: verified fuzzy; raw_fallback, observed 2026-08-04T22:23:22.906694Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 92bfd690-6947-4750-872d-cef1b6c1b37d · outbound

This paper cites Codecontests-o: Powering llms via feedback-driven iterative test case generation.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Codecontests-o: Powering llms via feedback-driven iterative test case generation

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-08-04T22:23:22.695487Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 939ed675-3d3a-49c1-acf7-588c8bbfa030 · outbound

This paper cites Can llms generate reliable test case generators? a study on competition-level programming problems, 2025.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Can llms generate reliable test case generators? a study on competition-level programming problems, 2025

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-04T22:23:15.477265Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 97eda75e-f171-4461-98c0-76e623f6e977 · outbound

This paper cites Codet: Code generation with generated tests.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Codet: Code generation with generated tests

Reference 5

Resolution: verified fuzzy; raw_fallback, observed 2026-08-04T22:23:22.505709Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation de222aa3-2388-4437-aac6-16084ac28244 · outbound

This paper cites an unresolved cited work.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Unresolved cited work

Reference 6

Resolution: unresolved; raw_fallback, observed 2026-08-04T22:23:22.267756Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation e648841f-8d2a-4b32-993b-577b359d78c0 · outbound

This paper cites Deepseek-v4: Towards highly efficient million-token context intelligence, 2026.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Deepseek-v4: Towards highly efficient million-token context intelligence, 2026

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-04T22:23:15.713080Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 58b5e466-6633-4e0a-9054-7ab05254309a · outbound

This paper cites Klear-CodeTest: Scalable Test Case Generation for Code Reinforcement Learning.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Klear-CodeTest: Scalable Test Case Generation for Code Reinforcement Learning

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-04T22:23:15.782639Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0abba0e1-298c-4178-ab30-239e0db3f0f0 · outbound

This paper cites Google Antigravity: An Agentic Development Platform.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Google Antigravity: An Agentic Development Platform

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-08-04T22:23:22.038791Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation f6f3fe3e-3eb4-4239-ae84-2f2f27991555 · outbound

This paper cites Gemini3.1ProModelCard.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Gemini3.1ProModelCard

Reference 10

Resolution: verified fuzzy; raw_fallback, observed 2026-08-04T22:23:21.859122Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 0aa7b6c7-458a-4bf8-a924-98bbb9ae9c7b · outbound

This paper cites HardTests: Synthesizing High-Quality Test Cases for LLM Coding.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch HardTests: Synthesizing High-Quality Test Cases for LLM Coding

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-04T22:23:16.109674Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6fc37dcc-076b-4765-98a7-47dcd6345f6f · outbound

This paper cites Solvita: Enhancing Large Language Models for Competitive Programming via Agentic Evolution.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Solvita: Enhancing Large Language Models for Competitive Programming via Agentic Evolution

Reference 12

Resolution: verified exact; local_arxiv, observed 2026-08-04T22:23:19.467825Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 9f574be9-edea-40d3-847e-17cf1cfa7cc3 · outbound

This paper cites TACO: Topics in Algorithmic COde generation dataset.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch TACO: Topics in Algorithmic COde generation dataset

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-04T22:23:16.315763Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5ec99d1c-a805-4ef5-8760-83e56ad43003 · outbound

This paper cites Mankowitz, Esme Sutherland Robson, Pushmeet Kohli, Nando de Fre- itas, Koray Kavukcuoglu, and Oriol Vinyals.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Mankowitz, Esme Sutherland Robson, Pushmeet Kohli, Nando de Fre- itas, Koray Kavukcuoglu, and Oriol Vinyals

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-04T22:23:16.441853Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7532c92d-b330-4446-b5c4-453196e95855 · outbound

This paper cites Is your code generated by chatgpt really correct? rigorous evaluation of large language models for code generation.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Is your code generated by chatgpt really correct? rigorous evaluation of large language models for code generation

Reference 15

Resolution: verified fuzzy; raw_fallback, observed 2026-08-04T22:23:21.643919Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 8be04a2a-a6ea-4297-8533-3daca015fc5a · outbound

This paper cites Zhang, Zhenpeng Chen, Federica Sarro, Mark Harman, Gang Huang, and Yun Ma.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Zhang, Zhenpeng Chen, Federica Sarro, Mark Harman, Gang Huang, and Yun Ma

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-04T22:23:16.654472Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 67eb9148-7542-43a7-a0d0-979ee25d25fc · outbound

This paper cites Zhang, Federica Sarro, Gang Huang, and Yun Ma.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Zhang, Federica Sarro, Gang Huang, and Yun Ma

Reference 17

Resolution: metadata mismatch; arxiv_id, observed 2026-08-04T22:23:19.233067Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 5f22e658-3ee1-47a4-a5da-81400cad444d · outbound

This paper cites Zhang, Mark Harman, Yudong Han, Yun Ma, Yihong Dong, Ge Li, and Gang Huang.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Zhang, Mark Harman, Yudong Han, Yun Ma, Yihong Dong, Ge Li, and Gang Huang

Reference 18

Resolution: verified exact; doi, observed 2026-08-04T22:23:21.499969Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 831fff94-a9cc-443e-8d17-1ccc07ed16be · outbound

This paper cites Codex CLI: A Lightweight Coding Agent for the Terminal.https://github.com/openai/ codex, 2025.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Codex CLI: A Lightweight Coding Agent for the Terminal.https://github.com/openai/ codex, 2025

Reference 19

Resolution: verified fuzzy; raw_fallback, observed 2026-08-04T22:23:21.321231Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 20ad7ae1-6cac-407b-8069-833dc68f1a39 · outbound

This paper cites GPT-5.4 Thinking System Card.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch GPT-5.4 Thinking System Card

Reference 20

Resolution: verified fuzzy; raw_fallback, observed 2026-08-04T22:23:21.133749Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation fca88a36-1f7e-4a88-8f3f-65e5bee16cb5 · outbound

This paper cites OpenCode: An Open-Source AI Coding Agent for the Terminal.https:// opencode.ai/, 2025.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch OpenCode: An Open-Source AI Coding Agent for the Terminal.https:// opencode.ai/, 2025

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-08-04T22:23:20.976827Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 2f18b3d6-b055-43e6-bb99-258452dcd23b · outbound

This paper cites Kung, Geert Janssen, Wei Zhang, Giacomo Domeniconi, Vladimir Zolotov, Julian Dolby, Jie Chen, Mihir R.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Kung, Geert Janssen, Wei Zhang, Giacomo Domeniconi, Vladimir Zolotov, Julian Dolby, Jie Chen, Mihir R

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-04T22:23:20.722909Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation b9b3f4e4-d1f6-494b-b976-2d7a6afdb3db · outbound

This paper cites Codehacker: Automated test case generation for detecting vulnerabilities in competitive programming solutions.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Codehacker: Automated test case generation for detecting vulnerabilities in competitive programming solutions

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-08-04T22:23:20.539913Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 9dd1da5b-34e4-44e7-8423-2d06e28ba81e · outbound

This paper cites Logicase: Effective test case generation from logicaldescriptionincompetitiveprogramming.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Logicase: Effective test case generation from logicaldescriptionincompetitiveprogramming

Reference 24

Resolution: verified exact; doi, observed 2026-08-04T22:23:18.798287Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 00a3011a-cb9a-470a-a6cf-ca323d0eb158 · outbound

This paper cites Co-evolving LLM coder and unit tester via reinforcement learning.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Co-evolving LLM coder and unit tester via reinforcement learning

Reference 25

Resolution: verified fuzzy; raw_fallback, observed 2026-08-04T22:23:20.357664Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 3ff0b0a6-083d-4b85-8d95-9008061ac267 · outbound

This paper cites Codecontests+: High-quality test case generation for competitive programming.Conference on Empirical Methods in Natural Language Processing,.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Codecontests+: High-quality test case generation for competitive programming.Conference on Empirical Methods in Natural Language Processing,

Reference 26

Resolution: verified fuzzy; raw_fallback, observed 2026-08-04T22:23:20.164460Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation d890f4df-2eee-4a47-850c-4faf06fd4129 · outbound

This paper cites Beyond Problem Solving: UOJ-Bench for Evaluating Code Generation, Hacking, and Repair in Competitive Programming.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Beyond Problem Solving: UOJ-Bench for Evaluating Code Generation, Hacking, and Repair in Competitive Programming

Reference 27

Resolution: verified exact; local_arxiv, observed 2026-08-04T22:23:19.019371Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 6b1edaaa-6fd5-4798-9007-adf871dfdb02 · outbound

This paper cites Jimenez, Alexander Wettig, Kilian Lieret, Shunyu Yao, Karthik Narasimhan, and Ofir Press.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Jimenez, Alexander Wettig, Kilian Lieret, Shunyu Yao, Karthik Narasimhan, and Ofir Press

Reference 28

Resolution: verified fuzzy; raw_fallback, observed 2026-08-04T22:23:20.033400Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation e45ec79c-5879-4031-a6ac-3a2f2c27ff7c · outbound

This paper cites Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure

Reference 29

Resolution: verified exact; local_arxiv, observed 2026-08-04T22:23:18.639334Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 02ad301b-70ce-4a63-b2f6-8f59e520555e · outbound

This paper cites Themis: Automated constraint- aware test synthesis framework for code reinforcement learning.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Themis: Automated constraint- aware test synthesis framework for code reinforcement learning

Reference 30

Resolution: verified fuzzy; raw_fallback, observed 2026-08-04T22:23:19.748134Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

Observation 47504924-afc0-4e3e-914d-a7200f344fd5 · outbound

This paper cites Autocode: Llms as problem setters for competitive programming, 2025.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch Autocode: Llms as problem setters for competitive programming, 2025

Reference 31

Resolution: malformed identifier; no resolver link, observed 2026-08-04T22:23:18.449185Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 79d8b6c6-2870-4d46-87f0-ef8c806f7fcb · outbound

This paper cites CodeContests+: High-Quality Test Case Generation for Competitive Programming.

Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch CodeContests+: High-Quality Test Case Generation for Competitive Programming

Reference 2025

Resolution: unresolved; no resolver link, observed 2026-08-04T22:23:17.906054Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.