Paper Citation Record · LEDGER

BenchGuard: Who Guards the Benchmarks? Automated Auditing of LLM Agent Benchmarks

As of 5 August 2026, this Paper Citation Record lists 5 of 5 outbound references and 5 inbound Pith citation observations for arXiv:2604.24955.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2604.24955 v1

Coverage vector

measured 5 of 5 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-05-08T03:30:55.419225Z

measured 10 of 10 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-05T06:32:48.257954+00:00

measured 5 of 5 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-02T14:53:54.893111Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-05-14T20:32:56.827813Z

Reference resolution

5 of 5 outbound references displayed

verified exact3
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch2

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation bb5f9a46-0b98-4801-b6f3-9316f41b18e0 · outbound

This paper cites Ziru Chen, Shijie Chen, Yuting Ning, Qianheng Zhang, Boshi Wang, Botao Yu, Yifei Li, Zeyi Liao, Chen Wei, Zitong Lu, Vishal Dey, Mingyi Xue, Frazier N.

BenchGuard: Who Guards the Benchmarks? Automated Auditing of LLM Agent Benchmarks Ziru Chen, Shijie Chen, Yuting Ning, Qianheng Zhang, Boshi Wang, Botao Yu, Yifei Li, Zeyi Liao, Chen Wei, Zitong Lu, Vishal Dey, Mingyi Xue, Frazier N

Reference 1

Resolution: verified exact; doi, observed 2026-05-09T00:24:28.380005Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 8a715fd2-2bac-4910-894c-15bc19f02fca · outbound

This paper cites Proceedings of the 2025.

BenchGuard: Who Guards the Benchmarks? Automated Auditing of LLM Agent Benchmarks Proceedings of the 2025

Reference 2

Resolution: verified exact; doi, observed 2026-05-09T00:24:28.387336Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 8ac8b491-a2b7-4f4f-aff5-06f596c06d5f · outbound

This paper cites Jansson and Steven M.

BenchGuard: Who Guards the Benchmarks? Automated Auditing of LLM Agent Benchmarks Jansson and Steven M

Reference 3

Resolution: verified exact; doi, observed 2026-05-09T00:24:28.383454Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 7c42cf42-5dbb-4319-9999-5b6baa1e85c7 · outbound

This paper cites Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing.

BenchGuard: Who Guards the Benchmarks? Automated Auditing of LLM Agent Benchmarks Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing

Reference 4

Resolution: metadata mismatch; doi, observed 2026-05-09T00:24:28.374426Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 954bd355-01ed-4240-a08c-369ca313ce8e · outbound

This paper cites LLM Critics Help Catch LLM Bugs.

BenchGuard: Who Guards the Benchmarks? Automated Auditing of LLM Agent Benchmarks LLM Critics Help Catch LLM Bugs

Reference 5

Resolution: metadata mismatch; arxiv_id, observed 2026-05-09T00:24:28.369167Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Pith citing papers

Observation 0ab24ec6-9037-4b5e-9bf8-233154454a43 · inbound

D3-Gym: Constructing Real-World Verifiable Environments for Data-Driven Discovery cites this paper.

D3-Gym: Constructing Real-World Verifiable Environments for Data-Driven Discovery BenchGuard: Who Guards the Benchmarks? Automated Auditing of LLM Agent Benchmarks

Reference 4

Resolution: malformed identifier; local_arxiv, observed 2026-05-09T04:50:11.921338Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 5952ca91-70db-4f34-acdd-d10eddcb4323 · inbound

AuditRepairBench: A Paired-Execution Trace Corpus for Evaluator-Channel Ranking Instability in Agent Repair cites this paper.

AuditRepairBench: A Paired-Execution Trace Corpus for Evaluator-Channel Ranking Instability in Agent Repair BenchGuard: Who Guards the Benchmarks? Automated Auditing of LLM Agent Benchmarks

Reference 53

Resolution: verified exact; local_arxiv, observed 2026-05-11T17:11:07.694606Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 1274377b-70ea-4238-85da-811204810912 · inbound

AuditRepairBench: A Paired-Execution Trace Corpus for Evaluator-Channel Ranking Instability in Agent Repair cites this paper.

AuditRepairBench: A Paired-Execution Trace Corpus for Evaluator-Channel Ranking Instability in Agent Repair BenchGuard: Who Guards the Benchmarks? Automated Auditing of LLM Agent Benchmarks

Reference 53

Resolution: unresolved; no resolver link, observed 2026-08-02T14:53:54.893111Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f8358352-54c7-4d15-a484-b46f2d7741a9 · inbound

Do Androids Dream of Breaking the Game? Systematically Auditing AI Agent Benchmarks with BenchJack cites this paper.

Do Androids Dream of Breaking the Game? Systematically Auditing AI Agent Benchmarks with BenchJack BenchGuard: Who Guards the Benchmarks? Automated Auditing of LLM Agent Benchmarks

Reference 54

Resolution: verified exact; local_arxiv, observed 2026-05-14T20:32:56.830494Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 232bb22d-d1e1-423c-958b-43a7223beb6b · inbound

Automated Transcript Analysis for Detecting Flaws in Agentic Benchmarks cites this paper.

Automated Transcript Analysis for Detecting Flaws in Agentic Benchmarks BenchGuard: Who Guards the Benchmarks? Automated Auditing of LLM Agent Benchmarks

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-01T06:24:59.579784Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.