Paper Citation Record · LEDGER

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents

As of 12 August 2026, this Paper Citation Record lists 44 of 44 outbound references and 2 inbound Pith citation observations for arXiv:2606.04874.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2606.04874 v2

Coverage vector

measured 44 of 44 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-06-28T06:05:07.776116Z

measured 46 of 46 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-12T06:34:41.77262+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-11T04:17:33.443440Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-10T05:52:48.238137Z

Reference resolution

44 of 44 outbound references displayed

verified exact1
verified fuzzy0
unresolved38
parse uncertain0
malformed identifier2
metadata mismatch3

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 3d5f425c-ef36-497f-af9a-83b6ce8e5419 · outbound

This paper cites Advances in Neural Information Processing Systems, 36:28091–28114.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Advances in Neural Information Processing Systems, 36:28091–28114

Reference 1

Resolution: verified exact; arxiv_id, observed 2026-07-02T08:26:47.888157Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation c43ba5a4-5330-4031-a955-0254076ee984 · outbound

This paper cites Agent AI: Surveying the Horizons of Multimodal Interaction.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Agent AI: Surveying the Horizons of Multimodal Interaction

Reference 2

Resolution: metadata mismatch; local_arxiv, observed 2026-07-02T08:26:47.882476Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 639eb42d-a1c6-4dc0-afb3-01fef177c005 · outbound

This paper cites Voyager: An Open-Ended Embodied Agent with Large Language Models.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Voyager: An Open-Ended Embodied Agent with Large Language Models

Reference 3

Resolution: metadata mismatch; local_arxiv, observed 2026-07-02T08:26:47.890484Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 6543bdea-cbc9-4372-9f24-2cce824ebc34 · outbound

This paper cites WebArena: A Realistic Web Environment for Building Autonomous Agents.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents WebArena: A Realistic Web Environment for Building Autonomous Agents

Reference 4

Resolution: metadata mismatch; local_arxiv, observed 2026-07-02T08:26:47.885530Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation be25760c-5dc5-4558-80c8-82dcb39c024e · outbound

This paper cites an unresolved cited work.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Unresolved cited work

Reference 5

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 281378de-0044-400f-be37-62cde4a4744a · outbound

This paper cites an unresolved cited work.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Unresolved cited work

Reference 6

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7b5746a7-004f-4de7-96e3-c3d13f10c969 · outbound

This paper cites an unresolved cited work.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Unresolved cited work

Reference 7

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5620a73a-1c81-4269-bc94-4e140b9f8f21 · outbound

This paper cites an unresolved cited work.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Unresolved cited work

Reference 8

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 031fe367-dbe4-4ec5-8232-d61ee3984076 · outbound

This paper cites Does [X]. Parameters: ’param1’ (string, required) - . . . Returns . . . Notes:.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Does [X]. Parameters: ’param1’ (string, required) - . . . Returns . . . Notes:

Reference 9

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f0a379d4-01a4-4067-ba2a-e7c7aa08717a · outbound

This paper cites I first analyzed.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents I first analyzed

Reference 10

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1ce68a84-8b8d-40d2-90b3-b4eeba0d99d4 · outbound

This paper cites - DO NOT just add suffixes like ‘_v2’, ‘_new’, ‘_alt’, ‘_1’, etc.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents - DO NOT just add suffixes like ‘_v2’, ‘_new’, ‘_alt’, ‘_1’, etc

Reference 11

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f386984c-6a34-451a-973b-a0dc5ff98948 · outbound

This paper cites an unresolved cited work.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Unresolved cited work

Reference 12

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 24757e40-eae0-47e3-b96b-e105a29c24b7 · outbound

This paper cites an unresolved cited work.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Unresolved cited work

Reference 13

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 75de49d9-b568-4989-bd16-9f8c1b62c2d0 · outbound

This paper cites tool_name.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents tool_name

Reference 14

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5e83c4ea-85da-4c81-a99c-9df799f541a6 · outbound

This paper cites First, I would obtain the exact sunset time.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents First, I would obtain the exact sunset time

Reference 15

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1ff2a26f-167e-4bb8-a946-4f8e117a0e2e · outbound

This paper cites (Sequence of 14 tools) Figure 23: Data transformation example: converting step-wise trajectory into descriptivePlanwith extractedTool Chainfor holistic planning ground truth.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents (Sequence of 14 tools) Figure 23: Data transformation example: converting step-wise trajectory into descriptivePlanwith extractedTool Chainfor holistic planning ground truth

Reference 16

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f2a2c8f5-fcd9-4d53-92e2-bbef121cc31c · outbound

This paper cites filter by date.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents filter by date

Reference 17

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 196533ff-457e-4201-9508-7d8c924f5485 · outbound

This paper cites an unresolved cited work.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Unresolved cited work

Reference 18

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 394f5ffe-1ffd-4f93-aa4c-288d6bdfe35d · outbound

This paper cites Please search for the nearest open pizza place... All interface interactions must be executed through registered interaction handlers.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Please search for the nearest open pizza place... All interface interactions must be executed through registered interaction handlers

Reference 19

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fcece7da-21e0-49e5-8a97-79d63043f397 · outbound

This paper cites Please search for the nearest open pizza place to my home on Google Maps.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Please search for the nearest open pizza place to my home on Google Maps

Reference 20

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9c572ef4-9999-4cde-bb07-1617975432c1 · outbound

This paper cites •Check:Does the predicted step align with the main query objective? Does it follow the logical progression established by previous steps? •Examples:.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents •Check:Does the predicted step align with the main query objective? Does it follow the logical progression established by previous steps? •Examples:

Reference 21

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 46c6bcc4-9523-4534-9113-4663d288a204 · outbound

This paper cites •Check:Are all required sub-tasks completed? Does the step try to answer before gathering all necessary information? •Examples:.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents •Check:Are all required sub-tasks completed? Does the step try to answer before gathering all necessary information? •Examples:

Reference 22

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3ac0d8ad-954a-472f-b2fb-90e693c3c6a8 · outbound

This paper cites •Check:Does the step respect all specified constraints (time range, data source, format, method, etc.)? Does it follow the required output structure? •Examples:.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents •Check:Does the step respect all specified constraints (time range, data source, format, method, etc.)? Does it follow the required output structure? •Examples:

Reference 23

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f31a9e91-4815-4c57-961f-d54d2b6017c0 · outbound

This paper cites •Check:Does the step use non-existent data? Does it ignore already-obtained data? Is the reasoning flow logical? •Examples:.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents •Check:Does the step use non-existent data? Does it ignore already-obtained data? Is the reasoning flow logical? •Examples:

Reference 24

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b6715f60-fb82-48c8-b6ed-ab9495f5a327 · outbound

This paper cites •Check:Does the tool call match the tool’s specification? Are parameter types correct? Are required parameters present? •Examples:.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents •Check:Does the tool call match the tool’s specification? Are parameter types correct? Are required parameters present? •Examples:

Reference 25

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a7677a4c-a8fa-48f7-8aea-5f43428350cf · outbound

This paper cites optimal" or.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents optimal" or

Reference 26

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7e9d3448-15de-4ff7-92bd-f0d04c7b2c77 · outbound

This paper cites plan" (string) and.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents plan" (string) and

Reference 27

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f6560ef2-632b-483a-b57f-afbb8c31e8a0 · outbound

This paper cites name": (string) The exact name of the tool to be called. •.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents name": (string) The exact name of the tool to be called. •

Reference 28

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c562fe08-1521-4e58-a5a5-7fcee1f47f3c · outbound

This paper cites parameter_description.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents parameter_description

Reference 29

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 35c7e62e-9bb9-4f4d-a345-62d235513809 · outbound

This paper cites an unresolved cited work.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Unresolved cited work

Reference 30

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c7e9827c-731d-4682-9a1e-7db53637c4e2 · outbound

This paper cites an unresolved cited work.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Unresolved cited work

Reference 31

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 774ec799-c518-46f1-8b4a-b5cb97c85b4c · outbound

This paper cites an unresolved cited work.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Unresolved cited work

Reference 32

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0e8f3a72-6b39-4f5c-bc60-ed06b2eae933 · outbound

This paper cites an unresolved cited work.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Unresolved cited work

Reference 33

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 156d3aba-645b-443b-a6bd-c4e6f8635a6b · outbound

This paper cites an unresolved cited work.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Unresolved cited work

Reference 34

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1f7d12bf-37f6-4dcf-a11c-077dac303dcf · outbound

This paper cites On the right track.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents On the right track

Reference 35

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 62119a8b-537a-40c5-b551-e7fba4fafbb5 · outbound

This paper cites Analyze this UI,.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Analyze this UI,

Reference 36

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a264f0d7-1d36-4ac4-ba82-6fab1fb84374 · outbound

This paper cites is_correct.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents is_correct

Reference 37

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1fcee5b8-f705-4977-b31e-33cd8ec0cf24 · outbound

This paper cites is_correct.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents is_correct

Reference 38

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 64d2b75c-d94c-487e-843a-28e962e92b4b · outbound

This paper cites the price we discussed.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents the price we discussed

Reference 39

Resolution: malformed identifier; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 42852a76-132b-426a-a84a-febef94370c3 · outbound

This paper cites I want to buy a PS5 for each child in the photo. I need to know the exact total cost including sales tax (8.5%).

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents I want to buy a PS5 for each child in the photo. I need to know the exact total cost including sales tax (8.5%)

Reference 40

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation eed00b9d-44e6-4e3b-82d3-fe49299267e4 · outbound

This paper cites I need to analyze Apple’s stock performance across multiple milestones. First, find when Apple stock first crossed $50.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents I need to analyze Apple’s stock performance across multiple milestones. First, find when Apple stock first crossed $50

Reference 41

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 226ae8a3-3a10-4fe6-bf88-ed2b56b489c8 · outbound

This paper cites Can you explain this meme and help me understand its cultural context?.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents Can you explain this meme and help me understand its cultural context?

Reference 42

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 261e1ff2-16db-4ae3-9fa7-40bc3616cf15 · outbound

This paper cites I’m starting a new technology consulting company and need to find suitable office space in San Francisco’s Financial District.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents I’m starting a new technology consulting company and need to find suitable office space in San Francisco’s Financial District

Reference 43

Resolution: unresolved; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c93dbdc0-2e5d-4992-9b26-6c6c92c3e251 · outbound

This paper cites I’m dining at this beachfront restaurant and need a detailed expense breakdown.

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents I’m dining at this beachfront restaurant and need a detailed expense breakdown

Reference 44

Resolution: malformed identifier; no resolver link, observed 2026-06-28T06:05:07.776116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation aaeede7f-642d-4d82-8cfc-e039574f507f · inbound

$A^2E$ : An End-to-End Agent Auditing Engine cites this paper.

$A^2E$ : An End-to-End Agent Auditing Engine Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents

Reference 2023

Resolution: verified exact; local_arxiv, observed 2026-08-10T05:52:48.244282Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 1c1740ba-fc59-48e7-98d1-19196a995173 · inbound

$A^2E$ : An End-to-End Agent Auditing Engine cites this paper.

$A^2E$ : An End-to-End Agent Auditing Engine Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents

Reference 2023

Resolution: unresolved; no resolver link, observed 2026-08-11T04:17:33.443440Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.