Pith. sign in

Paper Citation Record · LEDGER

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents

As of 23 August 2026, this Paper Citation Record lists 25 of 25 outbound references and 0 inbound Pith citation observations for arXiv:2605.20530.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2605.20530 v2

Coverage vector

measured 25 of 25 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-06-30T17:52:14.944875Z

measured 25 of 25 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-23T06:30:58.430688+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

25 of 25 outbound references displayed

  • verified exact7
  • verified fuzzy2
  • unresolved15
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 43be1ac7-1ccc-4b65-9712-3673b929a5f6 · outbound

This paper cites online" 'onlinestring :=.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents online" 'onlinestring :=

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-07-08T07:24:43.740160Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:bd5bc0aede6b29547945f652471158a69042b9658707f1bf6f847e5ee58da1bb

Observation e7461f90-0761-432c-8464-06bdf04cc31a · outbound

This paper cites write newline.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents write newline

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-07-08T07:24:43.768884Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:87a22bf257c36241fe07c27f5a44a90a36551e953a301b1ba0d3a9fc80a03cac

Observation fc45c5fc-23de-43f1-8d67-9e4922312b01 · outbound

This paper cites Ask or Assume? Uncertainty-Aware Clarification-Seeking in Coding Agents.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents Ask or Assume? Uncertainty-Aware Clarification-Seeking in Coding Agents

Reference 3

Resolution
verified exact
local_arxiv, observed 2026-06-30T17:54:57.838207Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:614c24392cca3f36eeb108668f166b2a1198c8324578199a024d84c49e61bf27

Observation e85e6820-0f9c-4c67-b346-d004ea942085 · outbound

This paper cites an unresolved cited work.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-07-08T07:24:43.782067Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:b5f5edccfec453663de7767354b663fc7c52b1eaebd1f63bff21916b6776c8da

Observation 3beb556d-7cfd-4e6a-abc6-bdf65c531081 · outbound

This paper cites Why Do Multi-Agent LLM Systems Fail?.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents Why Do Multi-Agent LLM Systems Fail?

Reference 5

Resolution
metadata mismatch
local_arxiv, observed 2026-06-30T17:54:57.833585Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:9d73d63f128607f56da0a5a4862a3feca756de5e90d459264ccb7051733cf763

Observation 3052e105-407f-4edc-8f04-7b7c151b0c38 · outbound

This paper cites an unresolved cited work.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-07-08T07:24:43.763851Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:96ea1bb854cda3b983dff2361c65d138bb04f86d70db39584e5640e5d98f5b8b

Observation 651ad81a-7dd0-4460-8bf0-cbf64b77ce3d · outbound

This paper cites an unresolved cited work.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-07-08T07:24:43.774065Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:c8dceda4e1621f9699465efa51b866433d81e9adab138e3564c88182dfd27554

Observation 95388839-225e-4881-b068-cca7f21932bf · outbound

This paper cites Holistic agent leaderboard: The missing infrastructure for ai agent evaluation.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents Holistic agent leaderboard: The missing infrastructure for ai agent evaluation

Reference 8

Resolution
verified exact
arxiv_id, observed 2026-06-30T17:54:57.838641Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:466087ba14b5fba00a0c52851f9441818715bbd224e96bd3c178d7c4f095adc6

Observation d6b4966e-61c6-4bd0-b72e-1bd7582b77c7 · outbound

This paper cites AI Agents That Matter.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents AI Agents That Matter

Reference 9

Resolution
verified exact
arxiv_id, observed 2026-06-30T17:54:57.841290Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:829395a9835160761cbbaac00eb39efc672386c4197ae4c3d0e4b3834e03a1b2

Observation 13aaa927-2bd5-42e6-b1fd-00646f1abfeb · outbound

This paper cites an unresolved cited work.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-07-08T07:24:43.758945Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:6b42a0a356e6fb6adb9e928ce0e0eb4c4f47c65744a8c53cd5d90f6b76eb52b9

Observation 98e1f0e2-50c8-4302-9408-f5403f7a0ec9 · outbound

This paper cites an unresolved cited work.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents Unresolved cited work

Reference 11

Resolution
unresolved
raw_fallback, observed 2026-07-08T07:24:43.761398Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:7f53baf743c642beffd87bb79241e0c607b01845d5712b5b964d118c1662d5fd

Observation 284c6389-acd5-45e1-b047-6d8a3871222f · outbound

This paper cites an unresolved cited work.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-07-08T07:24:43.766277Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:9f9a279426e3ef4bc2691d06f329b5050d033705745f76a7cff73927834e2ae3

Observation 1508867e-de20-4be9-b4e3-fbfadd577f49 · outbound

This paper cites AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents

Reference 13

Resolution
verified exact
arxiv_id, observed 2026-06-30T17:54:57.825258Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:1059d2a81ab23b4a9fb93083f512e2b9c791ce3b2ddb2e6513f7fa8d5489590d

Observation 5f3f9286-45e2-4eda-9514-3d468078c252 · outbound

This paper cites an unresolved cited work.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-07-08T07:24:43.750549Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:efa6c7a6ab0523af1ffa36f4d3d6a526d3d96ddf43a2df7f27445972d3467937

Observation e181b54d-56bd-4cd8-b301-248587b08ab5 · outbound

This paper cites an unresolved cited work.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-07-08T07:24:43.771545Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:06e07fbf50dc5c052f0b95ec0ea07147f65d75d2a315d6ae8ae0942796c42643

Observation b06df924-8d51-4654-a74c-4e0edefe88b3 · outbound

This paper cites an unresolved cited work.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-07-08T07:24:43.752923Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:b7b042f4d4318c04bedfa1ebe44c4df81e11dffa6897280d96176814fcb007e9

Observation 30b916e1-2fa2-4f4d-acde-da073e221b97 · outbound

This paper cites OSWorld-Human: Benchmarking the Efficiency of Computer-Use Agents.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents OSWorld-Human: Benchmarking the Efficiency of Computer-Use Agents

Reference 17

Resolution
verified exact
local_arxiv, observed 2026-06-30T17:54:57.828136Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:25fcf90578a25243c2e3a1d7be718d1b9eb706a40221486c64999e8028e34b23

Observation 1a40c8cb-a20d-409d-9f01-5afa7c5533cf · outbound

This paper cites an unresolved cited work.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-07-08T07:24:43.779476Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:56e8da8c1c8e51f3fcd752e4ff3f7a8b9295dadbe733cfe49f24d06b857c5cab

Observation 431d7285-567b-49db-8056-a7ecd2e3f6b5 · outbound

This paper cites an unresolved cited work.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-07-08T07:24:43.776846Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:8add4b8c97f74f394c5469abaf3dc323b3ef13d8abca2155965350b2ce597578

Observation 1e0029f7-78d4-4672-a257-4585f0553391 · outbound

This paper cites an unresolved cited work.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-07-08T07:24:43.747922Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:8454351bf308bcb4ec108d3cca54847194f0ad289ee1e689855c944531dc4ec5

Observation 2efaeb29-3418-4c71-b22d-aedd66465712 · outbound

This paper cites an unresolved cited work.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-07-08T07:24:43.756084Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:dadc98bf022fcc349cf299bcd4b275d0035fc5fe5937d5086c6752dd6608f770

Observation 8b76128d-7d76-4b4e-b0b8-bf77fde8b618 · outbound

This paper cites Survey on Evaluation of LLM-based Agents.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents Survey on Evaluation of LLM-based Agents

Reference 22

Resolution
verified exact
local_arxiv, observed 2026-06-30T17:54:57.832899Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:465bbbb886bd8498e209e6eb425de95246d14c8347c669afe9bb83681bf71787

Observation 51fd1a65-613a-4f73-8334-bba4c4fa7bc8 · outbound

This paper cites an unresolved cited work.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-07-08T07:24:43.742633Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:f78db79134be9f3db529b64ed3cd45f9d37475a2650fa67588e4c3d6a39ceff2

Observation 4e955613-884e-44e3-8c68-cf285d817496 · outbound

This paper cites an unresolved cited work.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-07-08T07:24:43.745083Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:7b430b460486c8a7656c009a46bb22ee809596b05b1694968d49923a36d64ad8

Observation 77b746ae-9ad2-4198-82cb-31aaf57801d5 · outbound

This paper cites Agent-as-a-Judge: Evaluate Agents with Agents.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents Agent-as-a-Judge: Evaluate Agents with Agents

Reference 25

Resolution
verified exact
arxiv_id, observed 2026-06-30T17:54:57.843736Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-30T17:52:14.944875Z digest=sha256:221cb4bdc0535389f24d42d586d25660b65289e56fadff4979c104c7895500c0

Pith citing papers

No inbound Pith citation observations are available.