Pith. sign in

Paper Citation Record · LEDGER

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality

As of 13 August 2026, this Paper Citation Record lists 13 of 13 outbound references and 0 inbound Pith citation observations for arXiv:2608.05263.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2608.05263 v1

Coverage vector

measured 13 of 13 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-08T16:55:25.086245Z

measured 13 of 13 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-13T06:32:02.005865+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

13 of 13 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved13
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation bda7e281-e311-4fc6-ac00-c0d94ddb9991 · outbound

This paper cites an unresolved cited work.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-08-08T16:55:25.464905Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-08T16:55:25.049359Z digest=sha256:cf65630bad174c970432739ebe9a60bde0d2da464a7a32aa13990f8cd0ead163

Observation 4da9c864-5e82-4517-84e9-5e7a6af432f4 · outbound

This paper cites Why Do Multi-Agent LLM Systems Fail?.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality Why Do Multi-Agent LLM Systems Fail?

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.053010Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.053010Z digest=sha256:57540d1862ecdf30132a61bb03242dd0619bb773841fda54590d6c1f2151bafc

Observation 98ce1601-51f6-4558-869a-4bb14d0b31fc · outbound

This paper cites Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systems.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systems

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.055968Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.055968Z digest=sha256:d90c16f46c1089dceee6149a97282da8c9cde3fbb9c89ea8f303dbba224bec7d

Observation 8c0d5811-648d-4f41-9cbb-e0bc95a187ff · outbound

This paper cites an unresolved cited work.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality Unresolved cited work

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.058736Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.058736Z digest=sha256:4d263f518375414418850fb12cdd37e95bfee2b1c35c1c7c9c7477fba8a183cf

Observation a0fa45f8-9519-47b3-8a03-363bfd6e0a9e · outbound

This paper cites SWE-bench: Can Language Models Resolve Real-World GitHub Issues?.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.061431Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.061431Z digest=sha256:1eab6ab7176bcb73fe18de838b47544da907f2083e39a8c1dcfda7a4357cafde

Observation d4d14260-fb19-4726-9c64-857b0e70a7de · outbound

This paper cites an unresolved cited work.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality Unresolved cited work

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.064300Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.064300Z digest=sha256:fe450e5e813215d7dd43c40df0522fad98f27095d4f6a5bfe2ebe628f648d7ba

Observation d768e3fc-1ceb-4ecf-a552-de120e499892 · outbound

This paper cites AgentBench: Evaluating LLMs as Agents.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality AgentBench: Evaluating LLMs as Agents

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.067711Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.067711Z digest=sha256:0c243e6f0c8d0bdc9b2bdd85e99644b0e40232f55cab3ec073a4b1787896037a

Observation afb39c2b-fed8-4bc4-b8e0-aa8a14c79318 · outbound

This paper cites an unresolved cited work.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality Unresolved cited work

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.070879Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.070879Z digest=sha256:f86ada701d58c1f2367f4b01a11d9273a8e6834a42228ef847578584a93709d8

Observation ba1c042e-869e-4601-8b0d-3df27d192725 · outbound

This paper cites OdysseyBench: Evaluating LLM Agents on Long-Horizon Complex Office Application Workflows.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality OdysseyBench: Evaluating LLM Agents on Long-Horizon Complex Office Application Workflows

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.073757Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.073757Z digest=sha256:c8a900d6c49bd7dcb9c653506cff3f67a415cde55327b1cb8a305e54b8a60461

Observation f98b9881-50a1-4c5f-8ee8-825bba1b55fa · outbound

This paper cites From Spark to Fire: Modeling and Mitigating Error Cascades in LLM-Based Multi-Agent Collaboration.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality From Spark to Fire: Modeling and Mitigating Error Cascades in LLM-Based Multi-Agent Collaboration

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.076877Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.076877Z digest=sha256:62f61bfd48e689c2fac30f66937d1440ba06ca8755ffdb3929cbe9a9518ce28e

Observation 0e07f305-0cfa-4ab7-a867-86b91fa84f4c · outbound

This paper cites an unresolved cited work.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality Unresolved cited work

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.080128Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.080128Z digest=sha256:6f59aa19c6c35614f2aa9bbf042814b3c99baebc3cd807509ab711b443d3dc78

Observation 1b1a4bc4-5c4a-4cf5-bfd2-d7320037acf2 · outbound

This paper cites an unresolved cited work.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-08T16:55:25.455420Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-08T16:55:25.082955Z digest=sha256:8611a0ce78ffebbfea35a04d937241b8662717a1bd1c029d0955984f7edcc57d

Observation 3f7cdcfb-68ca-4dbf-9693-bebea510f99b · outbound

This paper cites Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems.

OrchestraBench: Evaluating Multi-Agent Orchestration Failure Modes, Recovery, and Decomposition Quality Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-08T16:55:25.086245Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:55:25.086245Z digest=sha256:ff28377b0448cd5e90b07921c512acce5a4db99aa8150675f4e77ba7d4883cbc

Pith citing papers

No inbound Pith citation observations are available.