The Amazing Agent Race benchmark shows LLM agents are strong at tool execution but weak at navigating complex Wikipedia-based DAG tool chains, with best accuracy at 37.2% dominated by navigation errors.
These legs have strong PVR (63.5%) and RCR (71.4%), indicating the agent was on the right track but made a computational error in the final aggregation
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.AI 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
The Amazing Agent Race: Strong Tool Users, Weak Navigators
The Amazing Agent Race benchmark shows LLM agents are strong at tool execution but weak at navigating complex Wikipedia-based DAG tool chains, with best accuracy at 37.2% dominated by navigation errors.