VAKRA is a benchmark combining executable database-backed APIs, document retrieval, and tool-use policy constraints to evaluate multi-hop reasoning in AI agents, and it finds large performance drops on compositional and policy-constrained tasks.
InProceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (V olume 1: Long Papers), pages 16022–16076, Bangkok, Thai- land
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.AI 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
VAKRA: Evaluating Multi-Hop Reasoning Across APIs and Retrieval Under Tool-Use Policies
VAKRA is a benchmark combining executable database-backed APIs, document retrieval, and tool-use policy constraints to evaluate multi-hop reasoning in AI agents, and it finds large performance drops on compositional and policy-constrained tasks.