LiveMCP-101 tests 18 AI agents on 101 live, multi-step MCP tool tasks; no model exceeds 58.42% task success, and semantic parameter errors dominate failures.
Chase Center, 1 Warriors Way, San Francisco, CA 94158, USA
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
LiveMCP-101: Stress Testing and Diagnosing MCP-enabled Agents on Challenging Queries
LiveMCP-101 tests 18 AI agents on 101 live, multi-step MCP tool tasks; no model exceeds 58.42% task success, and semantic parameter errors dominate failures.