MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers | Paper Citation Record

Observation 5241f98b-8ff9-4743-8abe-c21bed5bdf41 · outbound

This paper cites A survey on large language model based autonomous agents.Frontiers of Computer Science, 18(6):186345, 2024.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers A survey on large language model based autonomous agents.Frontiers of Computer Science, 18(6):186345, 2024

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:10.850331Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 356d2d6f-c65a-4f3e-af14-e087eea06d6a · outbound

This paper cites Tool learning with large language models: a survey.Frontiers of Computer Science, 19(8), 2025.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Tool learning with large language models: a survey.Frontiers of Computer Science, 19(8), 2025

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:10.914274Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 93ab22a9-30ac-448d-b598-0396ba7e0e4a · outbound

This paper cites Agentic large language models, a survey.Journal of Artificial Intelligence Research, 84, 2025.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Agentic large language models, a survey.Journal of Artificial Intelligence Research, 84, 2025

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:10.991812Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 78be2acd-457e-4c55-a81b-c38207399e3e · outbound

This paper cites Repomaster: Autonomous exploration and understanding of github repositories for complex task solving.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Repomaster: Autonomous exploration and understanding of github repositories for complex task solving

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:11.059743Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c223ebed-7ced-42f7-884c-862feaf4a768 · outbound

This paper cites OS-ATLAS: foundation action model for generalist GUI agents.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers OS-ATLAS: foundation action model for generalist GUI agents

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:11.147259Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f3c6c2b6-3684-4b55-b2a1-36d9eb3575d7 · outbound

This paper cites Chemagent: Self-updating memories in large language models improves chemical reasoning.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Chemagent: Self-updating memories in large language models improves chemical reasoning

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:11.187997Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 30f02789-cd66-4784-a968-895bc434f998 · outbound

This paper cites Toolllm: Facilitating large language models to master 16000+ real-world apis.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Toolllm: Facilitating large language models to master 16000+ real-world apis

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:11.278626Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 527e509c-25ce-4d62-a01d-8b81ce37595b · outbound

This paper cites ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Cases.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Cases

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:11.366164Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 48fd0983-1dfb-43ac-a175-5bed6e794d1d · outbound

This paper cites Shortcutsbench: A large-scale real-world benchmark for api-based agents.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Shortcutsbench: A large-scale real-world benchmark for api-based agents

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:11.476416Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1fe843e8-5bfa-4c96-bc9c-f37ec85c4260 · outbound

This paper cites Stabletoolbench: Towards stable large-scale benchmarking on tool learning of large language models.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Stabletoolbench: Towards stable large-scale benchmarking on tool learning of large language models

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:11.583829Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b1fd7baf-067c-430e-b62b-fb6deb34f466 · outbound

This paper cites Model context protocol (mcp).

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Model context protocol (mcp)

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:11.700223Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c8d43dab-a14a-4bf2-a450-5d0778c93d85 · outbound

This paper cites Apigen: Automated pipeline for generating verifiable and diverse function-calling datasets.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Apigen: Automated pipeline for generating verifiable and diverse function-calling datasets

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:11.789855Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 482bd9fe-59f7-47f8-b407-e5ca3dbadf5e · outbound

This paper cites Mcp-flow: Facilitating llm agents to master real-world, diverse and scaling mcp tools, 2025.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Mcp-flow: Facilitating llm agents to master real-world, diverse and scaling mcp tools, 2025

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:11.896899Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 33b07738-40e9-41fe-bc8e-381e1003c5c4 · outbound

This paper cites Mcpeval: Automatic mcp-based deep evaluation for ai agent models.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Mcpeval: Automatic mcp-based deep evaluation for ai agent models

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:11.980694Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a9866b0c-602c-49eb-a0bd-d4d5f2cf377b · outbound

This paper cites Mcp-bench: Benchmarking tool-using llm agents with complex real-world tasks via mcp servers.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Mcp-bench: Benchmarking tool-using llm agents with complex real-world tasks via mcp servers

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:12.027722Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ab50c0ca-4dea-4390-9bd5-781822894e66 · outbound

This paper cites Toolace: Winning the points of llm function calling.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Toolace: Winning the points of llm function calling

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:12.132411Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 183965fc-4e61-4ce2-94e6-6a9096c2f0ea · outbound

This paper cites The berkeley function calling leaderboard (bfcl): From tool use to agentic evaluation of large language models.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers The berkeley function calling leaderboard (bfcl): From tool use to agentic evaluation of large language models

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:12.294259Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9d5d0186-b0d1-4511-aecb-51ff06fca719 · outbound

This paper cites Xu, Hao Zhu, Xuhui Zhou, Robert Lo, Abishek Sridhar, Xianyi Cheng, Tianyue Ou, Yonatan Bisk, Daniel Fried, Uri Alon, and Graham Neubig.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Xu, Hao Zhu, Xuhui Zhou, Robert Lo, Abishek Sridhar, Xianyi Cheng, Tianyue Ou, Yonatan Bisk, Daniel Fried, Uri Alon, and Graham Neubig

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:12.398664Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5ef54d25-822f-4b24-99a3-2a1d659d9b84 · outbound

This paper cites SWE-bench: Can language models resolve real-world github issues? InThe Twelfth International Conference on Learning Representations, 2024.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers SWE-bench: Can language models resolve real-world github issues? InThe Twelfth International Conference on Learning Representations, 2024

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:12.509438Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 00eb1950-4b2d-4952-b6f6-fdb3a08b5941 · outbound

This paper cites Osworld: Benchmarking multimodal agents for open-ended tasks in real computer environments.Advances in Neural Information Processing Systems, 37:52040–52094, 2024.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Osworld: Benchmarking multimodal agents for open-ended tasks in real computer environments.Advances in Neural Information Processing Systems, 37:52040–52094, 2024

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:12.601480Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7d34c308-4afb-409b-b064-3a0b77f6e720 · outbound

This paper cites Smithery.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Smithery

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:12.638949Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6dc6c889-6ec4-490a-b0d3-818b1326acf0 · outbound

This paper cites Github, 2026.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Github, 2026

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:12.677530Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9b28968e-f62e-4a01-a5dd-ab6896369e0c · outbound

This paper cites Modelscope platform, 2026.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Modelscope platform, 2026

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:12.724692Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 69cc8191-a5a1-4e1a-8430-41eac8b856fd · outbound

This paper cites npm registry, 2026.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers npm registry, 2026

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:12.778143Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f788806b-998a-43e5-b03d-8393d4a978fc · outbound

This paper cites Livemcpbench: Can agents navigate an ocean of mcp tools?.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Livemcpbench: Can agents navigate an ocean of mcp tools?

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:12.830683Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 97bc10b0-782a-4510-8bd4-69a906d51226 · outbound

This paper cites Re- Act: Synergizing reasoning and acting in language models.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Re- Act: Synergizing reasoning and acting in language models

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:12.881525Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7db1fc3e-daeb-4263-acc8-0b22ca64138b · outbound

This paper cites Deepseek-v3 technical report.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Deepseek-v3 technical report

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:12.940943Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f8e4d8ee-de28-4ddf-9142-0a79b7e2d2e8 · outbound

This paper cites Introducing gpt-5.4, 2026.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Introducing gpt-5.4, 2026

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:12.992386Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4f15bb67-78ba-43d5-a900-3d52057b65ed · outbound

This paper cites Introducing gpt-5, 2026.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Introducing gpt-5, 2026

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:13.047324Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 921408ec-f478-4aeb-bdef-acaca175b5cf · outbound

This paper cites GPT-4 Technical Report.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers GPT-4 Technical Report

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:13.102619Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 87cae0ba-4d0f-4c0e-b482-431687ff3317 · outbound

This paper cites Introducing claude opus 4.6, 2026.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Introducing claude opus 4.6, 2026

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:13.153355Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e6d285e8-e6e1-42db-879b-4a525a672a45 · outbound

This paper cites Introducing claude sonnet 4.6, 2026.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Introducing claude sonnet 4.6, 2026

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:13.202860Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4a477e97-a4e8-42c3-9e09-ee874e3fe773 · outbound

This paper cites Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:13.287990Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e870f728-a962-4286-abc5-106055d55b64 · outbound

This paper cites Introducing openai o3 and o4-mini, 2026.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Introducing openai o3 and o4-mini, 2026

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:13.345777Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 801ff9ef-d7ed-45bf-8782-97aa0873d7f0 · outbound

This paper cites Introducing claude sonnet 4.5, 2026.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Introducing claude sonnet 4.5, 2026

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:13.382818Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2d19e53e-bca2-4198-bd08-0c33972ac15b · outbound

This paper cites The Llama 3 Herd of Models.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers The Llama 3 Herd of Models

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:13.424951Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1379edce-f9f7-4a82-87a8-774c538f8ad4 · outbound

This paper cites Gemma 4, 2026.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Gemma 4, 2026

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:13.516341Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0691fff7-6dcb-4e44-9934-82360a04d88b · outbound

This paper cites Qwen3.5: Towards native multimodal agents, February 2026.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Qwen3.5: Towards native multimodal agents, February 2026

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:13.561803Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 95ee215c-a722-48ae-aead-7019df9b505a · outbound

This paper cites Judgebench: A benchmark for evaluating llm-based judges.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Judgebench: A benchmark for evaluating llm-based judges

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:13.617062Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 972f5769-7b0a-469c-90e4-e35b605ecd6c · outbound

This paper cites Mllm-as-a-judge for image safety without human labeling.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Mllm-as-a-judge for image safety without human labeling

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:13.670476Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 00675376-dd18-4da5-afcb-193d80aeecf3 · outbound

This paper cites Agentrx: Diagnosing ai agent failures from execution trajectories.arXiv preprint arXiv:2602.02475, 2026.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Agentrx: Diagnosing ai agent failures from execution trajectories.arXiv preprint arXiv:2602.02475, 2026

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:13.720801Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 89b25d1e-362d-4620-affd-197e6be0cfa1 · outbound

This paper cites Trajad: Trajectory anomaly detection for trustworthy llm agents.arXiv preprint arXiv:2602.06443, 2026.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Trajad: Trajectory anomaly detection for trustworthy llm agents.arXiv preprint arXiv:2602.06443, 2026

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:13.769803Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5b733a2c-fe10-4a8c-8e39-c675b0dce4ca · outbound

This paper cites Reflexion: Language agents with verbal reinforcement learning.Advances in neural information processing systems, 36:8634–8652, 2023.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Reflexion: Language agents with verbal reinforcement learning.Advances in neural information processing systems, 36:8634–8652, 2023

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:13.825249Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 67d177d6-34a9-49d3-8435-5dd5588e9dd4 · outbound

This paper cites Plan-and-act: Improving planning of agents for long-horizon tasks.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Plan-and-act: Improving planning of agents for long-horizon tasks

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:13.886948Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f80a6c08-c83b-43ee-97ce-01e6f6be29e9 · outbound

This paper cites Agent workflow memory.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Agent workflow memory

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:13.941048Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 572ee72a-6a6f-45b0-97ab-e62f64b26ab8 · outbound

This paper cites Bge m3-embedding: Multi-lingual, multi-functionality, multi-granularity text embeddings through self-knowledge distillation, 2024.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Bge m3-embedding: Multi-lingual, multi-functionality, multi-granularity text embeddings through self-knowledge distillation, 2024

Reference 46

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:14.020165Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4538fb9c-4c2c-46ed-bc30-894abb384eb4 · outbound

This paper cites Codet5: Identifier-aware unified pre-trained encoder-decoder models for code understanding and generation.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Codet5: Identifier-aware unified pre-trained encoder-decoder models for code understanding and generation

Reference 47

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:14.068782Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2551fce8-ba79-4422-a082-7d6d323f9aa7 · outbound

This paper cites StarCoder 2 and The Stack v2: The Next Generation.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers StarCoder 2 and The Stack v2: The Next Generation

Reference 48

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:14.112360Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 54602d4f-bf8e-4892-b4bf-d22119932160 · outbound

This paper cites Coefficient of variation.Encyclopedia of research design, 1(5):169–171, 2010.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Coefficient of variation.Encyclopedia of research design, 1(5):169–171, 2010

Reference 49

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:14.166174Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e17f8167-d818-4fad-b3d5-4c810f0f6544 · outbound

This paper cites Beijing". For multiple cities, separate with.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Beijing". For multiple cities, separate with

Reference 50

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:14.210118Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 13d99b93-f0bc-4aa4-9527-e8b50d0e558d · outbound

This paper cites Do not remove, rename, or alter the logic/schema of any existing tool.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Do not remove, rename, or alter the logic/schema of any existing tool

Reference 51

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:14.275863Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a833bc5b-402d-4334-8151-6b226b08e0dd · outbound

This paper cites Ensure the new tool name does not conflict with existing names.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Ensure the new tool name does not conflict with existing names

Reference 52

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:14.335142Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a6ea4f8c-c3e9-490f-a760-ae8df233a547 · outbound

This paper cites integration_summary.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers integration_summary

Reference 53

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:14.391402Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 97e754b2-a4b0-4ef9-8986-a0addde72e44 · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 54

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:14.462910Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 31fbb526-b68c-48f4-8f06-8e357115ba1a · outbound

This paper cites Their schemas, descriptions, and logic must be preserved 100%.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Their schemas, descriptions, and logic must be preserved 100%

Reference 55

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:14.500117Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e23361e3-1274-4c53-a973-99655f93b814 · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 56

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:14.597879Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e02bd52a-7b34-443b-b592-bbe2fe9c49ec · outbound

This paper cites replacement_summary.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers replacement_summary

Reference 57

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:14.679346Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0d227088-628e-4519-866c-245243f35f40 · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 58

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:14.767819Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8b6d9cf2-87e3-474e-88ff-d93fec179d2d · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 59

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:14.858250Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f000f35d-8d7c-45b4-a520-584f4c5c97ae · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 60

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:14.959042Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e356c7d0-9d2e-4922-8251-7b1de7e71e36 · outbound

This paper cites deletion_summary.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers deletion_summary

Reference 61

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:15.066182Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7f82f838-51e7-4e15-b9ee-a395f792d361 · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 62

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:15.159023Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3b6f0204-eb39-4c8a-9f05-d192db34b961 · outbound

This paper cites Only modify description/text fields; DO NOT change name, inputSchema, or outputSchema.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Only modify description/text fields; DO NOT change name, inputSchema, or outputSchema

Reference 63

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:15.221746Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a17c729b-250c-4d19-806a-223fe269e42b · outbound

This paper cites addition_summary.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers addition_summary

Reference 64

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:15.312684Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8d28cf89-a7d4-4557-a2c6-15823541e01d · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 65

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:15.390313Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 69b2de5e-c9ab-457a-9baa-986913d37530 · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 66

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:15.456235Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 70de6af5-8350-4ca7-8989-1c4df5e133cc · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 67

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:15.557135Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2228b345-c2b8-4af4-bfe0-87921b19dee2 · outbound

This paper cites evolution_summary.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers evolution_summary

Reference 68

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:15.625836Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 55aa238d-7e78-4c15-a935-d65e3b65ff45 · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 69

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:15.691256Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 941280ae-1a6d-4e98-966b-14aebcb5f950 · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 70

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:15.761140Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1e91337a-64b8-4dae-a4bc-be64c7a3885e · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 71

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:15.824847Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d2c6916f-6b32-48f9-af07-a93a269a5543 · outbound

This paper cites evolution_summary.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers evolution_summary

Reference 72

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:15.899501Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3a3bbf20-a337-4632-a23d-7414a8d4baf6 · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 73

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:15.976200Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 89164236-8587-4e52-909e-a01896dba1d5 · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 74

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:16.029679Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2553e661-160e-4c28-a070-992f91cf7b44 · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 75

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:16.110171Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 656c7d6f-4c65-486b-bb9c-70823be00835 · outbound

This paper cites evolution_summary.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers evolution_summary

Reference 76

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:16.163735Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 815a055a-4958-40e3-b47d-6c9306cf08ce · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 77

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:16.214718Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 67ee8b57-392b-4162-b32e-23df1fc1e0df · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 78

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:16.280338Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation de90b678-681d-45d9-a314-bdb01e7f3b56 · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 79

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:16.359633Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3450b0b5-971c-40ee-88da-f5cdbb8e2383 · outbound

This paper cites evolution_summary.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers evolution_summary

Reference 80

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:16.436169Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f984cc31-1d30-4976-8c63-544b296e8188 · outbound

This paper cites Your modifications are strictly limited to the description text field of the target tool.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Your modifications are strictly limited to the description text field of the target tool

Reference 81

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:16.515984Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 27710e2d-8932-4b19-bc02-08f6bb661d1f · outbound

This paper cites - Strict Prohibition: Do not claim, imply, or promise any capabilities, parameters, or return values that are not explicitly defined in the provided schemas.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers - Strict Prohibition: Do not claim, imply, or promise any capabilities, parameters, or return values that are not explicitly defined in the provided schemas

Reference 82

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:16.586363Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d154a30e-37ad-4fe4-93c6-6443c37e47dd · outbound

This paper cites tool": {.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers tool": {

Reference 83

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:16.640354Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6ea32034-6320-4772-9ff1-34646dc75325 · outbound

This paper cites - You MUST NOT add new parameters or remove existing ones.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers - You MUST NOT add new parameters or remove existing ones

Reference 84

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:16.703370Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 547db10d-061c-4adb-9d72-616bf26b74ab · outbound

This paper cites - Strict Prohibition: Do not change the semantic meaning of the parameter 30 in a way that contradicts its type or validation rules.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers - Strict Prohibition: Do not change the semantic meaning of the parameter 30 in a way that contradicts its type or validation rules

Reference 85

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:16.791162Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 778d9205-8302-4774-9c62-716f80d17067 · outbound

This paper cites parameters.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers parameters

Reference 86

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:16.883361Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 91dfd01c-bb8d-4254-b1c7-d3d70cb4f9b7 · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 87

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:16.953987Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 602e1aff-4546-4f3c-8442-77ca0cd6cf91 · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 88

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:17.032348Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 15464b84-c51e-4ecf-bc8e-1ea16fb247db · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 89

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:17.228679Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dec21f95-0094-4db3-95c7-99fd9b10fd4d · outbound

This paper cites Do not fabricate information sources, such as accessing self-invented URLs in the code or using data with unknown formats or structures.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Do not fabricate information sources, such as accessing self-invented URLs in the code or using data with unknown formats or structures

Reference 90

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:17.461528Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e5abc686-9d5d-4cbc-828d-0f388631b126 · outbound

This paper cites key": "value.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers key": "value

Reference 91

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:17.615188Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c30a6368-542f-425d-b91e-b47a831ae2f4 · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 92

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:17.755936Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2d1ebae8-e420-4e17-893a-182f1d5d9523 · outbound

This paper cites metadata.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers metadata

Reference 93

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:17.929043Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2618250c-f668-4dba-8413-38468d421d02 · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 94

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:18.083328Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4dbba295-faa3-4246-a40a-f22faaede4f5 · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 95

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:18.279536Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3877e769-052a-4c69-bc36-9d22ab536044 · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 96

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:18.486669Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e87b8724-47ee-4f69-aa2e-78c9b5a3fedd · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 97

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:18.624500Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ef8487c4-3f64-4581-a6fe-2393859a8b4d · outbound

This paper cites an unresolved cited work.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers Unresolved cited work

Reference 98

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:18.798260Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8caf6e6f-23d2-4c4e-bab5-fa9c06399660 · outbound

This paper cites categories.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers categories

Reference 99

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:18.936663Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 23775bc0-84d8-47f8-bdbe-2e2760ede044 · outbound

This paper cites perfectly executed.

MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers perfectly executed

Reference 100

Resolution: unresolved; no resolver link, observed 2026-08-02T01:32:19.116429Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Coverage vector

Reference resolution

Outbound references

Pith citing papers