Pith. sign in

REVIEW 7 cited by

ToolTalk: Evaluating Tool-Usage in a Conversational Setting

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2311.10775 v1 pith:LDQLBZG6 submitted 2023-11-15 cs.CL cs.AIcs.LG

classification cs.CLcs.AIcs.LG
keywords tooltalktoolsassistantsinformationtoolusersaccessactions
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Large language models (LLMs) have displayed massive improvements in reasoning and decision-making skills and can hold natural conversations with users. Many recent works seek to augment LLM-based assistants with external tools so they can access private or up-to-date information and carry out actions on behalf of users. To better measure the performance of these assistants, this paper introduces ToolTalk, a benchmark consisting of complex user intents requiring multi-step tool usage specified through dialogue. ToolTalk contains 28 tools grouped into 7 plugins, and includes a complete simulated implementation of each tool, allowing for fully automated evaluation of assistants that rely on execution feedback. ToolTalk also emphasizes tools that externally affect the world rather than only tools for referencing or searching information. We evaluate GPT-3.5 and GPT-4 on ToolTalk resulting in success rates of 26% and 50% respectively. Our analysis of the errors reveals three major categories and suggests some future directions for improvement. We release ToolTalk at https://github.com/microsoft/ToolTalk.

Discussion (0). Sign in to comment.

Forward citations

Cited by 7 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactions

    cs.AI 2026-05 unverdicted novelty 7.0 of 10

    VitaBench 2.0 introduces a benchmark for long-term personalized and proactive agent behavior, with results indicating substantial gaps in current frontier LLMs.

  2. AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agents

    cs.AI 2024-05 accept novelty 7.0 of 10

    AndroidWorld is a dynamic, reproducible Android benchmark that generates unlimited natural-language tasks for autonomous agents and shows current agents succeed on only 30.6 percent of them.

  3. Temporary Authority, Permanent Effects: Commit-Time Authorization for LLM Agents

    cs.CR 2026-07 conditional novelty 6.0 of 10

    Under controlled authority invalidation, agents reach visible goals in 262/270 runs but only 55 remain authorized; CommitGuard blocks stale durable effects when runtimes emit boundary signals.

  4. CallBench: A Benchmark for Dual-Goal Coordination in Phone Call Assistants

    cs.AI 2026-06 conditional novelty 6.0 of 10

    CALLBENCH is a 50k-dialogue Chinese benchmark showing current dialogue methods achieve only ~0.61-0.77 overall scores and about 10.6% safety violations on dual-goal phone-call assistant decisions.

  5. AgentOmnia: Scaling Agentic Models for Full-Scenario Applications

    cs.AI 2026-07 conditional novelty 5.0 of 10

    Post-training an open Qwen3-30B agent on 52,361 verifiable tasks in 5,018 synthesized stateful environments lifts its average across four agent benchmarks from 22.9% to 41.7%.

  6. Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application

    cs.CL 2026-06 unverdicted novelty 5.0 of 10

    This survey categorizes agentic environments for LLMs by eight attributes and domains, introduces symbolic and neural synthesis paradigms with evaluation, and outlines four agent evolution pathways plus three environm...

  7. TOBench: A Task-Oriented Omni-Modal Benchmark for Real-World Tool-Using Agents

    cs.AI 2026-05 unverdicted novelty 5.0 of 10

    MM-ToolBench introduces 100 closed-loop multimodal tasks across two domains with 27 MCP servers and 324 tools, where agents must execute, inspect artifacts, and revise before final output.

Pith tools