Pith. sign in

REVIEW 6 cited by

Tool Learning with Large Language Models: A Survey

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2405.17935 v3 pith:4ONKD5SC submitted 2024-05-28 cs.CL cs.AI

classification cs.CLcs.AI
keywords toollearningexistingllmsliteraturesurveyaccordingarea
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Recently, tool learning with large language models (LLMs) has emerged as a promising paradigm for augmenting the capabilities of LLMs to tackle highly complex problems. Despite growing attention and rapid advancements in this field, the existing literature remains fragmented and lacks systematic organization, posing barriers to entry for newcomers. This gap motivates us to conduct a comprehensive survey of existing works on tool learning with LLMs. In this survey, we focus on reviewing existing literature from the two primary aspects (1) why tool learning is beneficial and (2) how tool learning is implemented, enabling a comprehensive understanding of tool learning with LLMs. We first explore the "why" by reviewing both the benefits of tool integration and the inherent benefits of the tool learning paradigm from six specific aspects. In terms of "how", we systematically review the literature according to a taxonomy of four key stages in the tool learning workflow: task planning, tool selection, tool calling, and response generation. Additionally, we provide a detailed summary of existing benchmarks and evaluation methods, categorizing them according to their relevance to different stages. Finally, we discuss current challenges and outline potential future directions, aiming to inspire both researchers and industrial developers to further explore this emerging and promising area. We also maintain a GitHub repository to continually keep track of the relevant papers and resources in this rising area at https://github.com/quchangle1/LLM-Tool-Survey.

Discussion (0). Sign in to comment.

Forward citations

Cited by 6 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. DICE-BENCH: Evaluating the Tool-Use Capabilities of Large Language Models in Multi-Round, Multi-Party Dialogues

    cs.CL 2025-06 conditional novelty 7.0 of 10

    A new benchmark and metric show that large language models still struggle to call tools when the needed details are scattered across multi-party, multi-round group dialogues.

  2. Amplitude-Only FFN Intervention for Tool-Structured LLM Inference Method: Gated Evaluation Protocol, and Cross-Model Empirical Results

    cs.CL 2026-07 conditional novelty 6.0 of 10

    Gated amplitude-only FFN interventions improve tool-structured LLM outputs on Qwen models by several points, while direction-changing repairs harm more than they fix.

  3. ASPERA: A Simulated Environment to Evaluate Planning for Complex Action Execution

    cs.CL 2025-07 conditional novelty 6.0 of 10

    ASPERA generates a benchmark of 250 executable assistant tasks and finds that LLMs, even with full API documentation, solve only 10 to 80 percent of them.

  4. Butterfly Effects in Toolchains: A Comprehensive Analysis of Failed Parameter Filling in LLM Tool-Agent Systems

    cs.SE 2025-07 conditional novelty 6.0 of 10

    LLM tool agents fail at parameter filling in five recurring ways; perturbing tool documents and user queries drives most failures, and invented parameter names are tied to the model rather than the input.

  5. MassTool: A Multi-Task Search-Based Tool Retrieval Framework for Large Language Models

    cs.IR 2025-07 conditional novelty 6.0 of 10

    A multi-task retriever that combines tool-usage detection with query-centered graph and search-based modules improves tool retrieval accuracy over prior baselines.

  6. RT-SHCUA: Real-Time Self-Hosted Computer-Use Agent for UAV Control

    cs.CR 2026-07 conditional novelty 5.0 of 10

    An architecture that mediates LLM computer-use agents for UAV control by compiling agent decisions into validated, time-bounded, evidence-logged skill invocations, with a prototype on OpenClaw/PX4/OP-TEE.

Pith tools