REVIEW 12 cited by
RestGPT: Connecting Large Language Models with Real-World RESTful APIs
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Tool-augmented large language models (LLMs) have achieved remarkable progress in tackling a broad range of tasks. However, existing methods are mainly restricted to specifically designed tools and fail to fulfill complex instructions, having great limitations when confronted with real-world scenarios. In this paper, we explore a more realistic scenario by connecting LLMs with RESTful APIs, which adhere to the widely adopted REST software architectural style for web service development. To address the practical challenges of tackling complex instructions, we propose RestGPT, which exploits the power of LLMs and conducts a coarse-to-fine online planning mechanism to enhance the abilities of task decomposition and API selection. RestGPT also contains an API executor tailored for calling RESTful APIs, which can meticulously formulate parameters and parse API responses. To fully evaluate the performance of RestGPT, we propose RestBench, a high-quality benchmark which consists of two real-world scenarios and human-annotated instructions with gold solution paths. Experiments show that RestGPT is able to achieve impressive results in complex tasks and has strong robustness, which paves a new way towards AGI. RestGPT and RestBench is publicly available at https://restgpt.github.io/.
Forward citations
Cited by 12 Pith papers
-
Benchmarking Web API Integration Code Generation
Even the strongest open-source LLM generates fully correct API invocation code on only 40% of WAPIIBench tasks, versus 77% for GPT-4o.
-
PORTS: Preference-Optimized Retrievers for Tool Selection with Large Language Models
PORTS fine-tunes dense retrievers for LLM tool selection via odds-ratio preference optimization driven by a frozen LLM's log-likelihood of the gold tool call, plus contrastive semantic loss.
-
ToolLIFT: Lifting Tool-Specific Trajectories into Function-Level Graphs for Generalizable Tool Planning
ToolLIFT generalizes tool planning to unseen tool sets by lifting trajectories to function-level workflow graphs and separating workflow planning from tool selection.
-
Mitigating Errors in LLM-Generated Web API Invocations via Retrieval-Augmented Generation and Constrained Decoding
Constrained decoding derived from OpenAPI specifications eliminates hallucinated web API calls in LLM-generated code and substantially improves correctness across 24 models, while retrieval-augmented generation yields...
-
FitText: Evolving Agent Tool Ecologies via Memetic Retrieval
FitText embeds memetic evolutionary retrieval inside the agent's reasoning loop to iteratively refine pseudo-tool descriptions, raising retrieval rank from 8.81 to 2.78 on ToolRet and pass rate to 0.73 on StableToolBench.
-
Bridging the Capability Gap: Joint Alignment Tuning for Harmonizing LLM-based Multi-Agent Systems
MOAT alternately aligns a planning and a grounding LLM agent via perplexity-based DPO and self-generated SFT, reporting small but consistent gains over independently tuned baselines.
-
DrafterBench: Benchmarking Large Language Models for Tasks Automation in Civil Engineering
DrafterBench is a new benchmark of 1,920 PDF drawing-revision tasks; on it, the best model (OpenAI o1) averages about 80/100, and all tested models fail hard on incomplete instructions and plan execution.
-
Doc2Agent: Scalable Generation of Tool-Using Agents from API Documentation
Doc2Agent automatically converts unstructured REST API documentation into validated, Python-based tools for AI agents, reporting a 55% relative WebArena improvement over direct API calling.
-
AgentSLABench: Evaluating and Benchmarking Agentic Systems Under Resource Constraints
AgentSLABench adds resource budgets and cost/latency/memory profiles to AI agent evaluation, but its headline results rest on tiny samples and an internal inconsistency.
-
AutoTool: Dynamic Tool Selection and Integration for Agentic Reasoning
AutoTool's two-phase SFT/RL plus ranking training lets 8B LLM agents beat larger fixed-tool agents across math, search, code, and vision benchmarks, though unseen-tool gains are asserted, not isolated.
-
ReQuestNet: A Foundational Learning model for Channel Estimation
A single neural network model is claimed to estimate 5G channels across varying resource blocks, MIMO layers, and precoding patterns, beating a statistics-aware MMSE baseline by up to 10 dB.
-
Initial Steps in Integrating Large Reasoning and Action Models for Service Composition
A conceptual framework integrating LRMs and LAMs for end-to-end automated service composition, with no empirical validation.
Discussion (0). Sign in to comment.