REVIEW 10 cited by
AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Large Language Model-based agents have garnered significant attention and are becoming increasingly popular. Furthermore, planning ability is a crucial component of an LLM-based agent, which generally entails achieving a desired goal from an initial state. This paper investigates enhancing the planning abilities of LLMs through instruction tuning, referred to as agent training. Recent studies have demonstrated that utilizing expert-level trajectory for instruction-tuning LLMs effectively enhances their planning capabilities. However, existing work primarily focuses on synthesizing trajectories from manually designed planning tasks and environments. The labor-intensive nature of creating these environments and tasks impedes the generation of sufficiently varied and extensive trajectories. To address this limitation, this paper explores the automated synthesis of diverse environments and a gradual range of planning tasks, from easy to difficult. We introduce a framework, AgentGen, that leverages LLMs first to generate environments and subsequently generate planning tasks conditioned on these environments. Specifically, to improve environmental diversity, we propose using an inspiration corpus composed of various domain-specific text segments as the context for synthesizing environments. Moreover, to increase the difficulty diversity of generated planning tasks, we propose a bidirectional evolution method, Bi-Evol, that evolves planning tasks from easier and harder directions to synthesize a task set with a smoother difficulty curve. The evaluation results derived from AgentBoard show that AgentGen greatly improves LLMs' planning ability, e.g., the AgentGen instruction-tuned Llama-3.1-8B surpasses GPT-3.5 in overall performance. Moreover, the AgentGen-tuned Llama-3.1-70B model achieves state-of-the-art results in planning tasks. Project page: https://agent-gen.github.io/.
Forward citations
Cited by 10 Pith papers
-
ValueFlow: Measuring the Propagation of Value Perturbations in Multi-Agent LLM Systems
A perturbation-based framework measures how value opinions propagate through multi-agent LLM systems, revealing that susceptibility varies by value, model, and topology.
-
Benchmarking LLM-Assisted Blue Teaming via Standardized Threat Hunting
Standardized modular threat-hunting workflows (CyberTeam) improve LLM performance on blue team tasks compared to open-ended ICL, CoT, and ToT prompting across 30 tasks and 452k samples.
-
Self-Challenging Language Model Agents
A language model agent can generate its own verifiable training tasks and improve its tool-use success rate by about 2x without human-annotated data.
-
Understanding the Information Propagation Effects of Communication Topologies in LLM-based Multi-Agent Systems
Moderately sparse communication topologies balance error suppression and insight propagation in LLM multi-agent systems, and the proposed EIB-Learner learns such topologies to outperform prior methods.
-
ManiTaskGen: A Comprehensive Task Generator for Benchmarking and Improving Vision-Language Agents on Embodied Decision-Making
ManiTaskGen automatically generates diverse, feasible mobile manipulation tasks from any input scene, and uses them to benchmark and improve vision-language robot agents.
-
OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automation
A hierarchical multi-agent framework with a domain-agnostic planner trained by SFT and DPO achieves 69.70% on GAIA and lifts a Qwen2.5-32B planner by 16.37 points.
-
AgentDNS: A Root Domain Naming System for LLM Agents
AgentDNS is a proposed system that gives LLM agents a DNS-like namespace and discovery service for finding and invoking third-party tools and agents across vendors.
-
X-WebAgentBench: A Multilingual Interactive Web Benchmark for Evaluating Global Agentic System
X-WebAgentBench translates the WebShop e-commerce agent task into 14 languages and shows that current agents, including GPT-4o, perform substantially worse in multilingual settings than in English.
-
Can LLM-Reasoning Models Replace Classical Planning? A Benchmark Study
Reasoning-optimized LLMs reach at most 63.4% success across the five PDDL benchmarks, versus 97.9% for Fast Downward, and frequently produce plans that fail during execution.
-
Large Language Models for Planning: A Comprehensive and Systematic Survey
A structured survey of LLM planning methods, benchmarks, and interpretability work, organized around a three-way taxonomy.
Discussion (0). Sign in to comment.