REVIEW 5 cited by
Generalized Planning in PDDL Domains with Pretrained Large Language Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Recent work has considered whether large language models (LLMs) can function as planners: given a task, generate a plan. We investigate whether LLMs can serve as generalized planners: given a domain and training tasks, generate a program that efficiently produces plans for other tasks in the domain. In particular, we consider PDDL domains and use GPT-4 to synthesize Python programs. We also consider (1) Chain-of-Thought (CoT) summarization, where the LLM is prompted to summarize the domain and propose a strategy in words before synthesizing the program; and (2) automated debugging, where the program is validated with respect to the training tasks, and in case of errors, the LLM is re-prompted with four types of feedback. We evaluate this approach in seven PDDL domains and compare it to four ablations and four baselines. Overall, we find that GPT-4 is a surprisingly powerful generalized planner. We also conclude that automated debugging is very important, that CoT summarization has non-uniform impact, that GPT-4 is far superior to GPT-3.5, and that just two training tasks are often sufficient for strong generalization.
Forward citations
Cited by 5 Pith papers
-
Language-Informed Synthesis of Rational Agent Models for Grounded Theory-of-Mind Reasoning On-The-Fly
LIRAS synthesizes PDDL world models and agent configurations from language, parses video frames into symbolic states, and runs Bayesian inverse planning (SIAM) to produce human-like graded social inferences across fiv...
-
Hypothesis-driven Model Expansion under Uncertainty for Open-World Robot Planning
HUME lets robots generate, plan over, and actively verify object-centric hypotheses from foundation models so incomplete symbolic models become usable for open-world household tasks.
-
A Solver-Aided Hierarchical Language for LLM-Driven CAD Design
A solver-aided hierarchical DSL lets an untuned LLM generate precise, editable 2D CAD geometry from text prompts, outperforming OpenSCAD slightly on CLIP alignment.
-
Hindsight Planner: A Closed-Loop Few-Shot Planner for Embodied Instruction Following
A few-shot LLM planner for ALFRED that relabels suboptimal trajectories with hindsight prompts reaches 25.51 SR on Test Seen, approaching or beating the full-shot HLSM baseline.
-
Scaling Laws for State Dynamics in Large Language Models
LLM next-state prediction accuracy degrades with larger state spaces and sparser transitions, with state tracking distributed across several attention heads.
Discussion (0). Continue with ORCID to comment.