Pith. sign in

REVIEW 4 cited by

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2402.11489 v2 pith:OCX644AU submitted 2024-02-18 cs.CL

What's the Plan? Evaluating and Developing Planning-Aware Techniques for Language Models

classification cs.CL
keywords planningllmsdemonstratelanguagemodelssimplanachieveacross
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

Planning is a fundamental task in artificial intelligence that involves finding a sequence of actions that achieve a specified goal in a given environment. Large language models (LLMs) are increasingly used for applications that require planning capabilities, such as web or embodied agents. In line with recent studies, we demonstrate through experimentation that LLMs lack necessary skills required for planning. Based on these observations, we advocate for the potential of a hybrid approach that combines LLMs with classical planning methodology. Then, we introduce SimPlan, a novel hybrid-method, and evaluate its performance in a new challenging setup. Our extensive experiments across various planning domains demonstrate that SimPlan significantly outperforms existing LLM-based planners.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. A Close Look At World Model Recovery In Supervised Fine-Tuned LLM Planners

    cs.LG 2026-06 unverdicted novelty 6.0

    Supervised fine-tuning lets LLMs linearly encode action validity and state predicates, with broader state-space coverage during training improving world-model recovery.

  2. Verbalized Algorithms: Classical Algorithms are All You Need (Mostly)

    cs.CL 2025-09 unverdicted novelty 6.0

    Verbalized algorithms integrate LLMs as oracles for simple string operations within classical algorithms to improve accuracy-runtime tradeoffs on sorting, clustering, submodular maximization, and multi-hop QA.

  3. End-to-End LLM Flight Planning with RAG-based Memory and Multi-modal Coach Agent

    cs.RO 2026-07 conditional novelty 5.0

    FRAMe combines an LLM planner with RAG-based memory and a multi-modal coach agent to generate valid, preference-aligned eVTOL flight plans, achieving up to 93.8% validity across four LLMs.

  4. An LLM-Based Assistance System for Intuitive and Flexible Capability-Based Planning

    cs.AI 2026-05 unverdicted novelty 5.0

    Hybrid LLM-SMT assistance system for capability-based planning that supports natural-language interaction, result interpretation, and iterative knowledge-model adaptation under human approval.