REVIEW 4 cited by
Distilling Script Knowledge from Large Language Models for Constrained Language Planning
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
In everyday life, humans often plan their actions by following step-by-step instructions in the form of goal-oriented scripts. Previous work has exploited language models (LMs) to plan for abstract goals of stereotypical activities (e.g., "make a cake"), but leaves more specific goals with multi-facet constraints understudied (e.g., "make a cake for diabetics"). In this paper, we define the task of constrained language planning for the first time. We propose an overgenerate-then-filter approach to improve large language models (LLMs) on this task, and use it to distill a novel constrained language planning dataset, CoScript, which consists of 55,000 scripts. Empirical results demonstrate that our method significantly improves the constrained language planning ability of LLMs, especially on constraint faithfulness. Furthermore, CoScript is demonstrated to be quite effective in endowing smaller LMs with constrained language planning ability.
Forward citations
Cited by 4 Pith papers
-
Chain-of-Models: Cross-Model Auditing for Bias-Robust LLM Judges
Per-bias selection of a cross-family LLM auditor lifts biased-judgment accuracy from 0.805/0.824 baselines to 0.884.
-
Comet: Accelerating Private Inference for Large Language Model by Predicting Activation Sparsity
Comet accelerates MPC-based private LLM inference by securely predicting and skipping zero-valued neuron activations, achieving up to 2.6x speedup with about 1.5% accuracy loss.
-
Task Scheduling for Efficient Inference of Large Language Models on Single Moderate GPU Systems
ScheInfer partitions MLP and MoE weights into CPU, GPU, and transfer slices, then solves the optimal split with a fitted performance model.
-
PLANET: A Collection of Benchmarks for Evaluating LLMs' Planning Capabilities
A survey that catalogs and categorizes existing planning benchmarks for LLM agents and lists open gaps, without introducing new benchmarks, data, or experimental results.
Discussion (0). Continue with ORCID to comment.