Pith. sign in

REVIEW 4 cited by

A Survey of Automatic Prompt Optimization with Instruction-focused Heuristic-based Search Algorithm

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2502.18746 v2 pith:CX6UHTFD submitted 2025-02-26 cs.CL

A Survey of Automatic Prompt Optimization with Instruction-focused Heuristic-based Search Algorithm

Wendi Cui , Zhuohang Li , Hao Sun , Damien Lopez , Kamalika Das , Bradley A. Malin , Sricharan Kumar , Jiaxin Zhang This is my paper
classification cs.CL
keywords optimizationpromptpromptssearchalgorithmsautomaticheuristic-basedlanguage
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

Recent advances in Large Language Models have led to remarkable achievements across a variety of Natural Language Processing tasks, making prompt engineering increasingly central to guiding model outputs. While manual methods can be effective, they typically rely on intuition and do not automatically refine prompts over time. In contrast, automatic prompt optimization employing heuristic-based search algorithms can systematically explore and improve prompts with minimal human oversight. This survey proposes a comprehensive taxonomy of these methods, categorizing them by where optimization occurs, what is optimized, what criteria drive the optimization, which operators generate new prompts, and which iterative search algorithms are applied. We further highlight specialized datasets and tools that support and accelerate automated prompt refinement. We conclude by discussing key open challenges pointing toward future opportunities for more robust and versatile LLM applications.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Model Context Protocol (MCP) Tool Descriptions Are Smelly! Towards Improving AI Agent Efficiency with Augmented MCP Tool Descriptions

    cs.SE 2026-02 conditional novelty 6.0

    Most MCP tool descriptions (97.1%) contain quality smells, and augmenting them improves agent success by a median of 5.85 percentage points at a 67.46% increase in execution steps.

  2. Self-Prompting Small Language Models for Privacy-Sensitive Clinical Information Extraction

    cs.CL 2026-05 unverdicted novelty 5.0

    Small open-weight language models can self-optimize prompts for clinical named entity recognition in dental notes, reaching micro F1 of 0.864 after DPO on Qwen2.5-14B.

  3. Self-Prompting Small Language Models for Privacy-Sensitive Clinical Information Extraction

    cs.CL 2026-05 unverdicted novelty 4.0

    Self-prompting combined with QLoRA and DPO on small open-weight models yields micro F1 scores up to 0.864 on clinical named entity recognition from 1,200 dental notes.

  4. Towards Efficient and Robust Linguistic Emotion Diagnosis for Mental Health via Multi-Agent Instruction Refinement

    cs.AI 2026-01 reject novelty 4.0

    A multi-agent prompt-rewriting loop is claimed to improve LLM emotion diagnosis accuracy, but its evaluation appears to optimize on the test set and lacks replication details.