Pith. sign in

REVIEW 1 cited by

Evolutionary Prompt Design for LLM-Based Post-ASR Error Correction

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2407.16370 v1 pith:NC34GZ3K submitted 2024-07-23 cs.CL cs.SDeess.AS

classification cs.CLcs.SDeess.AS
keywords promptpromptscorrectionerrorllmseffectiveevolutionaryinitial
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
abstract

Building upon the strength of modern large language models (LLMs), generative error correction (GEC) has emerged as a promising paradigm that can elevate the performance of modern automatic speech recognition (ASR) systems. One representative approach is to leverage in-context learning to prompt LLMs so that a better hypothesis can be generated by the LLMs based on a carefully-designed prompt and an $N$-best list of hypotheses produced by ASR systems. However, it is yet unknown whether the existing prompts are the most effective ones for the task of post-ASR error correction. In this context, this paper first explores alternative prompts to identify an initial set of effective prompts, and then proposes to employ an evolutionary prompt optimization algorithm to refine the initial prompts. Evaluations results on the CHiME-4 subset of the Task $1$ of the SLT $2024$ GenSEC challenge show the effectiveness and potential of the proposed algorithms.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. An approach to measuring the performance of Automatic Speech Recognition (ASR) models in the context of Large Language Model (LLM) powered applications

    eess.AS 2025-07 reject novelty 5.0 of 10

    The paper introduces AER, an LLM-judged question-answering metric for evaluating ASR output in LLM applications, and shows it does not correlate strongly with WER.

Pith tools