REVIEW 5 cited by
Self-Edit: Fault-Aware Code Editor for Code Generation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Large language models (LLMs) have demonstrated an impressive ability to generate codes on competitive programming tasks. However, with limited sample numbers, LLMs still suffer from poor accuracy. Inspired by the process of human programming, we propose a generate-and-edit approach named Self-Edit that utilizes execution results of the generated code from LLMs to improve the code quality on the competitive programming task. We execute the generated code on the example test case provided in the question and wrap execution results into a supplementary comment. Utilizing this comment as guidance, our fault-aware code editor is employed to correct errors in the generated code. We perform extensive evaluations across two competitive programming datasets with nine different LLMs. Compared to directly generating from LLMs, our approach can improve the average of pass@1 by 89\% on APPS-dev, 31\% on APPS-test, and 48\% on HumanEval over nine popular code generation LLMs with parameter sizes ranging from 110M to 175B. Compared to other post-processing methods, our method demonstrates superior accuracy and efficiency.
Forward citations
Cited by 5 Pith papers
-
SemOpt: LLM-Driven Code Optimization via Rule-Based Analysis
SemOpt generates Semgrep static-analysis rules from LLM-summarized optimization commits and uses them to locate and apply optimization strategies, outperforming retrieval-based baselines on C/C++ code.
-
ReCode: Improving LLM-based Code Repair with Fine-Grained Retrieval-Augmented Generation
ReCode improves LLM-based code repair by combining algorithm-type prediction with dual-encoder retrieval of authentic bug-fix pairs, and introduces RACodeBench for evaluation.
-
Dr. Boot: Bootstrapping Program Synthesis Language Models to Perform Repairing
A bootstrapping algorithm that trains program synthesis models on their own successful outputs and on repaired failures modestly improves pass@k over regular fine-tuning on MBPP, with mixed results on APPS.
-
Aligning Requirement for Large Language Model's Code Generation
An LLM-based specification-alignment method that lifts the model's perceived requirements from generated code and applies ten alignment rules improves Pass@1 by about 30% over existing baselines.
-
Large Language Models for Next-Generation Wireless Network Management: A Survey and Tutorial
A survey and tutorial that organizes LLM-enabled wireless network optimization into formulation, solution, and verification stages, with case studies drawn from the authors' own prior papers.
Discussion (0). Continue with ORCID to comment.