Refining bug reports with hierarchical evidence from an unverified agent trajectory plus repository review raises Pass@1 on SWE-Bench Lite from 41% to 59.67% (GPT-5-mini) and similarly for other agents.
ImproBR: Bug Report Improver Using LLMs
2 Pith papers cite this work. Polarity classification is still indexing.
abstract
Bug tracking systems play a crucial role in software maintenance, yet developers frequently struggle with low-quality user-submitted reports that omit essential details such as Steps to Reproduce (S2R), Observed Behavior (OB), and Expected Behavior (EB). We propose ImproBR, an LLM-based pipeline that automatically detects and improves bug reports by addressing missing, incomplete, and ambiguous S2R, OB, and EB sections. ImproBR employs a hybrid detector combining fine-tuned DistilBERT, heuristic analysis, and an LLM analyzer, guided by GPT-4o mini with section-specific few-shot prompts and a Retrieval-Augmented Generation (RAG) pipeline grounded in Minecraft Wiki domain knowledge. Evaluated on Mojira, ImproBR improved structural completeness from 7.9% to 96.4%, more than doubled the proportion of executable S2R from 28.8% to 67.6%, and raised fully reproducible bug reports from 1 to 13 across 139 challenging real-world reports.
fields
cs.SE 2years
2026 2representative citing papers
Retrieval-augmented generation reaches 0.66 weighted F1 for invalid bug report subclassification while agentic web search reaches 68.9% Judge LLM success for no-code fix generation.
citing papers explorer
-
Bug Report Specification Refinement with Trajectory Guidance for Automated Program Repair
Refining bug reports with hierarchical evidence from an unverified agent trajectory plus repository review raises Pass@1 on SWE-Bench Lite from 41% to 59.67% (GPT-5-mini) and similarly for other agents.
-
Automated Root-Cause Subclassification and No-Code Fix Generation for Invalid Bug Reports
Retrieval-augmented generation reaches 0.66 weighted F1 for invalid bug report subclassification while agentic web search reaches 68.9% Judge LLM success for no-code fix generation.