pith:M5LOKMGP
Automated Root-Cause Subclassification and No-Code Fix Generation for Invalid Bug Reports
Large language models with retrieval and agent techniques can subclassify root causes of invalid bug reports and generate no-code fixes.
arxiv:2605.17561 v1 · 2026-05-17 · cs.SE · cs.AI · cs.MA
Add to your LaTeX paper
\usepackage{pith}
\pithnumber{M5LOKMGP6FHGYAWOSX23YLHQTS}
Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge
Record completeness
Claims
Retrieval augmented generation achieves the highest overall performance with 0.66 weighted F1 for subclassification of invalid bug reports, while agentic web search achieves the highest overall Judge LLM success rate at 68.9% for no-code fix generation.
The manually curated gold-standard benchmark accurately captures the distribution and labeling of invalid bug reports across real software projects and that the judge LLM evaluations align with human judgment of fix quality.
RAG reaches 0.66 weighted F1 on invalid bug report subclassification while agentic web search reaches 68.9% judge success on no-code fix generation, using a new gold-standard benchmark.
References
Formal links
Receipt and verification
| First computed | 2026-05-20T00:04:46.004490Z |
|---|---|
| Builder | pith-number-builder-2026-05-17-v1 |
| Signature | Pith Ed25519
(pith-v1-2026-05) · public key |
| Schema | pith-number/v1.0 |
Canonical hash
6756e530cff14e6c02ce95f5bc2cf09cbd74529bfd29e5cbd4eb28b5d8e3acbb
Aliases
· · · · ·Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/M5LOKMGP6FHGYAWOSX23YLHQTS \
| jq -c '.canonical_record' \
| python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 6756e530cff14e6c02ce95f5bc2cf09cbd74529bfd29e5cbd4eb28b5d8e3acbb
Canonical record JSON
{
"metadata": {
"abstract_canon_sha256": "2c87656401e1d2bb6ef3c6aa23d30ef10d86f2ca6af9035a6d04820ad9c5d51f",
"cross_cats_sorted": [
"cs.AI",
"cs.MA"
],
"license": "http://creativecommons.org/licenses/by/4.0/",
"primary_cat": "cs.SE",
"submitted_at": "2026-05-17T17:45:13Z",
"title_canon_sha256": "27e08a3136ee2c5b59ef466e885e339e5464d65982514373f7f1246dd80b0a7f"
},
"schema_version": "1.0",
"source": {
"id": "2605.17561",
"kind": "arxiv",
"version": 1
}
}