CommitSuite is a large benchmark for commit classification and message generation that includes AST-level changes and LLM annotations, together with a reference-free evaluation framework achieving 0.849 Cohen's Kappa with humans.
Title resolution pending
4 Pith papers cite this work. Polarity classification is still indexing.
4
Pith papers citing it
citation-role summary
background 1
citation-polarity summary
fields
cs.SE 4years
2026 4roles
background 1polarities
background 1representative citing papers
DebugRepair improves LLM-based automated program repair by adding test semantic purification, simulated instrumentation, and debugging-driven conversational repair, fixing 224 Defects4J bugs with GPT-3.5 (26.2% above prior SOTA) and 295 with DeepSeek-V3.
A systematic mapping of 97 papers finds growing research on commit messages for bug analysis and fix identification, mainly combined with code diffs via repository mining and AI/ML, with developers as primary stakeholders, though messages frequently lack key details.
citing papers explorer
-
CommitSuite: A Comprehensive Benchmark for Commit Classification and Message Generation
CommitSuite is a large benchmark for commit classification and message generation that includes AST-level changes and LLM annotations, together with a reference-free evaluation framework achieving 0.849 Cohen's Kappa with humans.
-
DebugRepair: Enhancing LLM-Based Automated Program Repair via Self-Directed Debugging
DebugRepair improves LLM-based automated program repair by adding test semantic purification, simulated instrumentation, and debugging-driven conversational repair, fixing 224 Defects4J bugs with GPT-3.5 (26.2% above prior SOTA) and 295 with DeepSeek-V3.
-
On the Use of Commit Messages for Corrective Software Maintenance: A Systematic Mapping Study
A systematic mapping of 97 papers finds growing research on commit messages for bug analysis and fix identification, mainly combined with code diffs via repository mining and AI/ML, with developers as primary stakeholders, though messages frequently lack key details.
- XSearch: Explainable Code Search via Concept-to-Code Alignment