CommitSuite is a large benchmark for commit classification and message generation that includes AST-level changes and LLM annotations, together with a reference-free evaluation framework achieving 0.849 Cohen's Kappa with humans.
Title resolution pending
2 Pith papers cite this work. Polarity classification is still indexing.
2
Pith papers citing it
citation-role summary
background 1
citation-polarity summary
fields
cs.SE 2years
2026 2verdicts
UNVERDICTED 2roles
background 1polarities
background 1representative citing papers
A systematic mapping of 97 papers finds growing research on commit messages for bug analysis and fix identification, mainly combined with code diffs via repository mining and AI/ML, with developers as primary stakeholders, though messages frequently lack key details.
citing papers explorer
-
CommitSuite: A Comprehensive Benchmark for Commit Classification and Message Generation
CommitSuite is a large benchmark for commit classification and message generation that includes AST-level changes and LLM annotations, together with a reference-free evaluation framework achieving 0.849 Cohen's Kappa with humans.
-
On the Use of Commit Messages for Corrective Software Maintenance: A Systematic Mapping Study
A systematic mapping of 97 papers finds growing research on commit messages for bug analysis and fix identification, mainly combined with code diffs via repository mining and AI/ML, with developers as primary stakeholders, though messages frequently lack key details.