Pith. sign in

REVIEW 1 cited by

AI-Assisted Assessment of Coding Practices in Modern Code Review

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2405.13565 v1 pith:AMTXCUNM submitted 2024-05-22 cs.SE cs.AI

classification cs.SEcs.AI
keywords codepracticesbestsystemcodingmodernreviewautocommenter
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Modern code review is a process in which an incremental code contribution made by a code author is reviewed by one or more peers before it is committed to the version control system. An important element of modern code review is verifying that code contributions adhere to best practices. While some of these best practices can be automatically verified, verifying others is commonly left to human reviewers. This paper reports on the development, deployment, and evaluation of AutoCommenter, a system backed by a large language model that automatically learns and enforces coding best practices. We implemented AutoCommenter for four programming languages (C++, Java, Python, and Go) and evaluated its performance and adoption in a large industrial setting. Our evaluation shows that an end-to-end system for learning and enforcing coding best practices is feasible and has a positive impact on the developer workflow. Additionally, this paper reports on the challenges associated with deploying such a system to tens of thousands of developers and the corresponding lessons learned.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Too Noisy To Learn: Enhancing Data Quality for Code Review Comment Generation

    cs.SE 2025-02 conditional novelty 5.0 of 10

    LLM-filtered training data containing only actionable review comments improves code review comment generation despite shrinking the training set by 25-66%.

Pith tools