REVIEW 5 cited by
Exploring Large Language Models for Code Explanation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Automating code documentation through explanatory text can prove highly beneficial in code understanding. Large Language Models (LLMs) have made remarkable strides in Natural Language Processing, especially within software engineering tasks such as code generation and code summarization. This study specifically delves into the task of generating natural-language summaries for code snippets, using various LLMs. The findings indicate that Code LLMs outperform their generic counterparts, and zero-shot methods yield superior results when dealing with datasets with dissimilar distributions between training and testing sets.
Forward citations
Cited by 5 Pith papers
-
Selective Shot Learning for Code Explanation
SSL_ner, a named-entity-based few-shot example selector, improves code explanation over token-based selection but not significantly over embedding-based selection across open-source Code-LLMs.
-
Can the Rookies Cut the Tough Cookie? Exploring the Use of LLMs for SQL Equivalence Checking
LLMs, especially GPT-4, can classify SQL query equivalence on complex real-world assignment queries far beyond formal tools' coverage, but they systematically over-predict equivalence.
-
ASSERTIFY: Utilizing Large Language Models to Generate Assertions for Production Code
A prompt-engineered LLM pipeline can generate production code assertions with up to 83.5% compile accuracy and 0.526 ROUGE-L similarity to developer-written assertions.
-
From Critique to Clarity: A Pathway to Faithful and Personalized Code Explanations with Large Language Models
An iterative two-loop LLM pipeline (a faithfulness loop with execution-based checks and a personalization loop with a role-playing judge) produces code explanations that score higher on automatic metrics than simpler ...
-
Evaluation of LLMs for mathematical problem solving
A three-model, three-dataset LLM math evaluation using a multi-dimensional reasoning rubric, undermined by contradictory accuracy tables.
Discussion (0). Continue with ORCID to comment.