REVIEW 2 cited by
Interleaving Natural Language Prompting with Code Editing for Solving Programming Tasks with Generative AI Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Interleaving Natural Language Prompting with Code Editing for Solving Programming Tasks with Generative AI Models
read the original abstract
Modern computing students often rely on both natural-language prompting and manual code editing to solve programming tasks. Yet we still lack a clear understanding of how these two modes are combined in practice, and how their usage varies with task complexity and student ability. In this paper, we investigate this through a large-scale study in an introductory programming course, collecting 13,305 interactions from 355 students during a three-day lab activity. Our analysis shows that students primarily use prompting to generate initial solutions, and then often enter short edit-run loops to refine their code following a failed execution. Student reflections confirm that prompting is helpful for structuring solutions, editing is effective for making targeted corrections, while both are useful for learning. We find that manual editing becomes more frequent as task complexity increases, but most edits remain concise, with many affecting a single line of code. Higher-performing students succeed with less reliance on editing and fewer overall interactions. These findings highlight the role of manual editing as a form of last-mile repair, complementing prompting in AI-assisted programming workflows.
Forward citations
Cited by 2 Pith papers
-
Commenting with Copilot: A Taxonomy and Multi-Year Analysis of Student Code-Generation Specifications
In four years of Copilot tasks, students wrote mostly natural-language What comments, used more How comments for procedural constructs, and focused effort on verifying output rather than rewriting comments.
-
Say What? Examining Text and Voice Input Modalities for Prompt-Based Programming in Computing Education
Among 919 intro CS students solving Prompt Problems, typed prompts beat unedited voice on first-attempt success for two of three tasks; edited voice matched text, and most preferred text.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.