Pith. sign in

REVIEW 2 cited by

Explaining Code with a Purpose: An Integrated Approach for Developing Code Comprehension and Prompting Skills

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2403.06050 v1 pith:QY26PN2R submitted 2024-03-10 cs.HC cs.CYcs.SE

classification cs.HCcs.CYcs.SE
keywords codeeipeskillsquestionsllmscomprehensionstudentsability
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Reading, understanding and explaining code have traditionally been important skills for novices learning programming. As large language models (LLMs) become prevalent, these foundational skills are more important than ever given the increasing need to understand and evaluate model-generated code. Brand new skills are also needed, such as the ability to formulate clear prompts that can elicit intended code from an LLM. Thus, there is great interest in integrating pedagogical approaches for the development of both traditional coding competencies and the novel skills required to interact with LLMs. One effective way to develop and assess code comprehension ability is with ``Explain in plain English'' (EiPE) questions, where students succinctly explain the purpose of a fragment of code. However, grading EiPE questions has always been difficult given the subjective nature of evaluating written explanations and this has stifled their uptake. In this paper, we explore a natural synergy between EiPE questions and code-generating LLMs to overcome this limitation. We propose using an LLM to generate code based on students' responses to EiPE questions -- not only enabling EiPE responses to be assessed automatically, but helping students develop essential code comprehension and prompt crafting skills in parallel. We investigate this idea in an introductory programming course and report student success in creating effective prompts for solving EiPE questions. We also examine student perceptions of this activity and how it influences their views on the use of LLMs for aiding and assessing learning.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Hints Help Finding and Fixing Bugs Differently in Python and Text-based Program Representations

    cs.SE 2024-12 conditional novelty 7.0 of 10

    In a large crowd-sourced experiment, natural-language descriptions of buggy algorithms improved debugging accuracy over Python code for users who understood the task, while hints mainly helped users working with code.

  2. Beyond the Hype: A Comprehensive Review of Current Trends in Generative AI Research, Teaching Practices, and Tools

    cs.CY 2024-12 conditional novelty 5.0 of 10

    Computing educators are adopting GenAI faster than they are formalizing policies, and both educators and developers see code reading, evaluation, and problem decomposition as rising in importance over syntax recall.

Pith tools