An LLM scored students' written computational thinking responses in an introductory physics course with human-level agreement on well-defined practices and reproduced pre-post growth trends at scale.
Towards Just-in-Time Adaptive Feedback: Enhancing Student Learning via Knowledge-Grounded LLM
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Educational interventions are effective tools for enhancing student learning. While Large Language Models (LLMs) allow for generating adaptive feedback at scale, current studies lack clear methodologies for providing Just-in-Time (JiT) feedback in authentic instructional settings. In this paper, we present a framework that provides adaptive feedback by grounding LLMs with domain-specific expert knowledge. Our approach collects written reasoning logic (strategy essays) from students, analyzes potential error types based on the content of that reasoning, and delivers non-intrusive feedback designed to clarify missing or incorrect concepts. We deploy this framework in a large-scale university course (N > 1000), where it improved student performance by over 80% compared to previous semesters. Lastly, we validate the framework's pedagogical utility by analyzing the learning trajectories; we demonstrate how iterative conversations with LLM facilitate shifting one's misconception to correct understanding.
citation-role summary
citation-polarity summary
fields
physics.ed-ph 1years
2026 1verdicts
CONDITIONAL 1roles
background 1polarities
background 1representative citing papers
citing papers explorer
-
Using LLMs to Detect Growth in Computational Thinking in Introductory Physics
An LLM scored students' written computational thinking responses in an introductory physics course with human-level agreement on well-defined practices and reproduced pre-post growth trends at scale.