REVIEW 5 cited by
A large language model-assisted education tool to provide feedback on open-ended responses
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Open-ended questions are a favored tool among instructors for assessing student understanding and encouraging critical exploration of course material. Providing feedback for such responses is a time-consuming task that can lead to overwhelmed instructors and decreased feedback quality. Many instructors resort to simpler question formats, like multiple-choice questions, which provide immediate feedback but at the expense of personalized and insightful comments. Here, we present a tool that uses large language models (LLMs), guided by instructor-defined criteria, to automate responses to open-ended questions. Our tool delivers rapid personalized feedback, enabling students to quickly test their knowledge and identify areas for improvement. We provide open-source reference implementations both as a web application and as a Jupyter Notebook widget that can be used with instructional coding or math notebooks. With instructor guidance, LLMs hold promise to enhance student learning outcomes and elevate instructional methodologies.
Forward citations
Cited by 5 Pith papers
-
CRABS: A syntactic-semantic pincer strategy for bounding LLM interpretation of Python notebooks
CRABS combines AST bounds with an LLM to reconstruct information flow and execution dependency graphs for Python notebooks, reaching 98% F1 on 50 curated Kaggle notebooks.
-
DrawEduMath: Evaluating Vision Language Models with Expert-Annotated Students' Hand-Drawn Math Images
A new expert-annotated benchmark of students' handwritten math responses shows current vision language models perform poorly, especially on correctness and error-detection questions.
-
Classroom Simulacra: Building Contextual Student Generative Agents in Online Education for Learning Behavioral Simulation
A new reflection-based AI method makes LLM-generated virtual students predict real students' future quiz performance better than deep learning knowledge-tracing baselines.
-
A Zero-Shot LLM Framework for Automatic Assignment Grading in Higher Education
A zero-shot, prompt-engineered GPT-4 system can grade open-ended statistics homework and produce personalized feedback, but the evidence that it improves learning over traditional grading is limited by the survey design.
-
Agent4Edu: Generating Learner Response Data by Generative Agents for Intelligent Education Systems
Agent4Edu generates learner responses using LLM agents with profile, memory, and action modules, and shows small improvements over prior simulators and in CAT model training.
Discussion (0). Continue with ORCID to comment.