REVIEW 4 cited by
Impact of Guidance and Interaction Strategies for LLM Use on Learner Performance and Perception
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Impact of Guidance and Interaction Strategies for LLM Use on Learner Performance and Perception
read the original abstract
Personalized chatbot-based teaching assistants can be crucial in addressing increasing classroom sizes, especially where direct teacher presence is limited. Large language models (LLMs) offer a promising avenue, with increasing research exploring their educational utility. However, the challenge lies not only in establishing the efficacy of LLMs but also in discerning the nuances of interaction between learners and these models, which impact learners' engagement and results. We conducted a formative study in an undergraduate computer science classroom (N=145) and a controlled experiment on Prolific (N=356) to explore the impact of four pedagogically informed guidance strategies on the learners' performance, confidence and trust in LLMs. Direct LLM answers marginally improved performance, while refining student solutions fostered trust. Structured guidance reduced random queries as well as instances of students copy-pasting assignment questions to the LLM. Our work highlights the role that teachers can play in shaping LLM-supported learning environments.
Forward citations
Cited by 4 Pith papers
-
It Matters How You Say It: Exploring Rhetorical Patterns for AI-Assisted Information Evaluation
In a 98-participant fact-checking study, the rhetorical style of AI advice changed accuracy, confidence, and preference, with step-by-step explanations helping most and user preference diverging from performance.
-
Can Vision Language Models Be Adaptive in Mathematics Education? A Learner Model-based Rubric Study
Introduces a rubric drawn from adaptive learning frameworks to assess VLMs on adaptivity, correctness, and quality in math instruction, finding measurable differences but inconsistent performance with limited learner ...
-
Enhanced Self-Learning with Epistemologically-Informed LLM Dialogue
CausaDisco integrates Aristotle's Four Causes into LLM prompts to produce more engaging, exploratory, and multifaceted self-learning dialogues, as evidenced by controlled user studies.
-
Humanizing Automated Programming Feedback: Fine-Tuning Generative Models with Student-Written Feedback
Fine-tuning small open language models on student-written feedback produces shorter and more accurate feedback than prompt engineering on the same 30 programs, but the test set overlaps the training data.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.