Pith. sign in

REVIEW 4 cited by

AI Meets the Classroom: When Do Large Language Models Harm Learning?

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2409.09047 v2 pith:HUUOKDQM submitted 2024-08-29 cs.CY cs.AIcs.HCcs.LG

AI Meets the Classroom: When Do Large Language Models Harm Learning?

classification cs.CY cs.AIcs.HCcs.LG
keywords llmslearningstudentseffectincreaseactivitieslanguagelarge
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

The effect of large language models (LLMs) in education is debated: Previous research shows that LLMs can help as well as hurt learning. In two pre-registered and incentivized laboratory experiments, we find no effect of LLMs on overall learning outcomes. In exploratory analyses and a field study, we provide evidence that the effect of LLMs on learning outcomes depends on usage behavior. Students who substitute some of their learning activities with LLMs (e.g., by generating solutions to exercises) increase the volume of topics they can learn about but decrease their understanding of each topic. Students who complement their learning activities with LLMs (e.g., by asking for explanations) do not increase topic volume but do increase their understanding. We also observe that LLMs widen the gap between students with low and high prior knowledge. While LLMs show great potential to improve learning, their use must be tailored to the educational context and students' needs.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Generative AI Availability, Grades, and Student Satisfaction at a Large University

    cs.CY 2026-07 conditional novelty 6.0

    In a large-U.S.-university panel, courses with more GenAI-susceptible assessment weight show no significant post-ChatGPT rise in grades, withdrawal, or failure once pandemic effects are modeled; satisfaction effects a...

  2. Teaching Astronomy with Large Language Models

    physics.ed-ph 2025-06 unverdicted novelty 5.0

    Structured integration of LLMs in astronomy education, including a domain-specific tutor and documentation requirements, leads to improved AI literacy and reduced student reliance on AI over the semester.

  3. Preparing Students for AI-Powered Materials Discovery: A Workflow-Aligned Framework for AI Literacy, Equity, and Scientific Judgment

    physics.ed-ph 2026-05 unverdicted novelty 4.0

    This position paper advocates shifting AI education in materials discovery from basic tool access to a workflow-aligned literacy model that builds scientific judgment and equitable outcomes.

  4. Design and Deployment of a Course-Aware AI Tutor in an Introductory Programming Course

    cs.CY 2026-04 unverdicted novelty 4.0

    Design and deployment of a retrieval-augmented AI tutor in a Python course shows students using it for conceptual help and debugging while perceiving it as encouraging active engagement.