REVIEW 6 cited by
Can We Trust AI-Generated Educational Content? Comparative Analysis of Human and AI-Generated Learning Resources
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
As an increasing number of students move to online learning platforms that deliver personalized learning experiences, there is a great need for the production of high-quality educational content. Large language models (LLMs) appear to offer a promising solution to the rapid creation of learning materials at scale, reducing the burden on instructors. In this study, we investigated the potential for LLMs to produce learning resources in an introductory programming context, by comparing the quality of the resources generated by an LLM with those created by students as part of a learnersourcing activity. Using a blind evaluation, students rated the correctness and helpfulness of resources generated by AI and their peers, after both were initially provided with identical exemplars. Our results show that the quality of AI-generated resources, as perceived by students, is equivalent to the quality of resources generated by their peers. This suggests that AI-generated resources may serve as viable supplementary material in certain contexts. Resources generated by LLMs tend to closely mirror the given exemplars, whereas student-generated resources exhibit greater variety in terms of content length and specific syntax features used. The study highlights the need for further research exploring different types of learning resources and a broader range of subject areas, and understanding the long-term impact of AI-generated resources on learning outcomes.
Forward citations
Cited by 6 Pith papers
-
From Misunderstandings to Learning Opportunities: Leveraging Generative AI in Discussion Forums to Support Student Learning
M2M applies LLMs with retrieval-augmented generation to student forum posts to identify class-level misunderstandings and generate targeted learning resources, evaluated qualitatively with five instructors.
-
To Google or To ChatGPT? A Comparison of CS2 Students' Information Gathering Approaches and Outcomes
In a 32-participant within-subjects study, CS2 students scored significantly better on a conceptual quiz for currying when learning via web search than via ChatGPT, while query behavior differed markedly between the t...
-
LLM-Generated Feedback Supports Learning If Learners Choose to Use It
On-demand AI feedback produced small posttest gains for tutors who chose to use it, with significant benefits in two of seven lessons and no extra time.
-
How Large Language Models Are Changing MOOC Essay Answers: A Comparison of Pre- and Post-LLM Responses
Student essays in a large MOOC became longer, less lexically varied, and more likely to contain LLM-associated words after ChatGPT's release, while broad essay topics stayed similar.
-
Beyond the Hype: A Comprehensive Review of Current Trends in Generative AI Research, Teaching Practices, and Tools
Computing educators are adopting GenAI faster than they are formalizing policies, and both educators and developers see code reading, evaluation, and problem decomposition as rising in importance over syntax recall.
-
Designing Effective LLM-Assisted Interfaces for Curriculum Development
A clickable interface with predefined commands improves teachers' perceived usability and reduces workload compared with a ChatGPT-style chat interface for course outline creation.
Discussion (0). Continue with ORCID to comment.