pith. sign in

arxiv: 2504.13038 · v1 · pith:YIO5DMFQnew · submitted 2025-04-17 · 💻 cs.CY · cs.CL

How Large Language Models Are Changing MOOC Essay Answers: A Comparison of Pre- and Post-LLM Responses

Leo Lepp\"anen , Lili Aunimo , Arto Hellas , Jukka K. Nurminen , Linda Mannila This is my paper
classification 💻 cs.CY cs.CL
keywords academicchatgptessayssomestudentchangesdatasetessay
0
0 comments X
read the original abstract

The release of ChatGPT in late 2022 caused a flurry of activity and concern in the academic and educational communities. Some see the tool's ability to generate human-like text that passes at least cursory inspections for factual accuracy ``often enough'' a golden age of information retrieval and computer-assisted learning. Some, on the other hand, worry the tool may lead to unprecedented levels of academic dishonesty and cheating. In this work, we quantify some of the effects of the emergence of Large Language Models (LLMs) on online education by analyzing a multi-year dataset of student essay responses from a free university-level MOOC on AI ethics. Our dataset includes essays submitted both before and after ChatGPT's release. We find that the launch of ChatGPT coincided with significant changes in both the length and style of student essays, mirroring observations in other contexts such as academic publishing. We also observe -- as expected based on related public discourse -- changes in prevalence of key content words related to AI and LLMs, but not necessarily the general themes or topics discussed in the student essays as identified through (dynamic) topic modeling.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. The Crutch or the Ceiling? How Different Generations of LLMs Shape EFL Student Writings

    cs.HC 2026-04 unverdicted novelty 4.0

    Advanced LLMs improve EFL writing scores and diversity for lower-proficiency students but correlate with lower expert ratings on deep coherence, acting more as crutches than scaffolds.

  2. Measuring Changes in Instructor Class Design and Student Learning After the Release of Large Language Models (LLMs)

    cs.CY 2026-04 unverdicted novelty 4.0

    A pilot mixed-methods study at one university uses surveys and pre/post-LLM grade data to document patterns in faculty course design and student learning outcomes after generative AI release.