REVIEW 8 cited by
Is ChatGPT Transforming Academics' Writing Style?
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Based on one million arXiv papers submitted from May 2018 to January 2024, we assess the textual density of ChatGPT's writing style in their abstracts through a statistical analysis of word frequency changes. Our model is calibrated and validated on a mixture of real abstracts and ChatGPT-modified abstracts (simulated data) after a careful noise analysis. The words used for estimation are not fixed but adaptive, including those with decreasing frequency. We find that large language models (LLMs), represented by ChatGPT, are having an increasing impact on arXiv abstracts, especially in the field of computer science, where the fraction of LLM-style abstracts is estimated to be approximately 35%, if we take the responses of GPT-3.5 to one simple prompt, "revise the following sentences", as a baseline. We conclude with an analysis of both positive and negative aspects of the penetration of LLMs into academics' writing style.
Forward citations
Cited by 8 Pith papers
-
Most biomedical publications show signs of LLM-assisted writing
An analysis of 1.19 million biomedical papers estimates that 89% showed signs of LLM-assisted writing by December 2025, using extrapolated word frequencies.
-
Human-LLM Coevolution: Evidence from Academic Writing
After ChatGPT-style words were publicly flagged in early 2024, their frequency in arXiv abstracts dropped, while other common LLM-favored words kept rising, suggesting authors are adapting their writing to avoid detection.
-
Who Gets Seen in the Age of AI? Adoption Patterns of Large Language Models in Scholarly Writing and Citation Outcomes
Analyzing 98,000 Scopus computer science papers, the paper finds a global rise in AI-like writing after ChatGPT and reports regional differences in citation returns, but the key differential-gain result is statistical...
-
How Large Language Models Are Changing MOOC Essay Answers: A Comparison of Pre- and Post-LLM Responses
Student essays in a large MOOC became longer, less lexically varied, and more likely to contain LLM-associated words after ChatGPT's release, while broad essay topics stayed similar.
-
Humans Coexist, So Must Embodied Artificial Agents
Coexistence, defined as sustained meaningful and reciprocal interaction among an agent, humans, and environment, is presented as a necessary design goal for embodied AI.
-
Benchmarking Linguistic Diversity of Large Language Models
State-of-the-art LLMs generate less linguistically diverse text than humans on creative tasks, and several training and deployment choices systematically shift lexical, syntactic, and semantic diversity.
-
AIGS: Generating Science from AI-Powered Automated Falsification
Baby-AIGS is a multi-agent system that automates research through explicit falsification, outperforming its baseline on three ML tasks but lagging human experts.
-
NLLG Quarterly arXiv Report 09/24: What are the most influential current AI Papers?
A quarterly bibliometric report identifies the top-40 most influential AI arXiv papers of 2023-2024 and finds that they show fewer AI-generated text markers than random papers.
Discussion (0). Continue with ORCID to comment.