REVIEW 4 cited by
The Rise of AI-Generated Content in Wikipedia
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
The rise of AI-generated content in popular information sources raises significant concerns about accountability, accuracy, and bias amplification. Beyond directly impacting consumers, the widespread presence of this content poses questions for the long-term viability of training language models on vast internet sweeps. We use GPTZero, a proprietary AI detector, and Binoculars, an open-source alternative, to establish lower bounds on the presence of AI-generated content in recently created Wikipedia pages. Both detectors reveal a marked increase in AI-generated content in recent pages compared to those from before the release of GPT-3.5. With thresholds calibrated to achieve a 1% false positive rate on pre-GPT-3.5 articles, detectors flag over 5% of newly created English Wikipedia articles as AI-generated, with lower percentages for German, French, and Italian articles. Flagged Wikipedia articles are typically of lower quality and are often self-promotional or partial towards a specific viewpoint on controversial topics.
Forward citations
Cited by 4 Pith papers
-
Can Generative Artificial Intelligence Survive Data Contamination? Theoretical Guarantees under Contaminated Recursive Training
Contaminated recursive training converges to the true distribution at rate t^{-min(p, α)} — the slower of the model's baseline rate p and the real-data fraction α.
-
LLMs in Wikipedia: Investigating How LLMs Impact Participation in Knowledge Communities
Wikipedia editors who used LLMs reported that experienced editors expanded their contributions, while newcomers were pushed into editorial judgment they lacked skills for and saw their LLM-assisted edits rejected.
-
WETBench: A Benchmark for Detecting Task-Specific Machine-Generated Text on Wikipedia
WETBench shows that existing machine-generated text detectors, particularly zero-shot methods, underperform on task-specific Wikipedia editing scenarios, with supervised detectors averaging 78% accuracy and zero-shot ...
-
The Widespread Adoption of Large Language Model-Assisted Writing Across Society
LLM-assisted writing rose sharply after ChatGPT's launch and plateaued by 2024, reaching estimated shares of roughly 18% in consumer complaints, 24% in corporate press releases, 14% in UN releases, and up to 15% in sm...
Discussion (0). Continue with ORCID to comment.