GenAI Content Detection Task 1: English and Multilingual Machine-Generated Text Detection: AI vs. Human

Akim Tsvigun; Alham Fikri Aji; Artem Shelmanov; Ekaterina Artemova; Giovanni Puccetti; Iryna Gurevych; Jiahui Geng; Jinyan Su; Jonibek Mansurov; Kareem Ashraf Elozeiri

GenAI Content Detection Task 1: English and Multilingual Machine-Generated Text Detection: AI vs. Human

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2501.11012 v2 pith:FYJTOBRQ submitted 2025-01-19 cs.CL

Yuxia Wang , Artem Shelmanov , Jonibek Mansurov , Akim Tsvigun , Vladislav Mikhailov , Rui Xing , Zhuohan Xie , Jiahui Geng

show 18 more authors

Giovanni Puccetti Ekaterina Artemova Jinyan Su Minh Ngoc Ta Mervat Abassy Kareem Ashraf Elozeiri Saad El Dine Ahmed El Etter Maiya Goloburda Tarek Mahmoud Raj Vardhan Tomar Nurkhan Laiyk Osama Mohammed Afzal Ryuto Koike Masahiro Kaneko Alham Fikri Aji Nizar Habash Iryna Gurevych Preslav Nakov

This is my paper · ORCID

classification cs.CL

keywords taskdetectiongenaimultilingualcontentenglishmonolingualshared

verification ladder T0 review T1 audit T2 compute T3 formal

0 comments

read the original abstract

We present the GenAI Content Detection Task~1 -- a shared task on binary machine generated text detection, conducted as a part of the GenAI workshop at COLING 2025. The task consists of two subtasks: Monolingual (English) and Multilingual. The shared task attracted many participants: 36 teams made official submissions to the Monolingual subtask during the test phase and 26 teams -- to the Multilingual. We provide a comprehensive overview of the data, a summary of the results -- including system rankings and performance scores -- detailed descriptions of the participating systems, and an in-depth analysis of submissions. https://github.com/mbzuai-nlp/COLING-2025-Workshop-on-MGT-Detection-Task1

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

Human-LLM Coevolution: Evidence from Academic Writing
cs.CL 2025-02 conditional novelty 6.0 of 10

After ChatGPT-style words were publicly flagged in early 2024, their frequency in arXiv abstracts dropped, while other common LLM-favored words kept rising, suggesting authors are adapting their writing to avoid detection.

Pith tools