REVIEW 7 cited by
HowkGPT: Investigating the Detection of ChatGPT-generated University Student Homework through Context-Aware Perplexity Analysis
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
As the use of Large Language Models (LLMs) in text generation tasks proliferates, concerns arise over their potential to compromise academic integrity. The education sector currently tussles with distinguishing student-authored homework assignments from AI-generated ones. This paper addresses the challenge by introducing HowkGPT, designed to identify homework assignments generated by AI. HowkGPT is built upon a dataset of academic assignments and accompanying metadata [17] and employs a pretrained LLM to compute perplexity scores for student-authored and ChatGPT-generated responses. These scores then assist in establishing a threshold for discerning the origin of a submitted assignment. Given the specificity and contextual nature of academic work, HowkGPT further refines its analysis by defining category-specific thresholds derived from the metadata, enhancing the precision of the detection. This study emphasizes the critical need for effective strategies to uphold academic integrity amidst the growing influence of LLMs and provides an approach to ensuring fair and accurate grading in educational institutions.
Forward citations
Cited by 7 Pith papers
-
Fast segmentation of watermarked texts from large language models through an epidemic change-point framework
WISER is a linear-time, provably consistent algorithm that localizes multiple watermarked segments in mixed-source texts by treating pivot statistics as an epidemic change-point sequence.
-
Authorship Attribution in Multilingual Machine-Generated Texts
A systematic benchmark of multilingual authorship attribution shows fine-tuned LLM detectors exceed 0.9 macro F1 in-language but transfer poorly across languages, with Russian training generalizing better than English.
-
Are We in the AI-Generated Text World Already? Quantifying and Monitoring AIGT on Social Media
A detector trained on a new multi-LLM social media benchmark estimates that AI-generated text on Medium and Quora grew from about 2% to roughly 37 to 39 percent between 2022 and 2024, while Reddit stayed near 2%.
-
GenAI Content Detection Task 1: English and Multilingual Machine-Generated Text Detection: AI vs. Human
A COLING 2025 shared task benchmark showing that current machine-generated text detectors reach only moderate accuracy and degrade badly on out-of-domain and humanized AI text.
-
Towards Inclusive Toxic Content Moderation: Addressing Vulnerabilities to Adversarial Attacks in Toxicity Classifiers Tackling LLM-generated Content
Zeroing attack-vulnerable attention heads improves BERT/RoBERTa toxicity classifier accuracy on PGD-adversarial inputs, with distinct heads implicated per demographic group.
-
Survey on AI-Generated Media Detection: From Non-MLLM to MLLM
A survey organizing AI-generated media detection into Non-MLLM and MLLM based methods, with task and benchmark taxonomies.
-
Watermarking across Modalities for Content Tracing and Generative AI
A thesis showing that invisible watermarks can be embedded across images, audio, text, and model weights, with statistical tests for tracing AI-generated content.
Discussion (0). Continue with ORCID to comment.