REVIEW 7 cited by
Toxic Bias: Perspective API Misreads German as More Toxic
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Proprietary public APIs play a crucial and growing role as research tools among social scientists. Among such APIs, Google's machine learning-based Perspective API is extensively utilized for assessing the toxicity of social media messages, providing both an important resource for researchers and automatic content moderation. However, this paper exposes an important bias in Perspective API concerning German language text. Through an in-depth examination of several datasets, we uncover intrinsic language biases within the multilingual model of Perspective API. We find that the toxicity assessment of German content produces significantly higher toxicity levels than other languages. This finding is robust across various translations, topics, and data sources, and has significant consequences for both research and moderation strategies that rely on Perspective API. For instance, we show that, on average, four times more tweets and users would be moderated when using the German language compared to their English translation. Our findings point to broader risks associated with the widespread use of proprietary APIs within the computational social sciences.
Forward citations
Cited by 7 Pith papers
-
HateDay: Insights from a Global Hate Speech Dataset Representative of a Day on Twitter
HateDay provides a representative global sample of one day of Twitter and shows that hate speech detection models achieve much lower average precision on real-world data than on academic datasets.
-
Evaluating Chinese Large Language Models: The Influence of Persona Assignment on Stereotypes and Safeguards
Assigning personas to Chinese LLMs amplifies toxic output relative to default behavior, while refusal rates shift systematically with persona gender and target social group.
-
Watching the AI Watchdogs: A Fairness and Robustness Analysis of AI Safety Moderation Classifiers
A fairness and robustness audit of four closed-source moderation APIs finds measurable group disparities and shows that LLM-based paraphrasing can bypass unsafe-content flags.
-
Toxic behavior silences online political conversations
Toxic and insulting comments are more likely near the end of YouTube political conversations, but the study does not establish that toxicity causes the silence.
-
A Federated Approach to Few-Shot Hate Speech Detection for Marginalized Communities
A new multilingual REACT dataset plus simulated federated learning experiments show modest, inconsistent few-shot gains for low-resource hate speech detection.
-
Digital Guardians: Can GPT-4, Perspective API, and Moderation API reliably detect hate speech in reader comments of German online newspapers?
On the German HOCON34k hate speech test set, GPT-4o with one-shot prompting scored highest on the combined F2/MCC metric, about 5 points above the fine-tuned BERT baseline.
-
Trusting CHATGPT: how minor tweaks in the prompts lead to major differences in sentiment classification
Minor prompt rewording produces statistically significant shifts in GPT-4o mini's Spanish sentiment labels, yet overall agreement between prompts stays between 92% and 98%.
Discussion (0). Continue with ORCID to comment.