Pith. sign in

REVIEW

No offence, Bert -- I insult only humans! Multiple addressees sentence-level attack on toxicity detection neural network

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2310.13099 v1 pith:O4PX6B6W submitted 2023-10-19 cs.CL cs.AIcs.LG

classification cs.CLcs.AIcs.LG
keywords attacktoxicitydetectionnetworkneuralsentence-levelableadding
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

We introduce a simple yet efficient sentence-level attack on black-box toxicity detector models. By adding several positive words or sentences to the end of a hateful message, we are able to change the prediction of a neural network and pass the toxicity detection system check. This approach is shown to be working on seven languages from three different language families. We also describe the defence mechanism against the aforementioned attack and discuss its limitations.

Discussion (0). Continue with ORCID to comment.

Pith tools