Fine-tuned open-source LLMs, especially Mistral, generate synthetic toxic data that improves downstream hate speech detection classifiers, approaching GPT-4-level performance.
Predictive Embeddings for Hate Speech Detection on Twitter
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
We present a neural-network based approach to classifying online hate speech in general, as well as racist and sexist speech in particular. Using pre-trained word embeddings and max/mean pooling from simple, fully-connected transformations of these embeddings, we are able to predict the occurrence of hate speech on three commonly used publicly available datasets. Our models match or outperform state of the art F1 performance on all three datasets using significantly fewer parameters and minimal feature preprocessing compared to previous methods.
fields
cs.CL 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
ToxiLab: How Well Do Open-Source LLMs Generate Synthetic Toxicity Data?
Fine-tuned open-source LLMs, especially Mistral, generate synthetic toxic data that improves downstream hate speech detection classifiers, approaching GPT-4-level performance.