REVIEW 3 cited by
Overview of the HASOC Subtrack at FIRE 2021: Hate Speech and Offensive Content Identification in English and Indo-Aryan Languages
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
The widespread of offensive content online such as hate speech poses a growing societal problem. AI tools are necessary for supporting the moderation process at online platforms. For the evaluation of these identification tools, continuous experimentation with data sets in different languages are necessary. The HASOC track (Hate Speech and Offensive Content Identification) is dedicated to develop benchmark data for this purpose. This paper presents the HASOC subtrack for English, Hindi, and Marathi. The data set was assembled from Twitter. This subtrack has two sub-tasks. Task A is a binary classification problem (Hate and Not Offensive) offered for all three languages. Task B is a fine-grained classification problem for three classes (HATE) Hate speech, OFFENSIVE and PROFANITY offered for English and Hindi. Overall, 652 runs were submitted by 65 teams. The performance of the best classification algorithms for task A are F1 measures 0.91, 0.78 and 0.83 for Marathi, Hindi and English, respectively. This overview presents the tasks and the data development as well as the detailed results. The systems submitted to the competition applied a variety of technologies. The best performing algorithms were mainly variants of transformer architectures.
Forward citations
Cited by 3 Pith papers
-
A Modular Taxonomy for Hate Speech Definitions and Its Impact on Zero-Shot LLM Classification Performance
A taxonomy of 14 hate speech definition components plus evidence that zero-shot LLM hate speech classification is sensitive to which definition is inserted into the prompt, with model-dependent effects.
-
Conditional Reliability of Toxicity Signals for Multilingual and Code-Mixed Abuse Detection
A gated fusion head that conditions English toxicity, Indic abuse, and rule-based severity scores on the text context improves code-mixed abuse detection in 10/12 in-domain and 7/8 transfer comparisons.
-
Cyberbullying Detection in Hinglish Text Using MURIL and Explainable AI
A MURIL-based classifier outperforms RoBERTa, IndicBERT, and several published baselines on six Hinglish cyberbullying datasets, with reported gains of 1.36 to 13.07 percentage points.
Discussion (0). Continue with ORCID to comment.