Overview of the HASOC Subtrack at FIRE 2021: Hate Speech and Offensive Content Identification in English and Indo-Aryan Languages

Amit Kumar Jaiswal; Durgesh Nandini; Gautam Kishore Shahi; Hiren Madhu; Johannes Schaefer; Marcos Zampieri; Prasenjit Majumder; Sandip Modha; Shrey Satapara; Tharindu Ranasinghe

Overview of the HASOC Subtrack at FIRE 2021: Hate Speech and Offensive Content Identification in English and Indo-Aryan Languages

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2112.09301 v1 pith:6TGHMEAA submitted 2021-12-17 cs.CL cs.AIcs.SI

Overview of the HASOC Subtrack at FIRE 2021: Hate Speech and Offensive Content Identification in English and Indo-Aryan Languages

Thomas Mandl , Sandip Modha , Gautam Kishore Shahi , Hiren Madhu , Shrey Satapara , Prasenjit Majumder , Johannes Schaefer , Tharindu Ranasinghe

show 3 more authors

Marcos Zampieri Durgesh Nandini Amit Kumar Jaiswal

This is my paper

classification cs.CL cs.AIcs.SI

keywords hateoffensivedataenglishspeechclassificationcontenthasoc

verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

0 comments

Share X Bluesky LinkedIn Reddit HN

read the original abstract

The widespread of offensive content online such as hate speech poses a growing societal problem. AI tools are necessary for supporting the moderation process at online platforms. For the evaluation of these identification tools, continuous experimentation with data sets in different languages are necessary. The HASOC track (Hate Speech and Offensive Content Identification) is dedicated to develop benchmark data for this purpose. This paper presents the HASOC subtrack for English, Hindi, and Marathi. The data set was assembled from Twitter. This subtrack has two sub-tasks. Task A is a binary classification problem (Hate and Not Offensive) offered for all three languages. Task B is a fine-grained classification problem for three classes (HATE) Hate speech, OFFENSIVE and PROFANITY offered for English and Hindi. Overall, 652 runs were submitted by 65 teams. The performance of the best classification algorithms for task A are F1 measures 0.91, 0.78 and 0.83 for Marathi, Hindi and English, respectively. This overview presents the tasks and the data development as well as the detailed results. The systems submitted to the competition applied a variety of technologies. The best performing algorithms were mainly variants of transformer architectures.

discussion (0)

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

Conditional Reliability of Toxicity Signals for Multilingual and Code-Mixed Abuse Detection
cs.CL 2026-07 conditional novelty 5.0

A gated fusion head that conditions English toxicity, Indic abuse, and rule-based severity scores on the text context improves code-mixed abuse detection in 10/12 in-domain and 7/8 transfer comparisons.