LoRA fine-tuning of Nemo-Instruct achieves the best F1 among four LLMs on Devanagari hate speech detection (90.05%) and target identification (71.47%), but without baseline comparisons the approach's efficacy is unproven.
Overview of Memotion 3: Sentiment and Emotion Analysis of Codemixed Hinglish Memes
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
Analyzing memes on the internet has emerged as a crucial endeavor due to the impact this multi-modal form of content wields in shaping online discourse. Memes have become a powerful tool for expressing emotions and sentiments, possibly even spreading hate and misinformation, through humor and sarcasm. In this paper, we present the overview of the Memotion 3 shared task, as part of the DeFactify 2 workshop at AAAI-23. The task released an annotated dataset of Hindi-English code-mixed memes based on their Sentiment (Task A), Emotion (Task B), and Emotion intensity (Task C). Each of these is defined as an individual task and the participants are ranked separately for each task. Over 50 teams registered for the shared task and 5 made final submissions to the test set of the Memotion 3 dataset. CLIP, BERT modifications, ViT etc. were the most popular models among the participants along with approaches such as Student-Teacher model, Fusion, and Ensembling. The best final F1 score for Task A is 34.41, Task B is 79.77 and Task C is 59.82.
fields
cs.CL 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
LLMsAgainstHate @ NLU of Devanagari Script Languages 2025: Hate Speech Detection and Target Identification in Devanagari Languages via Parameter Efficient Fine-Tuning of LLMs
LoRA fine-tuning of Nemo-Instruct achieves the best F1 among four LLMs on Devanagari hate speech detection (90.05%) and target identification (71.47%), but without baseline comparisons the approach's efficacy is unproven.