pith. sign in

arxiv: 2505.20511 · v2 · pith:O6UG2GZKnew · submitted 2025-05-26 · 💻 cs.CL

Multimodal Emotion Recognition in Conversations: A Survey of Methods, Trends, Challenges and Prospects

Chengyan Wu , Yiqiang Cai , Yang Liu , Pengxu Zhu , Yun Xue , Ziwei Gong , Julia Hirschberg , Bolei Ma This is my paper
classification 💻 cs.CL
keywords emotionmercmethodsrecognitionsurveychallengesconversationsemotional
0
0 comments X
read the original abstract

While text-based emotion recognition methods have achieved notable success, real-world dialogue systems often demand a more nuanced emotional understanding than any single modality can offer. Multimodal Emotion Recognition in Conversations (MERC) has thus emerged as a crucial direction for enhancing the naturalness and emotional understanding of human-computer interaction. Its goal is to accurately recognize emotions by integrating information from various modalities such as text, speech, and visual signals. This survey offers a systematic overview of MERC, including its motivations, core tasks, representative methods, and evaluation strategies. We further examine recent trends, highlight key challenges, and outline future directions. As interest in emotionally intelligent systems grows, this survey provides timely guidance for advancing MERC research.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. AffectSeek: Agentic Affective Understanding in Long Videos under Vague User Queries

    cs.CV 2026-05 unverdicted novelty 7.0

    AffectSeek is an agentic framework that localizes affective moments, classifies emotions, and generates rationales in long videos under vague user queries, backed by the new VQAU-Bench benchmark.

  2. Beyond Monolingual Assumptions: A Survey of Code-Switched NLP in the Era of Large Language Models across Modalities

    cs.CL 2025-10 accept novelty 7.0

    A comprehensive survey of code-switched NLP research with LLMs across modalities, covering 327 studies, 15+ tasks, 30+ datasets, and 80+ languages while outlining challenges and a future roadmap.

  3. MISID: A Multimodal Multi-turn Dataset for Complex Intent Recognition in Strategic Deception Games

    cs.AI 2026-04 unverdicted novelty 6.0

    MISID is a multimodal multi-turn dataset for intent recognition in strategic deception games, paired with the FRACTAM framework that improves MLLM performance on hidden intent detection via decouple-anchor-reason steps.

  4. MA-DLE: Speech-based Automatic Depression Level Estimation via Memory Augmentation

    eess.AS 2026-04 conditional novelty 5.0

    An external memory bank with similarity-based retrieval and dynamic feature encoding, fused via hierarchical attention, improves GRU-based speech depression level estimation on DAIC-WOZ and E-DAIC.