REVIEW 6 cited by
DER-GCN: Dialogue and Event Relation-Aware Graph Convolutional Neural Network for Multimodal Dialogue Emotion Recognition
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
With the continuous development of deep learning (DL), the task of multimodal dialogue emotion recognition (MDER) has recently received extensive research attention, which is also an essential branch of DL. The MDER aims to identify the emotional information contained in different modalities, e.g., text, video, and audio, in different dialogue scenes. However, existing research has focused on modeling contextual semantic information and dialogue relations between speakers while ignoring the impact of event relations on emotion. To tackle the above issues, we propose a novel Dialogue and Event Relation-Aware Graph Convolutional Neural Network for Multimodal Emotion Recognition (DER-GCN) method. It models dialogue relations between speakers and captures latent event relations information. Specifically, we construct a weighted multi-relationship graph to simultaneously capture the dependencies between speakers and event relations in a dialogue. Moreover, we also introduce a Self-Supervised Masked Graph Autoencoder (SMGAE) to improve the fusion representation ability of features and structures. Next, we design a new Multiple Information Transformer (MIT) to capture the correlation between different relations, which can provide a better fuse of the multivariate information between relations. Finally, we propose a loss optimization strategy based on contrastive learning to enhance the representation learning ability of minority class features. We conduct extensive experiments on the IEMOCAP and MELD benchmark datasets, which verify the effectiveness of the DER-GCN model. The results demonstrate that our model significantly improves both the average accuracy and the f1 value of emotion recognition.
Forward citations
Cited by 6 Pith papers
-
Divide-Then-Rule: A Cluster-Driven Hierarchical Interpolator for Attribute-Missing Graphs
A hierarchical, cluster-aware imputation method (DTRGC) that reweights feature propagation by cluster membership and imputes missing node attributes in stages improves deep graph clustering on attribute-missing graphs.
-
SDR-GNN: Spectral Domain Reconstruction Graph Neural Network for Incomplete Multimodal Learning in Conversational Emotion Recognition
SDR-GNN is a graph neural network that reconstructs missing multimodal features and labels utterance emotions, with reported gains over prior methods that are inconsistent across datasets.
-
Graph Domain Adaptation with Dual-branch Encoder and Two-level Alignment for Whole Slide Image-based Survival Prediction
DETA, a dual-branch graph encoder with category and feature alignment, reports higher C-index than baselines on cross-cancer TCGA survival transfer.
-
A Novel Approach to for Multimodal Emotion Recognition : Multimodal semantic information fusion
DeepMSI-MER combines contrastive learning with semantic-guided visual compression and reports improved emotion recognition accuracy on IEMOCAP and MELD.
-
GroupFace: Imbalanced Age Estimation Based on Multi-hop Attention Graph Convolutional Network and Group-aware Margin Optimization
GroupFace combines a multi-hop attention graph network with a reinforcement-learning margin scheduler for imbalanced face age estimation, reporting modest benchmark gains but with internal inconsistencies in the rewar...
-
Dynamic Graph Neural ODE Network for Multi-modal Emotion Recognition in Conversation
DGODE combines adaptive mixhop aggregation with a graph ODE for multimodal emotion recognition in conversation, reporting SOTA numbers on IEMOCAP and MELD, but the supporting derivation and experimental reporting are ...
Discussion (0). Continue with ORCID to comment.