REVIEW 12 cited by
Aff-Wild2: Extending the Aff-Wild Database for Affect Recognition
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Automatic understanding of human affect using visual signals is a problem that has attracted significant interest over the past 20 years. However, human emotional states are quite complex. To appraise such states displayed in real-world settings, we need expressive emotional descriptors that are capable of capturing and describing this complexity. The circumplex model of affect, which is described in terms of valence (i.e., how positive or negative is an emotion) and arousal (i.e., power of the activation of the emotion), can be used for this purpose. Recent progress in the emotion recognition domain has been achieved through the development of deep neural architectures and the availability of very large training databases. To this end, Aff-Wild has been the first large-scale "in-the-wild" database, containing around 1,200,000 frames. In this paper, we build upon this database, extending it with 260 more subjects and 1,413,000 new video frames. We call the union of Aff-Wild with the additional data, Aff-Wild2. The videos are downloaded from Youtube and have large variations in pose, age, illumination conditions, ethnicity and profession. Both database-specific as well as cross-database experiments are performed in this paper, by utilizing the Aff-Wild2, along with the RECOLA database. The developed deep neural architectures are based on the joint training of state-of-the-art convolutional and recurrent neural networks with attention mechanism; thus exploiting both the invariant properties of convolutional features, while modeling temporal dynamics that arise in human behaviour via the recurrent layers. The obtained results show premise for utilization of the extended Aff-Wild, as well as of the developed deep neural architectures for visual analysis of human behaviour in terms of continuous emotion dimensions.
Forward citations
Cited by 12 Pith papers
-
Benchmarking Dynamic Affective Reasoning: A Viewer-Centric Video Emotion Dataset
DAR provides 15k videos with 37k event-aligned viewer-emotion segments and causal chains, and DAR-R1 (SFT+GRPO) leads 10+ MLLMs on segmentation, emotion accuracy, and reasoning quality.
-
Facial-Expression-Aware Prompting for Empathetic LLM Tutoring
Feeding LLM tutors a text description or AUM-selected frame of a student's facial expression improves rated empathetic responsiveness across three backbones.
-
Learning Transferable Facial Emotion Representations from Large-Scale Semantically Rich Captions
A new large-scale facial emotion caption dataset and a global-local contrastive training framework with positive mining improve zero-shot facial expression recognition.
-
DVD: A Comprehensive Dataset for Advancing Violence Detection in Real-World Scenarios
The authors propose a new frame-level annotated violence detection dataset, DVD, with 500 videos and rich metadata, but it is not yet available and lacks validation experiments.
-
FEALLM: Advancing Facial Emotion Analysis in Multimodal Large Language Models with Emotional Synergy and Reasoning
FEALLM is a multimodal LLM fine-tuned on a new, aligned facial expression and action unit reasoning dataset, reporting improved facial emotion analysis on its benchmark and zero-shot gains on RAF-DB, AffectNet, BP4D, ...
-
VAEmo: Efficient Representation Learning for Visual-Audio Emotion with Knowledge Injection
VAEmo achieves state-of-the-art audio-visual emotion recognition by pre-training a unified encoder and aligning it with MLLM-generated emotion captions.
-
Explaining Facial Expression Recognition
FAU-based textual and multimodal explanations improved user understanding and appropriate trust in a facial expression recognition model, but the explanation generator's use of the model's emotion vector as input crea...
-
Toward Annotation-Efficient Continuous Emotion Arousal Quantification via Group-Level EEG Dynamic Neural Synchrony
Group-level EEG dynamic neural synchrony (CorrCA) preferentially tracks the rate of change of continuous arousal and shows valence-dependent structure across four datasets.
-
Causal Supervision of Attention for Affective Behaviour Analysis
Causal supervision plus K-V independence and SwiGLU attention pooling yields a multi-task P-score of 1.2214 on s-Aff-Wild2 validation for valence-arousal, expression, and action-unit prediction.
-
FIDAC: An Easy-to-use Pipeline to Extract and Interpret Interpersonal Distance From Video
FIDAC merges multi-model face detection, human coding, and plane benchmarking to extract interpersonal distance from ordinary 2D video.
-
AffectFuse: Cross-Task Feature Fusion with Temporal Modeling for Multi-Task Affective Behavior Analysis
A multi-task affective system combining frozen AffectNet backbones, LoRA-adapted MAE for action units, temporal heads, fusion, and ensembling attains P=1.7302 on the s-Aff-Wild2 validation split.
-
Task-Specific Feature Fusion Method for Multi-Task Affective Behavior Analysis
A task-adaptive system that mixes two frozen visual features with per-task fusion and temporal strategies scores 1.6341 on the ABAW11 validation set, beating its own shared multi-task baselines.
Discussion (0). Continue with ORCID to comment.