RECORD
Feature Pyramid Network for Multi-task Affective Analysis
Computer Vision and Pattern Recognition · Submitted 8 Jul 2021
abstract compiled · 2026-09-23 · no language-model review
The authors' main claim Extensive experiment results demonstrate the proposed model outperforms other models.
The compiled record
The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
Open the compiled record
The abstract, sentence by sentence
Affective Analysis is not a single task, and the valence-arousal value, expression class, and action unit can be predicted at the same time. Previous researches did not pay enough attention to the entanglement and hierarchical relation of these three facial attributes. We propose a novel model named feature pyramid networks for multi-task affect analysis. The hierarchical features are extracted to predict three labels and we apply a teacher-student training strategy to learn from pretrained single-task models. Extensive experiment results demonstrate the proposed model outperforms other models. This is a submission to The 2nd Workshop and Competition on Affective Behavior Analysis in the wild (ABAW). The code and model are available for research purposes at https://github.com/ryanhe312/ABAW2-FPNMAA.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | Affective Analysis is not a single task, and the valence-arousal value, expression class, and action unit can be predicted at the same time. | background 0.99 | 0.14 | 0.08 | asserted 0.99 |
| s1 | Previous researches did not pay enough attention to the entanglement and hierarchical relation of these three facial attributes. | gap 0.99 | 0.04 | 0.03 | asserted 1.00 |
| s2 | We propose a novel model named feature pyramid networks for multi-task affect analysis. | contribution 0.94 | 0.90 | 0.06 | asserted 0.99 |
| s3 | The hierarchical features are extracted to predict three labels and we apply a teacher-student training strategy to learn from pretrained single-task models. | method 0.98 | 0.94 | 0.06 | asserted 0.99 |
| s4 | Extensive experiment results demonstrate the proposed model outperforms other models. | result 1.00 | 0.94 | 0.80 | asserted 1.00 |
| s5 | This is a submission to The 2nd Workshop and Competition on Affective Behavior Analysis in the wild (ABAW). | background 0.81 | 0.34 | 0.02 | asserted 0.99 |
| s6 | The code and model are available for research purposes at https://github.com/ryanhe312/ABAW2-FPNMAA. | contribution 0.73 | 0.51 | 0.02 | asserted 0.99 |
What was examined, and what was not
- arXiv listing abstract v3
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
The paper
Original abstract
Affective Analysis is not a single task, and the valence-arousal value, expression class, and action unit can be predicted at the same time. Previous researches did not pay enough attention to the entanglement and hierarchical relation of these three facial attributes. We propose a novel model named feature pyramid networks for multi-task affect analysis. The hierarchical features are extracted to predict three labels and we apply a teacher-student training strategy to learn from pretrained single-task models. Extensive experiment results demonstrate the proposed model outperforms other models. This is a submission to The 2nd Workshop and Competition on Affective Behavior Analysis in the wild (ABAW). The code and model are available for research purposes at https://github.com/ryanhe312/ABAW2-FPNMAA.
Human review
How the literature uses it
What this paper does with the arXiv papers it cites
What it cites
Uses data or values from 4 papers
-
We have done extensive experiments on the validation set of the AffWild2 [ref] [ref] [ref] [ref] [ref] [ref] [ref] [ref] .
Expression, Affect, Action Unit Recognition: Aff-Wild2, Multi-Task Learning and ArcFace · Experiment · 0.99
-
We have done extensive experiments on the validation set of the AffWild2 [ref] [ref] [ref] [ref] [ref] [ref] [ref] [ref] .
Face Behavior a la carte: Expressions, Affect and Action Units in a Single Network · Experiment · 0.99
-
We have done extensive experiments on the validation set of the AffWild2 [ref] [ref] [ref] [ref] [ref] [ref] [ref] [ref] .
Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Framework · Experiment · 0.99
Cites as background 4 papers
-
[ref] [ref] [ref] [ref] [ref] [ref] [ref] [ref] And there are three challenges in affective analysis: valence-arousal, seven basic expression and action unit prediction.
Expression, Affect, Action Unit Recognition: Aff-Wild2, Multi-Task Learning and ArcFace · Introduction · 0.97
-
[ref] [ref] [ref] [ref] [ref] [ref] [ref] [ref] And there are three challenges in affective analysis: valence-arousal, seven basic expression and action unit prediction.
Face Behavior a la carte: Expressions, Affect and Action Units in a Single Network · Introduction · 0.97
-
[ref] [ref] [ref] [ref] [ref] [ref] [ref] [ref] And there are three challenges in affective analysis: valence-arousal, seven basic expression and action unit prediction.
Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Framework · Introduction · 0.97
Discussion
Know something about this paper? Leave a comment, or highlight any passage above to comment on it.