REVIEW 1 cited by
A Multi-modal and Multi-task Learning Method for Action Unit and Expression Recognition
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Analyzing human affect is vital for human-computer interaction systems. Most methods are developed in restricted scenarios which are not practical for in-the-wild settings. The Affective Behavior Analysis in-the-wild (ABAW) 2021 Contest provides a benchmark for this in-the-wild problem. In this paper, we introduce a multi-modal and multi-task learning method by using both visual and audio information. We use both AU and expression annotations to train the model and apply a sequence model to further extract associations between video frames. We achieve an AU score of 0.712 and an expression score of 0.477 on the validation set. These results demonstrate the effectiveness of our approach in improving model performance.
Forward citations
Cited by 1 Pith paper
-
Multi-task Adversarial Attacks against Black-box Model with Few-shot Queries
CEMA converts multi-task black-box text attacks into attacks on a binary classifier trained on cluster pseudo-labels, achieving high attack success with 100 queries.
Discussion (0). Continue with ORCID to comment.