Facial Expression Analysis and Its Potentials in IoT Systems: A Contemporary Survey

M. Jamal Deen; Song Guo; Victor C. M. Leung; Xiping Hu; Yanjie Dong; Zixuan Shangguan

REVIEW 3 major objections 5 minor 286 references

Facial Expression Analysis and Its Potentials in IoT Systems: A Contemporary Survey

T0 review · 3 major / 5 minor · reviewed 2026-08-11 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read This survey claims that macro-expressions and micro-expressions are two halves of one facial-emotion analysis problem, and proposes a learning-paradigm-based framework that connects both to edge-driven IoT systems for healthcare and…

desk verdict A solid but not exceptional survey; the IoT lens is the real differentiator, but the 'gap-bridging' claim rests on an undocumented literature selection and needs cleanup before it earns that framing. read the letter →

arxiv 2412.17616 v3 pith:IWWZRCJ7 submitted 2024-12-23 cs.AI

Zixuan Shangguan , Yanjie Dong , Song Guo , Victor C. M. Leung , M. Jamal Deen , Xiping Hu This is my paper · ORCID

classification cs.AI

keywords facialexpressionanalysismacro-expressionrecognitionmicro-expressionInternetofThingsedgecomputingemotiondeeplearningsurvey

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This survey argues that facial expression analysis should be understood as two complementary problems—macro-expressions (MaEs), which are voluntary and last 0.5–4 seconds, and micro-expressions (MiEs), which are involuntary, last under 0.5 seconds, and reveal concealed emotion—and that both belong together in a single framework for Internet-of-Things (IoT) systems. It claims that prior surveys treated MaE and MiE in isolation, leaving a gap: no existing review offered a holistic, learning-paradigm-based map of methods, datasets, and IoT applications for both. The paper organizes MaE methods into ensemble, transfer, multi-task, attention-based, and self-supervised paradigms, and separates MiE analysis into spotting (finding the fleeting expression) and recognition (classifying it). It then shows how each can be deployed on edge-driven IoT architectures for healthcare, security, negotiation, and mental-health monitoring. If the framework is right, a reader gets a structured route from raw facial video to emotion-aware IoT services.

What carries the argument

The load-bearing structure is a dual distinction plus a taxonomy. The first distinction is temporal and intentional: MaEs last roughly 0.5–4 seconds and are voluntary; MiEs last under 0.5 seconds, are involuntary, and carry about 55% of emotional messages. The second is the learning-paradigm taxonomy: for MaE, the paper partitions methods into ensemble learning, transfer learning, multi-task learning, attention-based learning, and self-supervised learning, for both static images and dynamic videos; for MiE, it partitions the pipeline into spotting (locating onset-apex-offset intervals) and recognition, and reviews descriptors (LBP variants, HOG, optical flow), deep transfer, multi-task, self-supervised, lightweight, meta-learning, and GAN-based generation. This taxonomy is what allows the paper to claim a holistic framework that connects fundamental research to IoT applications, with edge devices collecting and preprocessing before offloading inference.

What would settle it

Find a peer-reviewed survey, published before this one, that already reviews both macro-expression and micro-expression analysis together with IoT applications under a single framework; if such a survey exists and is not referenced, the paper's central claim of a missing holistic integration collapses.

Watch

Extended reading notes

Core claim

The paper's central claim is that macro-expression recognition and micro-expression analysis, usually surveyed as separate fields, are two halves of one problem that a learning-paradigm-based taxonomy can unify, and that this unification is the missing bridge to practical IoT deployment. It asserts that MaE analysis has matured (over 97% accuracy in controlled labs) while MiE analysis remains hard (about 47% accuracy even after training), so a holistic framework must treat them with different pipelines—static and dynamic deep recognition for MaEs, spotting-then-recognition for MiEs—under one structure. It further claims that edge computing is the natural hosting layer because it provides low latency and privacy for biometric facial data. On the application side, it argues that MaE-driven IoT handles real-time emotion monitoring, while MiE-driven IoT handles concealed-emotion tasks such as lie detection, security surveillance, and depression screening.

Load-bearing premise

The survey's usefulness as a map depends on its informal, non-reproducible selection of papers; if prior work already integrated MaE and MiE with IoT, or if key integrated surveys were missed, the claimed gap and the map itself would be incomplete.

Editorial extensions

If this is right

A researcher entering facial expression analysis can use the taxonomy to locate which learning paradigm (e.g., transfer vs. self-supervised) fits their data size and deployment target.
IoT systems for smart healthcare can adopt the edge-driven architecture described here, running MaE models for real-time emotion monitoring and MiE models for detecting concealed distress.
Security applications can combine MaE and MiE pipelines: MaE for visible state, MiE for deception or threat cues in high-stakes settings.
The survey's comparison tables give concrete accuracy expectations across datasets and paradigms, helping practitioners set realistic baselines.
Future methods can position themselves against this framework, filling gaps such as MiE spotting in long, unconstrained videos.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

The framework implies a natural product architecture: a single edge device could run a MaE classifier continuously and trigger a slower MiE spotter-and-recognizer only when an expression is too brief or too suppressed to be classified as MaE.
Because the taxonomy is paradigm-based rather than architecture-based, it could be lifted to other subtle behavior tasks (e.g., gesture or gaze micro-movements) where spotting precedes recognition.
The paper underplays the possibility that MiE recognition categories are not standardized across datasets; cross-dataset few-shot and AU-grounded methods point to where the field would need to standardize labels.
If the IoT integration is taken seriously, the next bottleneck is not accuracy but privacy and real-time constraints; the survey's own challenges section lists these but leaves concrete protocol design open.

Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

This is a competent survey of facial expression analysis that separates macro- and micro-expressions, organizes methods by learning paradigm, and ties both to IoT applications. The dataset tables are genuinely useful, especially the MiE table with annotation details, and the method summaries mostly track the cited literature. The IoT applications section is the most distinctive part; it is thinner than the methods sections but it does connect the two fields in a way I have not seen neatly packaged before. Credit is due for that.

The soft spots are real but not fatal. The load-bearing claim is that existing surveys treat MaE and MiE in isolation and this one bridges the gap. That claim is checked only against the handful of surveys the authors chose to discuss. There is no search protocol, no inclusion criteria, no time window, so 'comprehensive' is asserted rather than demonstrated. The stress-test note is right: if a structured search finds an integrated survey, the novelty framing weakens. That is a legitimate completeness concern, not a manufactured one.

There are also several typos that should have been caught: EmotioNet is described as '9500,000 images' in one place and 950,000 in the table; the appendices appear after the references and duplicate text from the main body; the 'Structure of Our Work' section is stranded in an appendix; and a few citations look mismatched (Chung et al.'s GRU paper appears in the security monitoring paragraph without a clear tie to the claim). None of this undermines the core summaries, but it signals a final proofread was skipped.

For a survey, the absence of a new method or result is not a flaw. The value here is organizational: a newcomer to facial expression analysis with an IoT interest could use this to get oriented quickly. I would not cite it as the definitive authority on coverage, but I would point students to the dataset tables and the IoT discussion.

My recommendation: send it to peer review. A serious referee can ask for a documented selection strategy, a toned-down novelty claim, and cleanup of the typos and formatting. The paper has enough substance to warrant that investment.

Referee Report

3 major / 5 minor

Summary. This manuscript is a survey of facial expression analysis, covering both macro-expression (MaE) and micro-expression (MiE) recognition, and discusses their potential applications in Internet-of-Things (IoT) systems. The authors organize recent work by learning paradigm (e.g., ensemble learning, transfer learning, multi-task learning, attention-based learning, self-supervised learning) for MaE analysis, and by spotting versus recognition for MiE analysis. They also catalog datasets, summarize representative methods with performance numbers, and dedicate sections to IoT applications in emotion recognition, healthcare, security monitoring, negotiation, and mental disorder detection. The paper claims three unique contributions: bridging the gap between MaE and MiE surveys, proposing a learning-paradigm-based framework, and emphasizing practical IoT deployment.

Significance. If the survey's coverage is complete and its comparisons are accurate, it would be a useful structured reference for researchers working at the intersection of facial expression analysis and IoT systems. The paper contains a large number of references, detailed tables of datasets and methods with performance figures that are generally traceable to the cited literature, and a taxonomy that could help readers navigate the field. The appendices provide useful paradigm-level comparisons. However, the main contribution is the map itself, so the credibility of the survey hinges on the completeness and representativeness of the selected literature. The absence of a documented, reproducible survey methodology is a significant weakness: it prevents a reader from verifying that the claimed gap over prior surveys is real and that no major integrated surveys were overlooked. The internal inconsistencies in dataset statistics also need correction before the paper can serve as a reliable reference.

major comments (3)

[§2.2] The paper's central novelty claim is that 'existing surveys treat MaE and MiE in isolation' and that this work 'bridges this gap' with a holistic framework. This is a load-bearing claim, yet the survey provides no reproducible selection protocol: no databases searched, no query strings, no time window, no inclusion/exclusion criteria, and no screening steps are reported. Without such a protocol, 'comprehensive overview' is an assertion rather than a demonstrated property. The risk is concrete: if prior surveys or application-focused reviews that already integrate MaE and MiE were missed, the claimed gap and the framing as a contemporary survey would be weakened. This issue must be addressed, at minimum by adding a methodology subsection that documents the search and screening process, and by re-evaluating the novelty claim in light of the full set of prior surveys found by that search.
[§3.1 and Table 1] There is an internal inconsistency in the EmotioNet dataset count: the text states 'a total of 9500,000 images were annotated with AUs, AU intensities, and emotion categories,' while Table 1 reports '950,000 images.' This is not a trivial typo because the dataset scale is a key piece of information in a survey's dataset overview. The authors should correct the number and verify that all dataset statistics in Tables 1 and 2 are consistent with the primary sources and with the accompanying text.
[§4.2.6, §5.1.3, and §13] The text repeatedly refers to 'Appendix 3.1,' 'Appendix 3.2,' 'Appendix 4.1,' 'Appendix 4.2,' and 'Appendix 5,' but these appendices appear after the reference list as Sections 12, 13, and 14, and they are numbered inconsistently. For example, the appendix for static MaE comparisons is labeled '12.1' in the appendix itself but is referred to as 'Appendix 3.1' in the main text. This cross-reference mismatch makes it unnecessarily difficult for readers to locate the comparative analyses that are supposed to support the survey's insights. The authors should renumber the appendices or update the in-text references so that they match.

minor comments (5)

[§3.1, Table 1] There are several typographical errors in Table 1 and the text, including 'imgaes' for 'images,' '35762 imgaes' for '35,762 images,' and inconsistent use of commas in numbers. These should be corrected throughout.
[§5.2] The phrase 'Since the seminar work [165]' should be 'seminal work.' The term 'seminar' changes the meaning and is clearly a typo.
[§4.2.6] In the sentence about traditional 3D CNNs, 'can increased latency' should be 'can increase latency.' Also in the same section, 'hinders the the training' contains a duplicated 'the.'
[§1 and §10] The description of MaE and MiE characteristics in Section 1 is repeated almost verbatim in Section 10. Since Section 10 is an appendix-like illustration section, the duplication should be removed or one of the passages should be shortened to avoid redundancy.
[§5 title and throughout] The term 'holographic MiE analysis' is used without definition or motivation. If 'holographic' is intended to mean 'holistic' or 'complete,' the authors should either define the term or replace it with clearer wording.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: the survey makes no predictions, fits no parameters, and its taxonomy is not derived from its own conclusions; the completeness limitation is a bibliographic-scope issue, not circular reasoning.

full rationale

This manuscript is a survey, not a derivation. It presents no equations, fits no parameters, and makes no quantitative prediction that could reduce to an input. The central contribution is a literature organization and a claimed gap over prior surveys; that claim rests on an informal and non-reproducible selection of papers, but an undocumented search strategy is a completeness or correctness limitation, not circularity. The paper does not invoke a self-citation chain to justify its taxonomy, and no 'uniqueness theorem' or ansatz is imported from the authors' prior work. The self-referential element identified by the reader—judging novelty against the set of surveys the authors chose to discuss—is a bibliographic judgment, not a result forced by construction. Therefore the appropriate finding is no significant circularity (score 0).

Assumptions & free parameters 0 free parameters · 3 assumptions · 0 invented entities

The survey introduces no fitted constants and no new theoretical objects. Its load-bearing assumptions are domain assumptions about the taxonomy, the emotion label space, and the trustworthiness of cited performance numbers. The absence of free parameters is expected for a review, but it also means the paper adds no quantitative content of its own.

assumptions (3)

domain assumption Facial expressions are partitionable into MaEs and MiEs by duration and intensity, with MaEs lasting 0.5 to 4 seconds and MiEs less than 0.5 seconds.
The survey's entire organization depends on this taxonomy; it is cited to [185] and not derived or tested here.
domain assumption The seven basic expressions, anger, neutral, disgust, fear, happiness, sadness, and surprise, are an adequate label space for comparing facial expression datasets.
The dataset comparisons in Section 3.1 assume these categories are the standard, even though the paper notes contempt is missing from most datasets.
domain assumption The reported accuracies in Tables 3 and 4 are trustworthy as reproduced from cited papers.
The survey does not rerun any experiment; its comparative claims rest on the authors' trust in the cited results.

how reviews work

0 comments

Cite this review

Pith. "Pith review of Facial Expression Analysis and Its Potentials in IoT Systems: A Contemporary Survey." pith.science (2026). https://pith.science/paper/IWWZRCJ7

@misc{pith2026241217616,
  author       = {Pith},
  title        = {Pith review of: Facial Expression Analysis and Its Potentials in IoT Systems: A Contemporary Survey},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/IWWZRCJ7}},
  note         = {Machine review of arXiv:2412.17616}
}

read the original abstract

Facial expressions convey human emotions and can be categorized into macro-expressions (MaEs) and micro-expressions (MiEs) based on duration and intensity. While MaEs are voluntary and easily recognized, MiEs are involuntary, rapid, and can reveal concealed emotions. The integration of facial expression analysis with Internet-of-Thing (IoT) systems has significant potential across diverse scenarios. IoT-enhanced MaE analysis enables real-time monitoring of patient emotions, facilitating improved mental health care in smart healthcare. Similarly, IoT-based MiE detection enhances surveillance accuracy and threat detection in smart security. Our work aims to provide a comprehensive overview of research progress in facial expression analysis and explores its potential integration with IoT systems. We discuss the distinctions between our work and existing surveys, elaborate on advancements in MaE and MiE analysis techniques across various learning paradigms, and examine their potential applications in IoT. We highlight challenges and future directions for the convergence of facial expression-based technologies and IoT systems, aiming to foster innovation in this domain. By presenting recent developments and practical applications, our work offers a systematic understanding of the ways of facial expression analysis to enhance IoT systems in healthcare, security, and beyond.

Figures

Figures reproduced from arXiv: 2412.17616 by the authors.

**Figure 3.** An illustration of [PITH_FULL_IMAGE:figures/full_fig_p037_3.png] view at source ↗

**Figure 4.** The organization of the remaining work. 12 COMPARISON OF LEARNING PARADIGMS FOR MAE ANALYSIS 12.1 Comparison of Learning Paradigms in Deep Static MaE recognition Deep static MaE recognition focuses on analyzing facial expressions from multiple individual images by leveraging advanced learning paradigms to extract effective features that contribute to improving model accuracy. For example, transfer learning initially… view at source ↗

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

286 extracted references · 74 canonical work pages

[1]

N. A. Ab Razak and S. Sahran. Lightweight micro-expression recognition on composite database. Appl. Sci.-Basel, 13(3), 2023

2023
[2]

Abdullah, M

M. Abdullah, M. Ahmad, and D. Han. Facial expression recognition in videos: An cnn-lstm based model for video classification. In Proc. Int. Conf. Electron. Inf. Commun., pages 1–3, 2020

2020
[3]

Aifanti, C

N. Aifanti, C. Papachristou, and A. Delopoulos. The mug facial expression database. In Proc. Int. Workshop Image Anal. Multimedia Interact. Services , pages 1–4, 2010

2010
[4]

M. A. H. Akhand, S. Roy, N. Siddique, M. A. S. Kamal, and T. Shimamura. Facial emotion recognition using transfer learning in the deep cnn. Electron., 10(9), 2021. ISSN 2079-9292

2021
[5]

An and Z

F. An and Z. Liu. Facial expression recognition algorithm based on parameter adaptive initialization of cnn and lstm. Visual Comput., 36(3):483–498, 2020

2020
[6]

An and R.-S

H.-Y. An and R.-S. Jia. Self-supervised facial expression recognition with fine-grained feature selection. Vis. Comput., pages 1–13, 2024

2024
[7]

Aouayeb, W

M. Aouayeb, W. Hamidouche, C. Soladie, K. Kpalma, and R. Seguier. Learning vision transformer with squeeze and excitation for facial expression recognition. arXiv preprint arXiv:2107.03107, 2021

arXiv 2021
[8]

C. C. Atabansi, T. Chen, R. Cao, and X. Xu. Transfer learning technique with vgg-16 for near-infrared facial expression recognition. J. Phys. Conf. Ser., 1873(1):012033, apr 2021

2021

Show all 286 references

[9]

Bai and R

M. Bai and R. Goecke. Investigating lstm for micro-expression recognition. In Proc. Companion Pub. Int. Conf. Multimodal Interact. , pages 7–11, 2020

2020
[10]

X. Ben, Y. Ren, J. Zhang, S.-J. Wang, K. Kpalma, W. Meng, and Y.-J. Liu. Video-based facial micro-expression analysis: A survey of datasets, features and algorithms. IEEE Trans. Pattern Anal. Mach. Intell. , 44(9):5826–5846, 2021

2021
[11]

Bilen, B

H. Bilen, B. Fernando, E. Gavves, A. Vedaldi, and S. Gould. Dynamic image networks for action recognition. In Proc. IEEE Conf. Comput. Vis. Pattern Recognit., pages 3034–3042, 2016

2016
[12]

J. Cai, Z. Meng, A. S. Khan, Z. Li, J. O’Reilly, and Y. Tong. Island loss for learning discriminative features in facial expression recognition. In Proc. IEEE Int. Conf. Autom. Face Gesture Recognit. , pages 302–309, 2018

2018
[13]

F. Z. Canal, T. R. Müller, J. C. Matias, G. G. Scotton, A. R. de Sa Junior, E. Pozzebon, and A. C. Sobieranski. A survey on facial emotion recognition techniques: A state-of-the-art literature review. Inf. Sci., 582:593–617, 2022. ISSN 0020-0255

2022
[14]

Q. Cao, L. Shen, W. Xie, O. M. Parkhi, and A. Zisserman. Vggface2: A dataset for recognising faces across pose and age. In Proc. IEEE Int. Conf. Autom. Face Gesture Recognit., pages 67–74, 2018

2018
[15]

Chaudhari, C

A. Chaudhari, C. Bhatt, A. Krishna, and C. M. Travieso-González. Facial emotion recognition with inter-modality-attention-transformer-based self-supervised learning. Electronics, 12(2), 2023. ISSN 2079-9292

2023
[16]

A. Chen, H. Xing, and F. Wang. A facial expression recognition method using deep convolutional neural networks based on edge computing. IEEE Access, 8:49741–49751, 2020

2020
[17]

B. Chen, Z. Zhang, N. Liu, Y. Tan, X. Liu, and T. Chen. Spatiotemporal convolutional neural network with convolutional block attention module for micro-expression recognition. Information, 11(8), 2020

2020
[18]

B. Chen, W. Guan, P. Li, N. Ikeda, K. Hirasawa, and H. Lu. Residual multi-task learning for facial landmark localization and expression recognition. Pattern Recognit., 115:107893, 2021. ISSN 0031-3203

2021
[19]

D. Chen, G. Wen, H. Li, P. Yang, C. Chen, and B. Wang. Multi-geometry embedded transformer for facial expression recognition in videos. Expert Syst. Appl., 249:123635, 2024. ISSN 0957-4174

2024
[20]

H. Chen, X. Liu, X. Li, H. Shi, and G. Zhao. Analyze spontaneous gestures for emotional stress state recognition: A micro-gesture dataset and analysis with deep learning. In Proc. IEEE Int. Conf. Autom. Face Gesture Recognit. , pages 1–8, 2019

2019
[21]

J. Chen, L. Yang, L. Tan, and R. Xu. Orthogonal channel attention-based multi-task learning for multi-view facial expression recognition. Pattern Recognit., 129:108753, 2022

2022
[22]

W. Chen, D. Zhang, M. Li, and D.-J. Lee. Stcam: Spatial-temporal and channel attention module for dynamic facial expression recognition. IEEE Trans. Affect. Comput., 14(1):800–810, 2023

2023
[23]

Chen and T

X. Chen and T. Luo. Catching elusive depression via facial micro-expression recognition. IEEE Commun. Mag., 61(10):30–36, 2023

2023
[24]

X. Chen, X. Zheng, K. Sun, W. Liu, and Y. Zhang. Self-supervised vision transformer-based few-shot learning for facial expression recognition. Inf. Sci., 634:206–226, 2023. ISSN 0020-0255

2023
[25]

Z. Chen, X. Feng, and S. Zhang. Emotion detection and face recognition of drivers in autonomous vehicles in iot platform. Image Vis. Comput., 128: 104569, 2022

2022
[26]

Chumachenko, A

K. Chumachenko, A. Iosifidis, and M. Gabbouj. Mma-dfer: Multimodal adaptation of unimodal models for dynamic facial expression recognition in-the-wild. arXiv preprint arXiv:2404.09010, 2024

2024 arXiv
[27]

Chung, C

J. Chung, C. Gulcehre, K. Cho, and Y. Bengio. Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555, 2014. Manuscript submitted to ACM Facial Expression Analysis and Its Potentials in IoT Systems: A Contemporary Survey 27

2014 arXiv
[28]

C. A. Corneanu, M. O. Simón, J. F. Cohn, and S. E. Guerrero. Survey on rgb, 3d, thermal, and multimodal approaches for facial expression recognition: History, trends, and affect-related applications. IEEE Trans. Pattern Anal. Mach. Intell. , 38(8):1548–1568, 2016

2016
[29]

Cristinacce, T

D. Cristinacce, T. F. Cootes, et al. Feature detection and tracking with constrained local models. In Proc. Brit. Mach. Vis. Conf. , volume 1, page 3. Citeseer, 2006

2006
[30]

Dai and L

Y. Dai and L. Feng. Cross-domain few-shot micro-expression recognition incorporating action units. IEEE Access, 9:142071–142083, 2021

2021
[31]

Dalal and B

N. Dalal and B. Triggs. Histograms of oriented gradients for human detection. In Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. , volume 1, pages 886–893, 2005

2005
[32]

A. Das, J. Mock, Y. Huang, E. Golob, and P. Najafirad. Interpretable self-supervised facial micro-expression learning to predict cognitive state and neurological disorders. In Proc. AAAI Conf. Artif. Intell. , volume 35, pages 818–826, 2021

2021
[33]

A. K. Davison, C. Lansley, N. Costen, K. Tan, and M. H. Yap. Samm: A spontaneous micro-facial movement dataset. IEEE Trans. Affect. Comput. , 9 (1):116–129, 2016

2016
[34]

J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In Proc. IEEE Conf. Comput. Vis. Pattern Recognit., pages 248–255, 2009

2009
[35]

L. Deng, Q. Wang, and D. Yuan. Dynamic facial expression recognition based on deep learning. In Proc. Int. Conf. Comput. Sci. Education , pages 32–37, 2019

2019
[36]

Dhall, R

A. Dhall, R. Goecke, S. Lucey, and T. Gedeon. Static facial expression analysis in tough conditions: Data, evaluation protocol and benchmark. In Proc. IEEE Int. Conf. Comput. Vis. Workshops , pages 2106–2112, 2011

2011
[37]

Dhall, R

A. Dhall, R. Goecke, S. Ghosh, J. Joshi, J. Hoey, and T. Gedeon. From individual to group-level emotion recognition: Emotiw 5.0. In Proc. ACM Int. Conf. Multimodal Interact., ICMI ’17, page 524–528. Association for Computing Machinery, 2017. ISBN 9781450355438

2017
[38]

Dosovitskiy, L

A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly, et al. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929, 2020

2010 arXiv
[39]

Ekman and W

P. Ekman and W. V. Friesen. Constants across cultures in the face and emotion. Journal of personality and social psychology , 17(2):124–129, 1971

1971
[40]

Ekman and W

P. Ekman and W. V. Friesen. Facial action coding system. Environmental Psychology & Nonverbal Behavior , 1978

1978
[41]

J. L. Elman. Finding structure in time. Cogn. Sci., 14(2):179–211, 1990

1990
[42]

Esmaeili and S

V. Esmaeili and S. O. Shahdi. Automatic micro-expression apex spotting using cubic-lbp. Multimed. Tools Appl., 79:20221–20239, 2020

2020
[43]

Esmaeili, M

V. Esmaeili, M. Mohassel Feghhi, and S. O. Shahdi. Spotting micro-movements in image sequence by introducing intelligent cubic-lbp. IET Image Process., 16(14):3814–3830, 2022

2022
[44]

Fabian Benitez-Quiroz, R

C. Fabian Benitez-Quiroz, R. Srinivasan, and A. M. Martinez. Emotionet: An accurate, real-time algorithm for the automatic annotation of a million facial expressions in the wild. In Proc. IEEE Conf. Comput. Vis. Pattern Recognit. , June 2016

2016
[45]

X. Fan, X. Chen, M. Jiang, A. R. Shahid, and H. Yan. Selfme: Self-supervised motion learning for micro-expression recognition. In Proc. IEEE Conf. Comput. Vis. Pattern Recognit. , pages 13834–13843, 2023

2023
[46]

B. Fang, X. Li, G. Han, and J. He. Rethinking pseudo-labeling for semi-supervised facial expression recognition with contrastive self-supervised learning. IEEE Access, 11:45547–45558, 2023

2023
[47]

H. Feng, W. Huang, D. Zhang, and B. Zhang. Fine-tuning swin transformer and multiple weights optimality-seeking for facial expression recognition. IEEE Access, 11:9995–10003, 2023

2023
[48]

Fernando, H

B. Fernando, H. Bilen, E. Gavves, and S. Gould. Self-supervised video representation learning with odd-one-out networks. In Proc. IEEE Conf. Comput. Vis. Pattern Recognit. , July 2017

2017
[49]

Foggia, A

P. Foggia, A. Greco, A. Saggese, and M. Vento. Multi-task learning on the edge for effective gender, age, ethnicity and emotion recognition. Engineering Applications of Artificial Intelligence, 118:105651, 2023. ISSN 0952-1976

2023
[50]

Frank, M

M. Frank, M. Herbasz, K. Sinuk, A. Keller, and C. Nolan. I see how you feel: Training laypeople and professionals to recognize fleeting emotions. In Proc. Annu. Meeting Int. Commun. Assoc. , pages 1–35, 2009

2009
[51]

L. Fu, Q. Zhang, and R. Wang. Micro-expression recognition based on multi-task learning and resnet18. In Proc. IEEE Conf. Telecommun. Optics Comput. Sci., pages 80–83, 2022

2022
[52]

Y. S. Gan and S.-T. Liong. Bi-directional vectors from apex in cnn for micro-expression recognition. In Proc. IEEE Int. Conf. Image, Vis. Comput. , pages 168–172, 2018

2018
[53]

Y. S. Gan, S.-T. Liong, W.-C. Yau, Y.-C. Huang, and L.-K. Tan. Off-apexnet on micro-expression recognition system. Signal Process. Image Commun. , 74:129–139, 2019

2019
[54]

Y. S. Gan, J. See, H.-Q. Khor, K.-H. Liu, and S.-T. Liong. Needle in a haystack: Spotting and recognising micro-expressions ‘in the wild’.Neurocomputing, 503:283–298, 2022

2022
[55]

Y. S. Gan, G.-B. Liong, K.-H. Liu, and S.-T. Liong. Revealing concealed spontaneous facial micro-expression: Are we a step closer to unveil real-life behavioral expressions? Neurocomputing, 539, 2023

2023
[56]

Gilanie, M

G. Gilanie, M. ul Hassan, M. Asghar, A. M. Qamar, H. Ullah, R. U. Khan, N. Aslam, and I. U. Khan. An automated and real-time approach of depression detection from facial micro-expressions. CMC-Comput. Mat. Contin., 73(2):2513–2528, 2022. ISSN 1546-2218

2022
[57]

Goeleven, R

E. Goeleven, R. De Raedt, L. Leyman, and B. Verschuere. The karolinska directed emotional faces: a validation study. Cogn. Emot., 22(6):1094–1118, 2008. Manuscript submitted to ACM 28 Zixuan Shangguan, Yanjie Dong, Song Guo, Victor C. M. Leung, M. Jamal Deen, and Xiping Hu

2008
[58]

W. Gong, Y. Zhang, W. Wang, P. Cheng, and J. Gonzalez. Meta-mmfnet: Meta-learning-based multi-model fusion network for micro-expression recognition. ACM Trans. Multimedia Comput. Commun. Appl. , 20(2):1–20, 2023

2023
[59]

I. J. Goodfellow, D. Erhan, P. L. Carrier, A. Courville, M. Mirza, B. Hamner, W. Cukierski, Y. Tang, D. Thaler, D.-H. Lee, et al. Challenges in representation learning: A report on three machine learning contests. In Proc. Int. Conf. Neural Inf. Process. , pages 117–124. Sprin...

2013
[60]

I. J. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In Proc. Adv. Neural Inf. Proc. Syst. , volume 27, 2014

2014
[61]

Gross, I

R. Gross, I. Matthews, J. Cohn, T. Kanade, and S. Baker. Multi-pie. Image Vis. Comput., 28(5):807–813, 2010. ISSN 0262-8856. Best of Automatic Face and Gesture Recognition 2008

2010
[62]

Q.-L. Gu, S. Yang, and T. Yu. Lite general network and magface cnn for micro-expression spotting in long videos. Multimedia Syst., pages 1–10, 2023

2023
[63]

Y. Guo, B. Li, X. Ben, Y. Ren, J. Zhang, R. Yan, and Y. Li. A magnitude and angle combined optical flow feature for microexpression spotting. IEEE MultiMedia, 28(2):29–39, 2021

2021
[64]

Halawa, F

M. Halawa, F. Blume, P. Bideau, M. Maier, R. A. Rahman, and O. Hellwich. Multi-task multi-modal self-supervised learning for facial expression recognition. arXiv preprint arXiv:2404.10904, 2024

2024 arXiv
[65]

Y. Han, B. Li, Y.-K. Lai, and Y.-J. Liu. Cfd: A collaborative feature difference method for spontaneous micro-expression spotting. In Proc. IEEE Int. Conf. Inf. Process., pages 1942–1946, 2018

1942
[66]

S. L. Happy and A. Routray. Fuzzy histogram of optical flow orientations for micro-expression recognition. IEEE Trans. Affect. Comput. , 10(3): 394–406, 2017

2017
[67]

S. L. Happy and A. Routray. Recognizing subtle micro-facial expressions using fuzzy histogram of optical flow orientations and feature selection methods. Comput. Intell. Pattern Recognit. , pages 341–368, 2018

2018
[68]

S. L. Happy, P. Patnaik, A. Routray, and R. Guha. The indian spontaneous expression database for emotion recognition. IEEE Trans. Affect. Comput. , 8(1):131–142, 2017

2017
[69]

Hariri and N

W. Hariri and N. Farah. Recognition of 3d emotional facial expression based on handcrafted and deep feature combination. Pattern Recognit. Lett., 148:84–91, 2021. ISSN 0167-8655

2021
[70]

Hasani and M

B. Hasani and M. H. Mahoor. Facial expression recognition using enhanced deep 3d convolutional neural networks. In Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops, July 2017

2017
[71]

K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. In Proc. IEEE Conf. Comput. Vis. Pattern Recognit. , June 2016

2016
[72]

K. He, H. Fan, Y. Wu, S. Xie, and R. Girshick. Momentum contrast for unsupervised visual representation learning. In Proc. IEEE Conf. Comput. Vis. Pattern Recognit., pages 9729–9738, 2020

2020
[73]

Hochreiter and J

S. Hochreiter and J. Schmidhuber. Long short-term memory. Neural Comput., 9(8):1735–1780, 1997

1997
[74]

B. K. Horn and B. G. Schunck. Determining optical flow. Artif. Intell., 17(1–3):185–203, 1981

1981
[75]

M. S. Hossain and G. Muhammad. An audio-visual emotion recognition system using deep learning fusion for a cognitive wireless framework. IEEE Wirel. Commun., 26(3):62–68, 2019

2019
[76]

X. Hu, W. Ma, C. Chen, S. Wen, J. Zhang, Y. Xiang, and G. Fei. Event detection in online social network: Methodologies, state-of-art, and evolution. Comput. Sci. Rev., 46, 2022

2022
[77]

W. Hua, F. Dai, L. Huang, J. Xiong, and G. Gui. Hero: Human emotions recognition for realizing intelligent internet of things. IEEE Access, 7: 24321–24332, 2019

2019
[78]

Huang, Z

G. Huang, Z. Liu, L. van der Maaten, and K. Q. Weinberger. Densely connected convolutional networks. In Proc. IEEE Conf. Comput. Vis. Pattern Recognit., July 2017

2017
[79]

Huang, C

Q. Huang, C. Huang, X. Wang, and F. Jiang. Facial expression recognition with grid-wise attention and visual transformer. Inf. Sci., 580:35–54, 2021

2021
[80]

W. Huang. Elderly depression recognition based on facial micro-expression extraction. Trait. Signal, 38(4):1123–1130, AUG 2021. ISSN 0765-0019

2021
[81]

Huang, G

X. Huang, G. Zhao, X. Hong, W. Zheng, and M. Pietikäinen. Spontaneous facial micro-expression analysis using spatiotemporal completed local quantized patterns. Neurocomputing, 175:564–578, 2016

2016
[82]

in the wild

P. Husák, J. Cech, and J. Matas. Spotting facial micro-expressions “in the wild”. In Proc. Comput. Vis. Winter Workshop , pages 1–9, 2017

2017
[83]

Indolia, S

S. Indolia, S. Nigam, and R. Singh. Integration of transfer learning and self-attention for spontaneous micro-expression recognition. In Proc. Int. Conf. Parallel, Distrib. Grid Comput. , pages 325–330, 2022

2022
[84]

Itti and C

L. Itti and C. Koch. Computational modelling of visual attention. Nature Rev. Neurosci., 2(3):194–203, 2001

2001
[85]

S. Ji, W. Xu, M. Yang, and K. Yu. 3D convolutional neural networks for human action recognition. IEEE Trans. Pattern Anal. Mach. Intell. , 35(1): 221–231, 2012

2012
[86]

X. Jia, X. Ben, H. Yuan, K. Kpalma, and W. Meng. Macro-to-micro transformation model for micro-expression recognition. J. Comput. Sci., 25: 289–297, 2018

2018
[87]

Jiang, Y

X. Jiang, Y. Zong, W. Zheng, C. Tang, W. Xia, C. Lu, and J. Liu. Dfew: A large-scale database for recognizing dynamic facial expressions in the wild. In Proc. ACM Int. Conf. Multimedia , MM ’20, page 2881–2889. Association for Computing Machinery, 2020. ISBN 9781450379885

2020
[88]

Y. Jin, T. Zheng, C. Gao, and G. Xu. Mtmsn: Multi-task and multi-modal sequence network for facial action unit and expression recognition. In Proc. IEEE Int. Conf. Comput. Vis. Workshops , pages 3597–3602, October 2021. Manuscript submitted to ACM Facial Expression Analysis an...

2021
[89]

S. E. Kahou, C. Pal, X. Bouthillier, P. Froumenty, Ç. Gülçehre, R. Memisevic, P. Vincent, A. Courville, Y. Bengio, R. C. Ferrari, et al. Combining modality specific deep neural networks for emotion recognition in video. In Proc. ACM Int. Conf. Multimodal Interact. , pages 543–...

2013
[90]

S. E. Kahou, X. Bouthillier, P. Lamblin, C. Gulcehre, V. Michalski, K. Konda, S. Jean, P. Froumenty, Y. Dauphin, N. Boulanger-Lewandowski, et al. Emonets: Multimodal deep learning approaches for emotion recognition in video. J. Multimodal User Interfaces , 10:99–111, 2016

2016
[91]

Karnati, A

M. Karnati, A. Seal, D. Bhattacharjee, A. Yazidi, and O. Krejcar. Understanding deep learning techniques for recognition of human emotions using facial expressions: A comprehensive survey. IEEE Trans. Instrum. Meas. , 72:1–31, 2023

2023
[92]

Khanna, N

D. Khanna, N. Jindal, P. S. Rana, and H. Singh. Enhanced spatio-temporal 3d cnn for facial expression classification in videos. Multimed. Tools Appl., 83(4):9911–9928, 2024

2024
[93]

H.-Q. Khor, J. See, S.-T. Liong, R. C. Phan, and W. Lin. Dual-stream shallow networks for facial micro-expression recognition. InProc. IEEE Int. Conf. Inf. Process., pages 36–40, 2019

2019
[94]

B.-K. Kim, H. Lee, J. Roh, and S.-Y. Lee. Hierarchical committee of deep cnns with exponentially-weighted decision fusion for static facial expression recognition. In Proc. ACM Int. Conf. Multimodal Interact. , page 427–434, 2015. ISBN 9781450339124

2015
[95]

Kim, S.-Y

B.-K. Kim, S.-Y. Dong, J. Roh, G. Kim, and S.-Y. Lee. Fusing aligned and non-aligned face information for automatic affect recognition in the wild: A deep learning approach. In Proc. IEEE Conf. Comput. Vis. Pattern Recognit. , June 2016

2016
[96]

H. Kim, D. Zhang, L. Kim, and C.-H. Im. Classification of individual’s discrete emotions reflected in facial microexpressions using electroencephalo- gram and facial electromyogram. Expert Syst. Appl., 188, 2022

2022
[97]

Kollias and S

D. Kollias and S. Zafeiriou. Expression, affect, action unit recognition: Aff-wild2, multi-task learning and arcface. arXiv preprint arXiv:1910.04855, 2019

1910 arXiv
[98]

Langner, R

O. Langner, R. Dotsch, G. Bijlstra, D. H. Wigboldus, S. T. Hawk, and A. Van Knippenberg. Presentation and validation of the radboud faces database. Cognit. Emotion, 24(8):1377–1388, 2010

2010
[99]

T. T. Q. Le, T.-K. Tran, and M. Rege. Dynamic image for micro-expression recognition on region-based framework. In Proc. IEEE Int. Conf. Information Reuse Integr. Data Sci. , pages 75–81, 2020

2020
[100]

J. Lee, S. Kim, S. Kim, J. Park, and K. Sohn. Context-aware emotion recognition networks. In Proc. IEEE Int. Conf. Comput. Vis. , October 2019

2019
[101]

J. Lee, S. Kim, S. Kim, and K. Sohn. Multi-modal recurrent attention networks for facial expression recognition. IEEE Trans. Image Process., 29: 6977–6991, 2020

2020
[102]

J. Li, Y. Wang, J. See, and W. Liu. Micro-expression recognition based on 3D flow convolutional neural network. Pattern Anal. Appl., 22:1331–1339, 2019

2019
[103]

J. Li, K. Jin, D. Zhou, N. Kubota, and Z. Ju. Attention mechanism-based cnn for facial expression recognition. Neurocomputing, 411:340–350, 2020. ISSN 0925-2312

2020
[104]

Li, S.-J

J. Li, S.-J. Wang, M. H. Yap, J. See, X. Hong, and X. Li. Megc2020-the third facial micro-expression grand challenge. In Proc. IEEE Int. Conf. Autom. Face Gesture Recognit., pages 777–780, 2020

2020
[105]

J. Li, Z. Dong, S. Lu, S.-J. Wang, W.-J. Yan, Y. Ma, Y. Liu, C. Huang, and X. Fu. Cas (me) 3: A third generation facial spontaneous micro-expression database with depth information and high ecological validity. IEEE Trans. Pattern Anal. Mach. Intell. , 45(3):2782–2800, 2022

2022
[106]

M. Li, L. Chen, W. Wei, X. Ben, and D. Wang. An improved generative adversarial network for micro-expressions based on multi-label learning from action units. In Proc. Int. Conf. Image Graph. Process. , pages 59–64, 2021

2021
[107]

Q. Li, S. Zhan, L. Xu, and C. Wu. Facial micro-expression recognition based on the fusion of deep learning and enhanced optical flow. Multimed. Tools Appl., 78:29307–29322, 2019

2019
[108]

Li and W

S. Li and W. Deng. Deep facial expression recognition: A survey. IEEE Trans. Affect. Comput. , 13(3):1195–1215, 2020

2020
[109]

S. Li, W. Deng, and J. Du. Reliable crowdsourcing and deep locality-preserving learning for expression recognition in the wild. In Proc. IEEE Conf. Comput. Vis. Pattern Recognit. , pages 2852–2861, 2017

2017
[110]

X. Li, T. Pfister, X. Huang, G. Zhao, and M. Pietikäinen. A spontaneous micro-expression database: Inducement, collection and baseline. In Proc. IEEE Int. Conf. Autom. Face Gesture Recognit. , pages 1–6, 2013

2013
[111]

X. Li, X. Hong, A. Moilanen, X. Huang, T. Pfister, G. Zhao, and M. Pietikäinen. Towards reading hidden emotions: A comparative study of spontaneous micro-expression spotting and recognition methods. IEEE Trans. Affect. Comput. , 9(4):563–577, 2017

2017
[112]

X. Li, S. Cheng, Y. Li, M. Behzad, J. Shen, S. Zafeiriou, M. Pantic, and G. Zhao. 4DME: A spontaneous 4D micro-expression dataset with multimodalities. IEEE Trans. Affect. Comput. , 14(4):3031–3047, 2022

2022
[113]

X. Li, W. Deng, S. Li, and Y. Li. Compound expression recognition in-the-wild with au-assisted meta multi-task learning. In Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops , pages 5735–5744, June 2023

2023
[114]

X. Li, X. Yi, J. Ye, Y. Zheng, and Q. Wang. Sftnet: A microexpression-based method for depression detection. Comput. Meth. Programs Biomed. , 243, JAN 2024. ISSN 0169-2607

2024
[115]

Y. Li, X. Huang, and G. Zhao. Can micro-expression be recognized based on single apex frame? In Proc. IEEE Int. Conf. Image Process. , pages 3094–3098, 2018

2018
[116]

Y. Li, J. Zeng, S. Shan, and X. Chen. Occlusion aware facial expression recognition using cnn with attention mechanism. IEEE Trans. Image Process. , 28(5):2439–2450, 2019

2019
[117]

Y. Li, X. Huang, and G. Zhao. Joint local and global information learning with single apex frame detection for micro-expression recognition. IEEE Trans. Image Process., 30:249–263, 2020. Manuscript submitted to ACM 30 Zixuan Shangguan, Yanjie Dong, Song Guo, Victor C. M. Leung...

2020
[118]

Y. Li, W. Peng, and G. Zhao. Micro-expression action unit detection with dual-view attentive similarity-preserving knowledge distillation. In Proc. IEEE Int. Conf. Autom. Face Gesture Recognit. , pages 01–08, 2021

2021
[119]

Y. Li, Y. Gao, B. Chen, Z. Zhang, G. Lu, and D. Zhang. Self-supervised exclusive-inclusive interactive learning for multi-label facial expression recognition in the wild. IEEE Trans. Circuits Syst. Video Technol. , 32(5):3190–3202, 2022

2022
[120]

Y. Li, J. Wei, Y. Liu, J. Kauttonen, and G. Zhao. Deep learning for micro-expression recognition: A survey. IEEE Trans. Affect. Comput. , 13(4): 2028–2046, 2022

2022
[121]

W. Liao, K. Hu, M. Y. Yang, and B. Rosenhahn. Text to image generation with semantic-spatial aware gan. In Proc. IEEE Conf. Comput. Vis. Pattern Recognit., pages 18187–18196, 2022

2022
[122]

Liong, R

S.-T. Liong, R. C.-W. Phan, J. See, Y.-H. Oh, and K. Wong. Optical strain based recognition of subtle emotions. In Proc. Int. Symp. Intell. Signal Process., pages 180–184, 2014

2014
[123]

Liong, J

S.-T. Liong, J. See, K. Wong, and R. C.-W. Phan. Less is more: Micro-expression recognition from video using apex frame.Signal Process. Image Commun., 62:82–92, 2018

2018
[124]

Liong, Y

S.-T. Liong, Y. S. Gan, J. See, H.-Q. Khor, and Y.-C. Huang. Shallow triple stream three-dimensional cnn (ststnet) for micro-expression recognition. In Proc. IEEE Int. Conf. Autom. Face Gesture Recognit. , pages 1–5, 2019

2019
[125]

Liong, Y

S.-T. Liong, Y. S. Gan, D. Zheng, S.-M. Li, H.-X. Xu, H.-Z. Zhang, R.-K. Lyu, and K.-H. Liu. Evaluation of the spatio-temporal features and gan for micro-expression recognition system. J. Signal Process. Syst. , 92:705–725, 2020

2020
[126]

C. Liu, K. Hirota, and Y. Dai. Patch attention convolutional vision transformer for facial expression recognition with occlusion. Inf. Sci., 619: 781–794, 2023. ISSN 0020-0255

2023
[127]

D. Liu, X. Ouyang, S. Xu, P. Zhou, K. He, and S. Wen. Saanet: Siamese action-units attention network for improving dynamic facial expression recognition. Neurocomputing, 413:145–157, 2020. ISSN 0925-2312

2020
[128]

H. Liu, H. Cai, Q. Lin, X. Li, and H. Xiao. Adaptive multilayer perceptual attention network for facial expression recognition. IEEE Trans. Circuits Syst. Video Technol., 32(9):6253–6266, 2022

2022
[129]

J. Liu, W. Zheng, and Y. Zong. Sma-stn: Segmented movement-attending spatiotemporal network formicro-expression recognition. arXiv preprint arXiv:2010.09342, 2020

2010 arXiv
[130]

Y. Liu, C. Feng, X. Yuan, L. Zhou, W. Wang, J. Qin, and Z. Luo. Clip-aware expressive feature learning for video-based facial expression recognition. Inf. Sci., 598:182–195, 2022. ISSN 0020-0255

2022
[131]

Y. Liu, Y. Li, X. Yi, Z. Hu, H. Zhang, and Y. Liu. Lightweight vit model for micro-expression recognition enhanced by transfer learning. Front. Neurorob., 16, 2022

2022
[132]

Y. Liu, W. Wang, C. Feng, H. Zhang, Z. Chen, and Y. Zhan. Expression snippet transformer for robust video-based facial expression recognition. Pattern Recognit., 138:109368, 2023. ISSN 0031-3203

2023
[133]

Y. Liu, X. Zhang, J. Kauttonen, and G. Zhao. Uncertain facial expression recognition via multi-task assisted correction. IEEE Trans. Multimedia, 26: 2531–2543, 2024

2024
[134]

Liu, J.-K

Y.-J. Liu, J.-K. Zhang, W.-J. Yan, S.-J. Wang, G. Zhao, and X. Fu. A main directional mean optical flow feature for spontaneous micro-expression recognition. IEEE Trans. Affect. Comput. , 7(4):299–310, 2015

2015
[135]

Lucey, J

P. Lucey, J. F. Cohn, T. Kanade, J. Saragih, Z. Ambadar, and I. Matthews. The extended cohn-kanade dataset (ck+): A complete dataset for action unit and emotion-specified expression. In Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. , pages 94–101, 2010

2010
[136]

M. J. Lyons, M. Kamachi, and J. Gyoba. Coding facial expressions with gabor wavelets. In Proc. IEEE Int. Conf. Autom. Face Gesture Recognit. , pages 200–205, 1998

1998
[137]

F. Ma, B. Sun, and S. Li. Spatio-temporal transformer for dynamic facial expression recognition in the wild. arXiv preprint arXiv:2205.04749, 2022

2022 arXiv
[138]

Q. Mao, L. Zhou, W. Zheng, X. Shao, and X. Huang. Objective class-based micro-expression recognition under partial occlusion via region-inspired relation reasoning network. IEEE Trans. Affect. Comput. , 13(4):1998–2016, 2022

1998
[139]

P. D. Marrero Fernandez, F. A. Guerrero Pena, T. Ing Ren, and A. Cunha. Feratt: Facial expression recognition with attention net. InProc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops , June 2019

2019
[140]

Mehrabian and M

A. Mehrabian and M. Wiener. Decoding of inconsistent communications. J. Pers. Soc. Psychol. , 6(1), 1967

1967
[141]

D. Meng, X. Peng, K. Wang, and Y. Qiao. Frame attention networks for facial expression recognition in videos. In Proc. IEEE Int. Conf. Image Process., pages 3866–3870, 2019

2019
[142]

Meng and W

S. Meng and W. Shi. Fusing structure and appearance features in facial expression recognition transformer. In Proc. IEEE Int. Conf. Acoust. Speech Signal Process., pages 3600–3604, 2024

2024
[143]

A. Mian, M. Bennamoun, and R. Owens. An efficient multimodal 2D-3D hybrid approach to automatic face recognition. IEEE Trans. Pattern Anal. Mach. Intell., 29(11):1927–1943, 2007

1927
[144]

Miolla, M

A. Miolla, M. Cardaioli, and C. Scarpazza. Padova emotional dataset of facial expressions (pedfe): A unique dataset of genuine and posed emotional facial expressions. Behav. Res. Methods, 55(5):2559–2574, 2023

2023
[145]

Mohan, A

K. Mohan, A. Seal, O. Krejcar, and A. Yazidi. Facial expression recognition using local gravitational force descriptor-based deep convolution neural networks. IEEE Trans. Instrum. Meas. , 70:1–12, 2021

2021
[146]

Mollahosseini, B

A. Mollahosseini, B. Hasani, and M. H. Mahoor. Affectnet: A database for facial expression, valence, and arousal computing in the wild. IEEE Trans. Affect. Comput., 10(1):18–31, 2019. Manuscript submitted to ACM Facial Expression Analysis and Its Potentials in IoT Systems: A C...

2019
[147]

Muhammad and M

G. Muhammad and M. S. Hossain. Emotion recognition for cognitive edge computing using deep learning.IEEE Internet Things J., 8(23):16894–16901, 2021

2021
[148]

H.-W. Ng, V. D. Nguyen, V. Vonikakis, and S. Winkler. Deep learning for emotion recognition on small datasets using transfer learning. InProc. Int. Conf. Multimodal Interact., ICMI ’15, page 443–449. Association for Computing Machinery, 2015. ISBN 9781450339124

2015
[149]

Q. T. Ngo and S. Yoon. Facial expression recognition based on weighted-cluster loss and deep transfer learning using a highly imbalanced dataset. Sensors, 20(9), 2020. ISSN 1424-8220

2020
[150]

Nguyen, S.-H

H.-D. Nguyen, S.-H. Kim, G.-S. Lee, H.-J. Yang, I.-S. Na, and S.-H. Kim. Facial expression recognition using a temporal ensemble of multi-level convolutional neural networks. IEEE Trans. Affect. Comput. , 13(1):226–237, 2022

2022
[151]

Nguyen, C

X.-B. Nguyen, C. N. Duong, X. Li, S. Gauch, H.-S. Seo, and K. Luu. Micron-BERT: BERT-based Facial Micro-Expression Recognition. In Proc. IEEE Conf. Comput. Vis. Pattern Recognit. , pages 1482–1492, 2023

2023
[152]

X. Nie, M. A. Takalkar, M. Duan, H. Zhang, and M. Xu. Geme: Dual-stream multi-task gender-based micro-expression recognition.Neurocomputing, 427:13–28, 2021

2021
[153]

M. Niu, Y. Li, J. Tao, and S.-J. Wang. Micro-expression recognition based on local two-order gradient pattern. In Proc. IEEE Asian Conf. Affect. Comput. Intell. Interact., pages 1–6. IEEE, 2018

2018
[154]

Odena, C

A. Odena, C. Olah, and J. Shlens. Conditional image synthesis with auxiliary classifier gans. In Proc. Int. Conf. Mach. Learn. , pages 2642–2651, 2017

2017
[155]

B. Pan, K. Hirota, Y. Dai, Z. Jia, E. F. Fukushima, and J. She. Adaptive key-frame selection-based facial expression recognition via multi-cue dynamic features hybrid fusion. Inf. Sci., 660:120138, 2024. ISSN 0020-0255

2024
[156]

H. Pan, L. Xie, and Z. Wang. Local bilinear convolutional neural network for spotting macro-and micro-expression intervals in long video sequences. In Proc. IEEE Int. Conf. Autom. Face Gesture Recognit. , pages 749–753, 2020

2020
[157]

X. Pan, Q. Xie, W. Liu, and B. Liu. Multi-task facial expression recognition with joint gender learning. In Proc. IEEE Int. Conf. Syst. Man Cybern. , pages 210–215, 2022

2022
[158]

M. Pantic. Machine analysis of facial behaviour: Naturalistic and dynamic behaviour. Philos. Trans. Royal Soc. B Biol. Sci. , 364(1535):3505–3513, 2009

2009
[159]

Pantic, M

M. Pantic, M. Valstar, R. Rademaker, and L. Maat. Web-based database for facial expression analysis. In Proc. IEEE Int. Conf. Multimedia Expo , 2005

2005
[160]

J. Park, S. Son, and K. M. Lee. Content-aware local gan for photo-realistic super-resolution. In Proc. IEEE Int. Conf. Comput. Vis. , pages 10585–10594, 2023

2023
[161]

Patel, G

D. Patel, G. Zhao, and M. Pietikäinen. Spatiotemporal integration of optical flow vectors for micro-expression detection. In Proc. Int. Conf. Adv. Concepts Intell. Vis. Syst. , pages 369–380. Springer, 2015

2015
[162]

Patel, X

D. Patel, X. Hong, and G. Zhao. Selective deep features for micro-expression recognition. In Proc. Int. Conf. Pattern Recognit. , pages 2258–2263, 2016

2016
[163]

E. Pei, M. C. Oveneke, Y. Zhao, D. Jiang, and H. Sahli. Monocular 3d facial expression features for continuous affect recognition. IEEE Trans. Multimedia, 23:3540–3550, 2021

2021
[164]

M. Peng, Z. Wu, Z. Zhang, and T. Chen. From macro to micro expression recognition: Deep learning on small datasets using transfer learning. In Proc. IEEE Int. Conf. Autom. Face Gesture Recognit. , pages 657–661, 2018

2018
[165]

Pfister, X

T. Pfister, X. Li, G. Zhao, and M. Pietikäinen. Differentiating spontaneous from posed facial expressions within a generic facial expression recognition framework. In Proc. Int. Conf. Comput. Vis. , pages 868–875, 2011

2011
[166]

Pfister, X

T. Pfister, X. Li, G. Zhao, and M. Pietikäinen. Recognising spontaneous facial micro-expressions. In Proc. Int. Conf. Comput. Vis. , pages 1449–1456, 2011

2011
[167]

Polikovsky, Y

S. Polikovsky, Y. Kameda, and Y. Ohta. Facial micro-expressions recognition using high speed camera and 3D-gradient descriptor. In Proc. Int. Conf. Crime Detection Prevention, pages 1–6, 2009

2009
[168]

Pons and D

G. Pons and D. Masip. Supervised committee of convolutional neural networks in automated facial expression analysis. IEEE Trans. Affect. Comput., 9(3):343–350, 2018

2018
[169]

Pons and D

G. Pons and D. Masip. Multi-task, multi-label and multi-domain learning with residual convolutional networks for emotion recognition. arXiv preprint arXiv:1802.06664, 2018

2018 arXiv
[170]

L. Qin, M. Wang, C. Deng, K. Wang, X. Chen, J. Hu, and W. Deng. Swinface: A multi-task transformer for face recognition, expression recognition, age estimation and attribute estimation. IEEE Trans. Circuits Syst. Video Technol. , 34(4):2223–2234, 2024

2024
[171]

Qu, S.-J

F. Qu, S.-J. Wang, W.-J. Yan, H. Li, S. Wu, and X. Fu. CAS (ME)2: A database for spontaneous macro-expression and micro-expression spotting and recognition. IEEE Trans. Affect. Comput. , 9(4):424–436, 2017

2017
[172]

M. A. Rahman and M. S. Hossain. An internet-of-medical-things-enabled edge computing framework for tackling covid-19. IEEE Internet Things J. , 8(21):15847–15854, 2021

2021
[173]

S. P. T. Reddy, S. T. Karri, S. R. Dubey, and S. Mukherjee. Spontaneous facial micro-expression recognition using 3D spatiotemporal convolutional neural networks. In Proc. IEEE Int. Joint Conf. Neural Netw. , pages 1–8, 2019

2019
[174]

L. J. Rothkrantz and M. Pantic. Automatic analysis of facial expressions: the state of the art.IEEE Trans. Pattern Anal. Mach. Intell., 22(12):1424–1445, 2000

2000
[175]

Roy and A

S. Roy and A. Etemad. Self-supervised contrastive learning of multi-view facial expressions. In Proc. Int. Conf. Multimodal Interact. , ICMI ’21, page 253–257. Association for Computing Machinery, 2021. ISBN 9781450384810

2021
[176]

Roy and A

S. Roy and A. Etemad. Contrastive learning of view-invariant representations for facial expressions recognition. ACM Trans. Multimedia Comput. Commun. Appl., 20(4), dec 2023. ISSN 1551-6857. Manuscript submitted to ACM 32 Zixuan Shangguan, Yanjie Dong, Song Guo, Victor C. M. L...

2023
[177]

U. Saeed. Facial micro-expressions as a soft biometric for person recognition. Pattern Recognit. Lett., 143:95–103, MAR 2021. ISSN 0167-8655

2021
[178]

Saffaryazdi, S

N. Saffaryazdi, S. T. Wasim, K. Dileep, A. F. Nia, S. Nanayakkara, E. Broadbent, and M. Billinghurst. Using facial micro-expressions in combination with eeg and physiological signals for emotion recognition. Front. Psychol., 13, 2022

2022
[179]

Saurav, P

S. Saurav, P. Gidde, R. Saini, and S. Singh. Dual integrated convolutional neural network for real-time facial expression recognition in the wild. Vis. Comput., 38(3):1083–1096, 2022

2022
[180]

Shao and Y

J. Shao and Y. Qian. Three convolutional neural network models for facial expression recognition in the wild. Neurocomputing, 355:82–92, 2019. ISSN 0925-2312

2019
[181]

Sharifnejad, A

M. Sharifnejad, A. Shahbahrami, A. Akoushideh, and R. Z. Hassanpour. Facial expression recognition using a combination of enhanced local binary pattern and pyramid histogram of oriented gradients features extraction. IET Image Process., 15(2):468–478, 2021

2021
[182]

Sharma, S

P. Sharma, S. Coleman, P. Yogarajah, L. Taggart, and P. Samarasinghe. Comparative analysis of super-resolution reconstructed images for micro-expression recognition. Adv. Intell. Soft. Comp., 2(3):24, 2022

2022
[183]

Sharma, S

P. Sharma, S. Coleman, P. Yogarajah, L. Taggart, and P. Samarasinghe. Evaluation of generative adversarial network generated super resolution images for micro expression recognition. In Proc. Int. Conf. Recognit. Appl. Method , pages 560–569, 2022

2022
[184]

Sharma, M

V. Sharma, M. Tapaswi, M. S. Sarfraz, and R. Stiefelhagen. Self-supervised learning of face representations for video face clustering. In Proc. IEEE Int. Conf. Autom. Face Gesture Recognit. , pages 1–8, 2019

2019
[185]

X.-b. Shen, Q. Wu, and X.-l. Fu. Effects of the duration of expressions on the recognition of microexpressions. J. Zhejiang Univ.-SCI. B, 13:221–230, 2012

2012
[186]

Shilaskar, S

S. Shilaskar, S. Patukale, P. Oak, and S. Bhatlawande. An expert system for facial micro-expressions based lie detection. In Proc. Int. Conf. Comput. Commun. Netw. Technol., pages 1–10, 2023

2023
[187]

Shreve, S

M. Shreve, S. Godavarthy, D. Goldgof, and S. Sarkar. Macro-and micro-expression spotting in long videos using spatio-temporal strain. In Proc. IEEE Int. Conf. Autom. Face Gesture Recognit. , pages 51–56, 2011

2011
[188]

Shukla, P

S. Shukla, P. K. Rai, and T. T. Verlekar. Micro-expression recognition using a shallow convlstm-based network. In Proc. Asian Conf. Comput. Vis. , pages 17–28, 2022

2022
[189]

Siriwardhana, T

S. Siriwardhana, T. Kaluarachchi, M. Billinghurst, and S. Nanayakkara. Multimodal emotion recognition with transformer-based self supervised feature fusion. IEEE Access, 8:176274–176285, 2020

2020
[190]

S. Song, E. Sanchez, L. Shen, and M. Valstar. Self-supervised learning of dynamic representations for static images. In Proc. Int. Conf. Pattern Recognit., pages 1619–1626, 2021

2021
[191]

Y. Song, W. Zhao, T. Chen, S. Li, and J. Li. Recognizing microexpression as macroexpression by the teacher-student framework network. In Proc. IEEE Int. Symp. Mix. Augmented Reality Adjunct , pages 548–553, 2022

2022
[192]

B. Sun, S. Cao, D. Li, J. He, and L. Yu. Dynamic micro-expression recognition using knowledge distillation. IEEE Trans. Affect. Comput. , 13(2): 1037–1043, 2020

2020
[193]

L. Sun, Z. Lian, B. Liu, and J. Tao. Mae-dfer: Efficient masked autoencoder for self-supervised dynamic facial expression recognition. In Proc. ACM Int. Conf. Multimedia, page 6110–6121, 2023

2023
[194]

M. Sun, W. Cui, Y. Zhang, S. Yu, X. Liao, B. Hu, and Y. Li. Attention-rectified and texture-enhanced cross-attention transformer feature fusion network for facial expression recognition. IEEE Trans. Ind. Inf. , 19(12):11823–11832, 2023

2023
[195]

X. Sun, P. Xia, and F. Ren. Multi-attention based deep neural network with hybrid features for dynamic sequential facial expression recognition. Neurocomputing, 444:378–389, 2021. ISSN 0925-2312

2021
[196]

J. M. Susskind, A. K. Anderson, and G. E. Hinton. The toronto face database. Dept. Comput. Sci., Univ. Toronto, Toronto, ON, Canada, Tech. Rep. , 3, 2010

2010
[197]

Szegedy, S

C. Szegedy, S. Ioffe, V. Vanhoucke, and A. Alemi. Inception-v4, inception-resnet and the impact of residual connections on learning. In Proc. AAAI Conf. Artif. Intell., volume 31, 2017

2017
[198]

M. A. Takalkar, S. Thuseethan, S. Rajasegarar, Z. Chaczko, M. Xu, and J. Yearwood. Lgattnet: Automatic micro-expression detection using dual-stream local and global attentions. Knowledge-Based Syst., 212, 2021

2021
[199]

Tran, V.-H

N.-T. Tran, V.-H. Tran, N.-B. Nguyen, T.-K. Nguyen, and N.-M. Cheung. On data augmentation for gan training.IEEE Trans. Image Process., 30: 1882–1897, 2021

2021
[200]

T.-K. Tran, X. Hong, and G. Zhao. Sliding window based micro-expression spotting: a benchmark. In Proc. Int. Conf. Adv. Concepts Intell. Vis. Syst. , pages 542–553, 2017

2017
[201]

M. A. Uddin, J. B. Joolee, and K.-A. Sohn. Dynamic facial expression understanding using deep spatiotemporal ldsp on spark. IEEE Access, 9: 16866–16877, 2021

2021
[202]

Ulrich, F

L. Ulrich, F. Marcolin, E. Vezzetti, F. Nonis, D. C. Mograbi, G. W. Scurati, N. Dozio, and F. Ferrise. Cald3r and mend3s: Spontaneous 3d facial expression databases. J. Vis. Commun. Image Represent. , 98:104033, 2024. ISSN 1047-3203

2024
[203]

Vahdani and Y

E. Vahdani and Y. Tian. Deep learning-based action detection in untrimmed videos: A survey. IEEE Trans. Pattern Anal. Mach. Intell. , 45(4): 4302–4320, 2022

2022
[204]

Valstar, M

M. Valstar, M. Pantic, et al. Induced disgust, happiness and surprise: an addition to the mmi facial expression database. In Proc. Int.Workshop Emotion (Satell. LREC): Corpora Res. Emotion Affect , volume 10, pages 65–70. Paris, France., 2010. Manuscript submitted to ACM Facia...

2010
[205]

Verma, S

M. Verma, S. K. Vipparthi, G. Singh, and S. Murala. Learnet: Dynamic imaging network for micro expression recognition. IEEE Trans. Image Process., 29:1618–1627, 2019

2019
[206]

Viswanatha Reddy, C

G. Viswanatha Reddy, C. Dharma Savarni, and S. Mukherjee. Facial expression recognition in the wild, by fusion of deep learnt and hand-crafted features. Cogn. Syst. Res., 62:23–34, 2020. ISSN 1389-0417

2020
[207]

Wadhawan and T

R. Wadhawan and T. K. Gandhi. Landmark-aware and part-based ensemble transfer learning network for static facial expression recognition from images. IEEE Trans. Artif. Intell., 4(2):349–361, 2023

2023
[208]

Wahid, A

Z. Wahid, A. H. Bari, F. Anzum, and M. L. Gavrilova. Human micro-expression: A novel social behavioral biometric for person identification. IEEE Access, 11:57481–57493, 2023

2023
[209]

B. Wan, J. Dang, X. Liu, and Q. Wang. Micro-expression recognition based on maml meta-learning algorithm. In Proc. IEEE Smartworld Ubiquitous Intell. Comput. Scalable Comput. , pages 1322–1328, 2022

2022
[210]

C. Wang, M. Peng, T. Bi, and T. Chen. Micro-attention for micro-expression recognition. Neurocomputing, 410:354–362, 2020

2020
[211]

G. Wang, S. Huang, and Z. Tao. Shallow multi-branch attention convolutional neural network for micro-expression recognition. Multimedia Syst., pages 1–14, 2023

2023
[212]

J. Wang, H. Ding, and S. Wang. Occluded facial expression recognition using self-supervised learning. In Proc. Asian Conf. Comput. Vis. , pages 1077–1092, December 2022

2022
[213]

K. Wang, X. Peng, J. Yang, D. Meng, and Y. Qiao. Region attention networks for pose and occlusion robust facial expression recognition. IEEE Trans. Image Process., 29:4057–4069, 2020

2020
[214]

L. Wang, X. Kang, F. Ding, S. Nakagawa, and F. Ren. Msstnet: A multi-scale spatio-temporal cnn-transformer network for dynamic facial expression recognition. In Proc. IEEE Int. Conf. Acoust. Speech Signal Process. , pages 3015–3019, 2024

2024
[215]

M. Wang, J. Wang, Y. Li, and H. Lu. Edge computing with complementary capsule networks for mental state detection in underground mining industry. IEEE Trans. Ind. Inf. , pages 8508–8517, 2022

2022
[216]

M. Wang, Q. Wang, Q. Wang, and Z. Zheng. A fixed-point rotation-based feature selection method for micro-expression recognition. Pattern Recognit. Lett., 164:261–267, 2022

2022
[217]

S. Wang, H. Shuai, and Q. Liu. Phase space reconstruction driven spatio-temporal feature learning for dynamic facial expression recognition. IEEE Trans. Affect. Comput., 13(3):1466–1476, 2022

2022
[218]

S. Wang, X. Zhao, X. Zeng, J. Xie, Y. Luo, J. Chen, and G. Liu. Micro-expression recognition based on eeg signals. Biomed. Signal Process. Control, 86, 2023

2023
[219]

S.-J. Wang, S. Wu, and X. Fu. A main directional maximal difference analysis for spotting micro-expressions. In Proc. Asian Conf. Comput. Vis. , pages 449–461, 2016

2016
[220]

S.-J. Wang, S. Wu, X. Qian, J. Li, and X. Fu. A main directional maximal difference analysis for spotting facial movements from long-term videos. Neurocomputing, 230:382–389, 2017

2017
[221]

S.-J. Wang, Y. He, J. Li, and X. Fu. Mesnet: A convolutional neural network for spotting multi-scale micro-expression intervals in long videos. IEEE Trans. Image Process., 30:3956–3969, 2021

2021
[222]

Wang and L

T. Wang and L. Shang. Temporal augmented contrastive learning for micro-expression recognition. Pattern Recognit. Lett., 167:122–131, 2023

2023
[223]

Y. Wang, J. See, R. C.-W. Phan, and Y.-H. Oh. Efficient spatio-temporal local binary patterns for spontaneous facial micro-expression recognition. PloS One, 10(5), 2015

2015
[224]

Y. Wang, J. See, R. C.-W. Phan, and Y.-H. Oh. Lbp with six intersection points: Reducing redundant information in lbp-top for micro-expression recognition. In Proc. Asian Conf. Comput. Vis. , pages 525–537, 2015

2015
[225]

Y. Wang, Y. Sun, Y. Huang, Z. Liu, S. Gao, W. Zhang, W. Ge, and W. Zhang. Ferv39k: A large-scale multi-scene dataset for facial expression recognition in videos. In Proc. IEEE Conf. Comput. Vis. Pattern Recognit. , pages 20922–20931, June 2022

2022
[226]

Y. Wang, H. Shi, and R. Wang. Action decouple multi-tasking for micro-expression recognition. IEEE Access, 11:82978–82988, 2023

2023
[227]

Warren, E

G. Warren, E. Schertler, and P. Bull. Detecting deception from emotional and unemotional cues. J. Nonverbal Behav., 33:59–69, 2009

2009
[228]

J. Wei, G. Lu, J. Yan, and H. Liu. Micro-expression recognition using local binary pattern from five intersecting planes. Multimed. Tools Appl., 81 (15):20643–20668, 2022

2022
[229]

J. Wei, G. Lu, J. Yan, and Y. Zong. Learning two groups of discriminative features for micro-expression recognition. Neurocomputing, 479:22–36, 2022

2022
[230]

K. S. Widjaja, C. C. Alamo, A. Chowanda, et al. Exploring the accuracy of artificial intelligence in detecting lies through micro-expression analysis. In Proc. Int. Conf. Inf. Commun. Technol. , pages 218–223, 2023

2023
[231]

Xia and S

B. Xia and S. Wang. Micro-expression recognition enhanced by macro-expression from spatial-temporal domain. In Proc. Int. Joint Conf. Artif. Intell., pages 1186–1193, 2021

2021
[232]

B. Xia, W. Wang, S. Wang, and E. Chen. Learning from macro-expression: a micro-expression recognition framework. In Proc. ACM Int. Conf. Multimedia, pages 2936–2944, 2020

2020
[233]

X. Xia, L. Yang, X. Wei, H. Sahli, and D. Jiang. A multi-scale multi-attention network for dynamic facial expression recognition. Multimedia Syst., 28(2):479–493, 2022

2022
[234]

Z. Xia, W. Peng, H.-Q. Khor, X. Feng, and G. Zhao. Revealing the invisible with model and data shrinking for composite-database micro-expression recognition. IEEE Trans. Image Process. , 29:8590–8605, 2020. Manuscript submitted to ACM 34 Zixuan Shangguan, Yanjie Dong, Song Guo...

2020
[235]

J. Xiao, C. Gan, Q. Zhu, Y. Zhu, and G. Liu. Cfnet: Facial expression recognition via constraint fusion under multi-task joint learning network. Applied Soft Computing, 141:110312, 2023. ISSN 1568-4946

2023
[236]

H.-X. Xie, L. Lo, H.-H. Shuai, and W.-H. Cheng. An overview of facial micro-expression analysis: Data, methodology and challenge. IEEE Trans. Affect. Comput., 14(3):1857–1875, 2022

2022
[237]

J. Xie, J. Wang, Q. Wang, D. Yang, J. Gu, Y. Tang, and Y. I. Varatnitski. A multimodal fusion emotion recognition method based on multitask learning and attention mechanism. Neurocomputing, 556:126649, 2023. ISSN 0925-2312

2023
[238]

Xie and H

S. Xie and H. Hu. Facial expression recognition using hierarchical features with deep comprehensive multipatches aggregation convolutional neural networks. IEEE Trans. Multimedia, 21(1):211–220, 2019

2019
[239]

Xiong, X

S. Xiong, X. Huang, K. Sato, and B. Wu. A smart glasses-based real-time micro-expressions recognition system via deep neural network. In Proc. Int. Conf. Green Pervasive Cloud Comput. , pages 191–205. Springer, 2023

2023
[240]

W. Xu, C. Long, R. Wang, and G. Wang. Drb-gan: A dynamic resblock generative adversarial network for artistic style transfer. In Proc. IEEE Int. Conf. Comput. Vis., pages 6383–6392, 2021

2021
[241]

Y. Xu, S. Zhao, H. Tang, X. Mao, T. Xu, and E. Chen. Famgan: Fine-grained aus modulation based generative adversarial network for micro-expression generation. In Proc. ACM Int. Conf. Multimedia , pages 4813–4817, 2021

2021
[242]

F. Xue, Q. Wang, and G. Guo. Transfer: Learning relation-aware facial expression representations with transformers. In Proc. IEEE Int. Conf. Comput. Vis., pages 3601–3610, October 2021

2021
[243]

W.-J. Yan, Q. Wu, Y.-J. Liu, S.-J. Wang, and X. Fu. Casme database: A dataset of spontaneous micro-expressions collected from neutralized faces. In Proc. IEEE Int. Conf. Autom. Face Gesture Recognit. , pages 1–7, 2013

2013
[244]

W.-J. Yan, X. Li, S.-J. Wang, G. Zhao, Y.-J. Liu, Y.-H. Chen, and X. Fu. Casme ii: An improved spontaneous micro-expression database and the baseline evaluation. PloS one, 9(1):e86041, 2014

2014
[245]

Yan, S.-J

W.-J. Yan, S.-J. Wang, Y.-H. Chen, G. Zhao, and X. Fu. Quantifying micro-expressions with constraint local model and local binary pattern. In Proc. Workshop Eur. Conf. Comput. Vis., pages 296–305, 2015

2015
[246]

B. Yang, J. Wu, K. Ikeda, G. Hattori, M. Sugano, Y. Iwasawa, and Y. Matsuo. Deep learning pipeline for spotting macro-and micro-expressions in long video sequences based on action units and optical flow. Pattern Recognit. Lett., 165:63–74, 2023

2023
[247]

J. Yang, T. Qian, F. Zhang, and S. U. Khan. Real-time facial expression recognition based on edge computing. IEEE Access, 9:76178–76190, 2021

2021
[248]

C. H. Yap, M. H. Yap, A. Davison, C. Kendrick, J. Li, S.-J. Wang, and R. Cunningham. 3d-cnn for facial micro-and macro-expression spotting on long video sequences using temporal oriented reference frame. In Proc. ACM Int. Conf. Multimedia , pages 7016–7020, 2022

2022
[249]

N. L. Yee, M. A. Zulkifley, A. H. Saputro, and S. R. Abdani. Apex frame spotting using attention networks for micro-expression recognition system. CMC-Comput. Mat. Contin., 73(3):5331–5348, 2022

2022
[250]

Yildirim, M

S. Yildirim, M. S. Chimeumanu, and Z. A. Rana. The influence of micro-expressions on deception detection. Multimed. Tools Appl. , 82(19): 29115–29133, 2023

2023
[251]

L. Yin, X. Wei, Y. Sun, J. Wang, and M. Rosato. A 3d facial expression database for facial behavior research. In Proc. Int. Conf. Autom. Face Gesture Recognit., pages 211–216, 2006

2006
[252]

S. Yin, S. Wu, T. Xu, S. Liu, S. Zhao, and E. Chen. Au-aware graph convolutional network for macroand micro-expression spotting. In Proc. IEEE Int. Conf. Multimedia Expo, pages 228–233, 2023

2023
[253]

J. Yu, C. Zhang, Y. Song, and W. Cai. Ice-gan: identity-aware and capsule-enhanced gan with graph-based reasoning for micro-expression recognition and synthesis. In Proc. Int. Jt. Conf. Neural Netw. , pages 1–8, 2021

2021
[254]

M. Yu, H. Zheng, Z. Peng, J. Dong, and H. Du. Facial expression recognition based on a multi-task global-local network. Pattern Recognit. Lett., 131: 166–171, 2020

2020
[255]

Yu and H

W. Yu and H. Xu. Co-attentive multi-task convolutional neural network for facial expression recognition. Pattern Recognit., 123:108401, 2022. ISSN 0031-3203

2022
[256]

W.-W. Yu, J. Jiang, and Y.-J. Li. Lssnet: A two-stream convolutional neural network for spotting macro-and micro-expression in long videos. In Proc. ACM Int. Conf. Multimedia , pages 4745–4749, 2021

2021
[257]

Y. Yu, H. Duan, and M. Yu. Spatiotemporal features selection for spontaneous micro-expression recognition. J. Intell. Fuzzy Syst. , 35(4):4773–4784, 2018

2018
[258]

Z. Yu, G. Liu, Q. Liu, and J. Deng. Spatio-temporal convolutional features with nested lstm for facial expression recognition. Neurocomputing, 317: 50–57, 2018. ISSN 0925-2312

2018
[259]

Zaghbani and M

S. Zaghbani and M. S. Bouhlel. Multi-task cnn for multi-cue affects recognition using upper-body gestures and facial expressions. Int. j. inf. tecnol. , 14(1):531–538, 2022

2022
[260]

Zbontar, L

J. Zbontar, L. Jing, I. Misra, Y. LeCun, and S. Deny. Barlow twins: Self-supervised learning via redundancy reduction. In Proc. Int. Conf. Mach. Learn., volume 139, pages 12310–12320. PMLR, 18–24 Jul 2021

2021
[261]

Zhang, I

H. Zhang, I. Goodfellow, D. Metaxas, and A. Odena. Self-attention generative adversarial networks. InProc. Int. Conf. Mach. Learn., pages 7354–7363. PMLR, 2019

2019
[262]

Zhang, Y

K. Zhang, Y. Huang, Y. Du, and L. Wang. Facial expression recognition based on deep evolutional spatial-temporal networks. IEEE Trans. Image Process., 26(9):4193–4203, 2017. Manuscript submitted to ACM Facial Expression Analysis and Its Potentials in IoT Systems: A Contemporar...

2017
[263]

Zhang, F

W. Zhang, F. Qiu, S. Wang, H. Zeng, Z. Zhang, R. An, B. Ma, and Y. Ding. Transformer-based multimodal information fusion for facial expression analysis. In Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops , pages 2428–2437, June 2022

2022
[264]

Zhang, M

X. Zhang, M. Li, S. Lin, H. Xu, and G. Xiao. Transformer-based multimodal emotional perception for dynamic facial expression recognition in the wild. IEEE Trans. Circuits Syst. Video Technol. , 34(5):3192–3203, 2024

2024
[265]

Zhang, H

Y. Zhang, H. Jiang, X. Li, B. Lu, K. M. Rabie, and A. U. Rehman. A new framework combining local-region division and feature selection for micro-expressions recognition. IEEE Access, 8:94499–94509, 2020

2020
[266]

Zhang, X

Y. Zhang, X. Xu, Y. Zhao, Y. Wen, Z. Tang, and M. Liu. Facial prior guided micro-expression generation. IEEE Trans. Image Process. , pages 1–1, 2023

2023
[267]

Zhang, T

Z. Zhang, T. Chen, H. Meng, G. Liu, and X. Fu. Smeconvnet: A convolutional neural network for spotting spontaneous facial micro-expression from long videos. IEEE Access, 6:71143–71151, 2018

2018
[268]

Zhang, P

Z. Zhang, P. Luo, C. C. Loy, and X. Tang. From facial expression recognition to interpersonal relation prediction. Int. J. Comput. Vis. , 126:550–569, 2018

2018
[269]

Zhao and M

G. Zhao and M. Pietikainen. Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans. Pattern Anal. Mach. Intell., 29(6):915–928, 2007

2007
[270]

G. Zhao, X. Huang, M. Taini, S. Z. Li, and M. Pietikäinen. Facial expression recognition from near-infrared videos. Image Vis. Comput. , 29(9): 607–619, 2011. ISSN 0262-8856

2011
[271]

G. Zhao, X. Li, Y. Li, and M. Pietikäinen. Facial micro-expressions: An overview. Proc. IEEE, 111(10):1215–1235, 2023

2023
[272]

R. Zhao, T. Liu, J. Xiao, D. P. Lun, and K.-M. Lam. Deep multi-task learning for facial expression recognition and synthesis based on selective feature sharing. In Proc. Int. Conf. Pattern Recognit. , pages 4412–4419, 2021

2021
[273]

R. Zhao, T. Liu, Z. Huang, D. P. Lun, and K.-M. Lam. Spatial-temporal graphs plus transformers for geometry-guided facial expression recognition. IEEE Trans. Affect. Comput. , 14(4):2751–2767, 2023

2023
[274]

S. Zhao, H. Tao, Y. Zhang, T. Xu, K. Zhang, Z. Hao, and E. Chen. A two-stage 3d cnn based learning method for spontaneous micro-expression recognition. Neurocomputing, 448:276–289, 2021

2021
[275]

X. Zhao, J. Chen, T. Chen, Y. Liu, S. Wang, X. Zeng, J. Yan, and G. Liu. Micro-expression recognition based on nodal efficiency in the eeg function network. IEEE Trans. Neural Syst. Rehabil. Eng. , 2024

2024
[276]

Zhao and Q

Z. Zhao and Q. Liu. Former-dfer: Dynamic facial expression recognition transformer. In Proc. ACM Int. Conf. Multimedia , MM ’21, page 1553–1561. Association for Computing Machinery, 2021. ISBN 9781450386517

2021
[277]

Z. Zhao, Q. Liu, and S. Wang. Learning deep global multi-scale and local attention features for facial expression recognition in the wild. IEEE Trans. Image Process., 30:6544–6556, 2021

2021
[278]

Zheng, M

C. Zheng, M. Mendieta, and C. Chen. Poster: A pyramid cross-fusion transformer network for facial expression recognition. In Proc. IEEE Int. Conf. Comput. Vis. Workshops, pages 3146–3155, October 2023

2023
[279]

Zhi and M

R. Zhi and M. Wan. Dynamic facial expression feature learning based on sparse RNN. In Proc. IEEE Joint Int. Inform. Technol. Artificial Intell. Conf. , pages 1373–1377, 2019

2019
[280]

R. Zhi, H. Xu, M. Wan, and T. Li. Combining 3D convolutional neural networks with transfer learning by supervised pre-training for facial micro-expression recognition. IEICE Trans. Inf. Syst. , 102(5):1054–1064, 2019

2019
[281]

J. Zhou, S. Sun, H. Xia, X. Liu, H. Wang, and T. Chen. Ulme-gan: a generative adversarial network for micro-expression sequence generation. Appl. Intell., pages 1–13, 2023

2023
[282]

L. Zhou, Q. Mao, and L. Xue. Cross-database micro-expression recognition: a style aggregated and attention transfer approach. In Proc. IEEE Int. Conf. Multimedia Expo, pages 102–107, 2019

2019
[283]

Y. Zhou, Y. Song, L. Chen, Y. Chen, X. Ben, and Y. Cao. A novel micro-expression detection algorithm based on BERT and 3DCNN. Image Vis. Comput., 119, 2022

2022
[284]

Video expression recognition method based on spatiotemporal recurrent neural network and feature fusion

ZhouXuan. Video expression recognition method based on spatiotemporal recurrent neural network and feature fusion. J. Inf. Process. Syst. , 17(2): 337–351, 4 2021

2021
[285]

J. Zhu, Y. Zong, J. Shi, C. Lu, H. Chang, and W. Zheng. Learning to rank onset-occurring-offset representations for micro-expression recognition. arXiv preprint arXiv:2310.04664, 2023

2023 arXiv
[286]

pre-train-then-fine-tune

B. Zou, Y. Wang, X. Zhang, X. Lyu, and H. Ma. Concordance between facial micro-expressions and physiological signals under emotion elicitation. Pattern Recognit. Lett., 164:200–209, 2022. 9 NOMENCLATURE Here is the nomenclature of our work. Abbreviations Definitions AFEW The a...

2022

Pith tools

Reviewed August 11, 2026 · model on record in the stance chip above.

[1] [1]

N. A. Ab Razak and S. Sahran. Lightweight micro-expression recognition on composite database. Appl. Sci.-Basel, 13(3), 2023

2023

[2] [2]

Abdullah, M

M. Abdullah, M. Ahmad, and D. Han. Facial expression recognition in videos: An cnn-lstm based model for video classification. In Proc. Int. Conf. Electron. Inf. Commun., pages 1–3, 2020

2020

[3] [3]

Aifanti, C

N. Aifanti, C. Papachristou, and A. Delopoulos. The mug facial expression database. In Proc. Int. Workshop Image Anal. Multimedia Interact. Services , pages 1–4, 2010

2010

[4] [4]

M. A. H. Akhand, S. Roy, N. Siddique, M. A. S. Kamal, and T. Shimamura. Facial emotion recognition using transfer learning in the deep cnn. Electron., 10(9), 2021. ISSN 2079-9292

2021

[5] [5]

An and Z

F. An and Z. Liu. Facial expression recognition algorithm based on parameter adaptive initialization of cnn and lstm. Visual Comput., 36(3):483–498, 2020

2020

[6] [6]

An and R.-S

H.-Y. An and R.-S. Jia. Self-supervised facial expression recognition with fine-grained feature selection. Vis. Comput., pages 1–13, 2024

2024

[7] [7]

Aouayeb, W

M. Aouayeb, W. Hamidouche, C. Soladie, K. Kpalma, and R. Seguier. Learning vision transformer with squeeze and excitation for facial expression recognition. arXiv preprint arXiv:2107.03107, 2021

arXiv 2021

[8] [8]

C. C. Atabansi, T. Chen, R. Cao, and X. Xu. Transfer learning technique with vgg-16 for near-infrared facial expression recognition. J. Phys. Conf. Ser., 1873(1):012033, apr 2021

2021