Pith. sign in

REVIEW 5 major objections 5 minor 1 cited by

MoFM: A Large-Scale Human Motion Foundation Model

T0 review · 5 major / 5 minor · reviewed 2026-08-08 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read MoFM claims that human motion can be encoded as discrete tokens from spatio-temporal pose heatmaps, and that masked-token pretraining yields one backbone that handles action classification, one-shot learning, and anomaly detection with…

desk verdict A sensible keypoint-wise masking idea, but the foundation-model claim needs a from-scratch baseline and real pretraining statistics before it is credible. read the letter →

arxiv 2502.05432 v2 pith:GST2Z73X submitted 2025-02-08 cs.CV cs.LG

Mohammadreza Baharani , Ghazal Alinezhad Noghre , Armin Danesh Pazho , Gabriel Maldonado , Hamed Tabkhi This is my paper · ORCID
classification cs.CVcs.LG
keywords motionfoundationmodeldiscretevariationalautoencoderthermalcubesBookmaskedtokenmodelingskeletonactionrecognitionposeanomalydetectionself-supervisedpretraining
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

MoFM is an attempt to import the foundation-model recipe into human motion understanding: turn raw poses into discrete tokens, pretrain a transformer to reconstruct masked tokens, and then reuse the same backbone for many tasks. The paper builds MotionBook, a learned dictionary of 8192 motion tokens, by training a discrete variational encoder-decoder on spatio-temporal heatmaps called Thermal Cubes. The pretrained transformer is evaluated with only a fully-connected head on four tasks—action classification, one-shot action classification, self-supervised anomaly detection, and supervised anomaly detection—and reaches performance on par with many task-specific systems. The intended contribution is a task-agnostic motion backbone, not a new state-of-the-art result for any single benchmark. If the approach works as claimed, it offers a shared, scalable starting point for downstream motion applications without redesigning architectures per task.

What carries the argument

The central object is the Thermal Cube: a spatio-temporal patch of pose heatmaps, created by placing a Gaussian at each 2D joint per frame and max-pooling over all joints into the reduced map $U_R$. The dVED, a discrete variational encoder-decoder using Gumbel-Softmax, converts each cube into one of 8192 discrete tokens, forming the MotionBook vocabulary; the encoder acts as the tokenizer for the downstream transformer. The MoFM backbone is a 12-layer vision transformer with a spatio-temporal embedding layer, pretrained to predict masked token IDs under keypoint-wise masking (Algorithm 1), which targets cubes containing randomly sampled joints rather than random blocks. The machinery works by forcing the transformer to predict which motion tokens are hidden, thereby learning spatial and temporal regularities of human movement in a task-agnostic way.

What would settle it

Train the same MoFM pipeline but replace the max-pooled reconstruction target $U_R$ with the full joint-aware tensor $U$, or add per-joint channels, and compare on NTU-120 action classes where different joints move in different directions (e.g., fine-grained gesture pairs such as 'write' versus 'point to phone'). If the joint-agnostic version is clearly worse, the max-pooling is discarding joint identity that the foundation model needs.

Watch

Extended reading notes

Core claim

The paper's central claim is that a single pretrained motion transformer can serve as a foundation model for diverse human-motion tasks once poses are converted into a discrete token vocabulary. The conversion operates on spatio-temporal heatmaps built from 2D skeletons (Thermal Cubes); a Gumbel-Softmax discrete variational encoder-decoder learns the vocabulary, MoFM's dVED, and the resulting MotionBook tokens are used as targets for BERT-style masked prediction. Pretraining uses keypoint-wise masking rather than random block masking, because random blocks frequently cover regions with no skeleton and produce poor reconstructions. After pretraining, the transformer backbone plus a small task head achieves results on NTU-60/NTU-120 action recognition, one-shot action recognition, ShanghaiTech anomaly detection, and UBnormal supervised anomaly detection that are comparable to many purpose-built models. The paper presents MoFM as a flexible, task-agnostic foundation rather than as a competitor for state-of-the-art on any single benchmark.

Load-bearing premise

The motion tokens are learned from a max-pooled heatmap that averages away which joint produced each activation, so the vocabulary may not preserve joint identity; if a downstream task needs to distinguish, say, the left hand from the right hand, the backbone might be missing the necessary information.

Editorial extensions

If this is right

  • The same pretrained MoFM backbone, augmented with a fully-connected head, supports supervised fine-tuning, one-shot learning via supervised contrastive training, and self-supervised anomaly scoring through a token-level jigsaw objective.
  • Because the representation is built from pose heatmaps rather than pixels, it avoids background and appearance biases that affect RGB video models.
  • MotionBook provides discrete, interpretable tokens that are visualized across the vocabulary, analogous to words in a language model.
  • Keypoint-aware masking improves representation learning over blind blockwise masking by focusing the model on locations where motion actually occurs.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Because the dVED reconstructs only the max-pooled map $U_R$, joint identity is not directly encoded in the tokens; tasks that hinge on which joint moves (e.g., distinguishing left-hand from right-hand gestures) may expose this limitation, and a variant that preserves per-joint channels could be tested directly against MoFM.
  • The ghosting trails seen in dVED reconstructions indicate that tokens carry implicit velocity and direction information, suggesting the same discrete vocabulary could support future-frame prediction or motion forecasting as additional pretraining tasks.
  • The recipe should transfer to 3D skeletons, multi-person scenes, and RGB-derived heatmaps with minimal changes, which would expand MoFM beyond 2D single-person pose inputs.
  • A natural scaling study is to vary the pretraining corpus size and measure downstream task accuracy, since the reported pretraining uses only the CMU Panoptic dataset.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

5 major / 5 minor

Summary. MoFM proposes a motion foundation model pipeline: 2D skeleton sequences are converted into Gaussian spatio-temporal heatmaps, divided into Thermal Cubes, discretized into MotionBook tokens by a discrete variational encoder-decoder (dVED), and used for BERT-style masked self-supervised training of a vision transformer backbone. The pretrained backbone is then fine-tuned with simple fully connected heads on four downstream tasks: NTU-60/NTU-120 action recognition, NTU-120 one-shot action recognition, self-supervised anomaly detection on ShanghaiTech and HR-ShanghaiTech, and supervised anomaly detection on UBnormal. The paper claims that the resulting model is a task-agnostic foundation backbone supporting one-shot, unsupervised, and supervised paradigms. The supporting evidence consists mainly of downstream fine-tuning results; no from-scratch baseline, no pretraining-scale disclosure, and no ablations of the proposed masking or tokenization components are reported.

Significance. The intended contribution is potentially useful: a discrete motion vocabulary plus a shared backbone that transfers across several skeleton-based tasks would be a valuable resource for the community. The mathematical components (Gaussian heatmaps, Gumbel-Softmax approximation, ELBO objective) are standard and are described correctly, and the supplementary tables provide enough hyperparameters to reproduce the fine-tuning protocols. The qualitative dVED reconstruction and the explicit discussion of the ghosting effect around moving joints are also positive aspects. However, as it stands, the experimental evidence does not support the central 'foundation model' claim, because the transfer results are uncontrolled and the scale of pretraining is never quantified.

major comments (5)
  1. [Section 5, Tables 1-5; Supplementary Tables 6-9] The central claim is that the pretrained MoFM backbone transfers across diverse downstream tasks. All four downstream protocols fine-tune the full pretrained backbone plus a simple head, but the paper never compares against an identically architected backbone trained from scratch on each downstream task, nor against a randomly initialized backbone with the same head. Without such a control, the reported accuracies may be attributable to task-specific fine-tuning alone rather than to the pretrained representation. The claim is therefore not supported by the reported experiments. No error bars or significance testing are provided either, which makes the small differences against state-of-the-art methods even harder to interpret.
  2. [Sections 4.2-4.3] The paper repeatedly describes MoFM as 'large-scale' and 'trained on a large corpus of motion data,' but it never specifies the corpus used to pretrain the MoFM backbone. No dataset name, number of videos, number of frames, hours of motion, or number of training clips is given, and the token-level masking budget is also absent. The only pretraining data identified anywhere is CMU Panoptic, and that is described specifically for dVED training. If the backbone was also trained only on CMU Panoptic, the 'large-scale' claim is unsupported; if a different corpus was used, it must be disclosed. As written, the central scale claim is untestable.
  3. [Section 4.3, Algorithm 1] The keypoint-wise masking scheme is presented as a contribution, but no quantitative ablation compares it with the blockwise masking of [7], with random cube masking, or with different masking budgets. The paper states that blockwise masking 'reduced the loss error' but produced qualitatively inaccurate reconstructions; these qualitative observations need to be backed by quantitative results on a downstream task. Similarly, there is no ablation of the vocabulary size, the dVED tokenizer versus continuous input features, or the number of pretraining epochs. Without these ablations, the contribution of the self-supervised pretraining objective to the downstream numbers is unclear.
  4. [Section 5.2 and Table 3] The one-shot action recognition protocol is non-standard. The model is trained on an auxiliary set of 100 labeled samples per class with supervised contrastive learning, and evaluation uses 20 exemplars for each remaining class. This is not the conventional one-shot setting, which typically provides a single labeled example per novel class or uses episode-based N-way K-shot evaluation. The comparison with prior methods in Table 3 may therefore not be apples-to-apples. The protocol should be justified or replaced with a standard episodic evaluation before the one-shot claim can be accepted.
  5. [Section 4.1 and Eq. (5)] The dVED is trained to reconstruct only UR, which is obtained by max-pooling the joint-indexed heatmap U over the J joints, rather than reconstructing the full joint-aware tensor U. Because the discrete MotionBook tokens are learned under this joint-agnostic objective, the learned vocabulary may not preserve joint identity. This is potentially load-bearing for downstream tasks such as action recognition, where the identity of the joint matters. Please provide evidence that joint identity is preserved (for example, token prediction accuracy per joint, or an experiment with shuffled or permuted joint ordering), or change the dVED objective to reconstruct U.
minor comments (5)
  1. [Section 5.1] The text says the results are 'on par with or surpassing SOTA approaches,' but Tables 1 and 2 show MoFM-FC below the best prior methods on every split (for example, NTU-60 X-Sub 89.4 versus 93.1 for Duan et al., and NTU-120 X-Sub 78.0 versus 88.9 for Jang et al.). The wording should be aligned with the reported numbers.
  2. [Table 4] The entry for Zaheer et al. [110] reads '78-93', which appears to be a typo for a numeric value such as 78.93; please correct the formatting.
  3. [Supplementary Section 7.2] The heading contains a typo, 'Calssification', which should be 'Classification'.
  4. [Section 3 and Eq. (1)] The notation for indices is confusing: the pose skeleton is written as P = {Pi}_{i=0}^{F-1} as if i indexes frames, while the heatmap equation uses i for a spatial coordinate, j for a joint, and f for a frame. Please clarify the index conventions for frames, joints, and spatial coordinates.
  5. [References and Figure 4] Several references are duplicated under different numbers (e.g., [17]/[18], [80]/[81], [85]/[86], [104]/[105]), and some in-text citations point to the wrong duplicate; the bibliography should be unified. In addition, Figure 4 uses the term 'PoseBook' at the bottom, whereas the body text consistently uses 'MotionBook'; the terminology should be made consistent.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity found: the pretraining and downstream evaluation are externally grounded, and self-citations are not load-bearing.

full rationale

The paper's claimed chain is: (1) a dVED tokenizer is trained to reconstruct spatio-temporal heatmaps from CMU Panoptic data (Sec. 4.2); (2) the dVED encoder is frozen and used to tokenize thermal cubes, and a BERT-style masked-cube prediction task trains the MoFM backbone (Sec. 4.3); (3) the pretrained backbone is fine-tuned with simple linear heads on four external benchmarks, NTU RGB+D, NTU RGB+D-120, ShanghaiTech Campus, and UBnormal (Sec. 5). Each downstream evaluation uses held-out benchmark splits that are independent of the CMU Panoptic pretraining data, so none of the reported accuracies is forced by construction. No fitted parameter is renamed as a prediction: the dVED vocabulary is learned by reconstruction, the backbone is trained by masked token classification, and the downstream heads are trained on task-specific labels or proxy tasks. The only apparent self-references (e.g., [4], [5], [68], [69], [71]) are contextual citations to the authors' prior surveillance and anomaly-detection work; they do not justify any architectural choice, supply a uniqueness theorem, or exclude alternatives. The absence of a from-scratch baseline and the undisclosed size of the backbone pretraining corpus are legitimate evidence-quality concerns about how strong the transfer claim is, but they are not circularity. No equation in the paper is equivalent to another by definition, and the key design choices, such as max-pooling over joints before reconstruction, are stated assumptions rather than disguised inputs to the results. On the evidence quoted in the paper, the central claims are self-contained with respect to circularity.

Assumptions & free parameters 7 free parameters · 4 assumptions · 2 invented entities

The central claim rests on several untested domain assumptions: max-pooled heatmaps and a codebook learned from a single lab dataset capture general motion semantics, and fine-tuning with linear heads reflects the quality of the pretrained representation. The many undisclosed hyperparameters (sigma, beta, masking range, temperature schedule) make it difficult to assess whether the results are robust or tuned to the benchmarks.

free parameters (7)
  • sigma (Gaussian spread)
    Controls the spread of thermal energy around each joint in Eq. (1). Its value is not specified, yet it affects every heatmap and token.
  • Vocabulary size T = 8192
    Codebook size for MotionBook, chosen in Section 4.2. Not tuned per task or justified.
  • Codebook dimension D = 256
    Dimensionality of each vocabulary entry in Eq. (4). Set equal to the hidden dimension without further justification.
  • Beta (KL weight)
    Coefficient for the KL term in Eq. (5). Its value is not reported.
  • Heatmap resolution (H, W, F, D_S) = 72, 72, 48, 4
    Chosen in Section 4.1.1. These determine the number of tokens K=324 and the tokenizer input shape.
  • Masking range (min/max masked blocks)
    Parameters in Algorithm 1 are not quantified in the paper, though they directly control pretraining difficulty.
  • Gumbel-Softmax temperature schedule
    The text says tau is dynamically reduced during dVED training, but the schedule is not given.
assumptions (4)
  • domain assumption Max-pooling over joints preserves enough motion semantics for downstream tasks.
    Section 4.1 condenses U in R^{J x F x H x W} to UR in R^{F x H x W} via max over joints. The dVED reconstructs only UR, so joint identity may be lost.
  • domain assumption CMU Panoptic is a comprehensive source for learning a generalizable motion vocabulary and backbone.
    Section 4.2 states that the dVED is trained on CMU Panoptic. No scale, diversity, or domain analysis is provided to justify the 'large-scale' claim.
  • domain assumption Fine-tuning with a linear head on each downstream task is sufficient to validate the pretrained backbone.
    Section 5 uses an FC head for all tasks. Without a from-scratch baseline, improvements cannot be attributed to pretraining.
  • ad hoc to paper Keypoint-wise masking is superior to blockwise masking for motion pretraining.
    Section 4.3 claims blockwise masking failed qualitatively, but no quantitative ablation is provided.
invented entities (2)
  • MotionBook vocabulary
    purpose: Discrete codebook of 8192 motion tokens used to convert thermal cubes into transformer input.
    A learned artifact trained on CMU Panoptic. No external validation or downstream benefit isolated from other components.
  • Thermal Cubes
    purpose: Segmented spatio-temporal heatmap patches that serve as input to the dVED and transformer.
    A data representation, not a new physical entity, but named as a novel concept in the paper.

how reviews work

0 comments
Cite this review

Pith. "Pith review of MoFM: A Large-Scale Human Motion Foundation Model." pith.science (2026). https://pith.science/paper/GST2Z73X

@misc{pith2026250205432,
  author       = {Pith},
  title        = {Pith review of: MoFM: A Large-Scale Human Motion Foundation Model},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/GST2Z73X}},
  note         = {Machine review of arXiv:2502.05432}
}
read the original abstract

Foundation Models (FM) have increasingly drawn the attention of researchers due to their scalability and generalization across diverse tasks. Inspired by the success of FMs and the principles that have driven advancements in Large Language Models (LLMs), we introduce MoFM as a novel Motion Foundation Model. MoFM is designed for the semantic understanding of complex human motions in both time and space. To facilitate large-scale training, MotionBook, a comprehensive human motion dictionary of discretized motions is designed and employed. MotionBook utilizes Thermal Cubes to capture spatio-temporal motion heatmaps, applying principles from discrete variational models to encode human movements into discrete units for a more efficient and scalable representation. MoFM, trained on a large corpus of motion data, provides a foundational backbone adaptable to diverse downstream tasks, supporting paradigms such as one-shot, unsupervised, and supervised tasks. This versatility makes MoFM well-suited for a wide range of motion-based applications.

Figures

Figures reproduced from arXiv: 2502.05432 by the authors.

Figure 1
Figure 1. Visualization of videos with corresponding pose tokens normalized by vocabulary size. Each row shows skeletal motion frames [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Architecture of the proposed custom dVED encoder and [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 3
Figure 3. Comparison of heatmap skeletons: (a) Ground truth heatmap skeleton used as input for dVED; (b) Reconstructed heatmap [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figures from the paper (1 more)
Figure 4
Figure 4. Figure 4: Overview of Motion Foundation Model (MoFM). Poses are converted into heatmap representations using a Gaussian function [PITH_FULL_IMAGE:figures/full_fig_p005_4.png]

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. MoCLIP: Motion-Aware Fine-Tuning and Distillation of CLIP for Human Motion Generation

    cs.CV 2025-05 conditional novelty 6.0 of 10

    MoCLIP fine-tunes CLIP's text encoder on motion-text pairs using contrastive learning and a distillation loss, and swapping it into MoMask and BAMM improves R-Precision by about 1 to 2 percent while FID stays roughly ...

Reference graph

Works this paper leans on

120 extracted references · 75 canonical work pages · cited by 1 Pith paper

  1. [7]

    BEit: BERT pre-training of image transformers

    Hangbo Bao, Li Dong, Songhao Piao, and Furu Wei. BEit: BERT pre-training of image transformers. In International Conference on Learning Representations, 2022. 3, 6

    2022

  2. [1]

    Latent space autoregression for novelty detec- tion

    Davide Abati, Angelo Porrello, Simone Calderara, and Rita Cucchiara. Latent space autoregression for novelty detec- tion. In Proceedings of the IEEE/CVF conference on com- puter vision and pattern recognition, pages 481–490, 2019. 8

    2019

  3. [2]

    Ub- normal: New benchmark for supervised open-set video anomaly detection

    Andra Acsintoae, Andrei Florescu, Mariana-Iuliana Georgescu, Tudor Mare, Paul Sumedrea, Radu Tudor Ionescu, Fahad Shahbaz Khan, and Mubarak Shah. Ub- normal: New benchmark for supervised open-set video anomaly detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022. 8, 1

    2022

  4. [3]

    Star-transformer: A spatio-temporal cross at- tention transformer for human action recognition

    Dasom Ahn, Sangwon Kim, Hyunsu Hong, and Byoung Chul Ko. Star-transformer: A spatio-temporal cross at- tention transformer for human action recognition. In 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pages 3319–3328, 2023. 2

    2023

  5. [4]

    Understanding the chal- lenges and opportunities of pose-based anomaly detec- tion

    Ghazal Alinezhad Noghre, Armin Danesh Pazho, Vinit Katariya, and Hamed Tabkhi. Understanding the chal- lenges and opportunities of pose-based anomaly detec- tion. In Proceedings of the 8th international Workshop on Sensor-Based Activity Recognition and Artificial Intel- ligence, pages 1–9, 2023. 2

    2023

  6. [5]

    Understanding policy and technical aspects of ai-enabled smart video surveillance to address public safety

    Babak Rahimi Ardabili, Armin Danesh Pazho, Ghazal Alinezhad Noghre, Christopher Neff, Sai Datta Bhaskararayuni, Arun Ravindran, Shannon Reid, and Hamed Tabkhi. Understanding policy and technical aspects of ai-enabled smart video surveillance to address public safety. Computational Urban Science, 3(1):21, 2023. 2

    2023

  7. [6]

    BEiT: BERT pre- training of image transformers

    Hangbo Bao, Li Dong, and Furu Wei. BEiT: BERT pre- training of image transformers. InInternational Conference on Learning Representations, 2021. 3

    2021

  8. [8]

    Is space-time attention all you need for video understanding? In ICML, page 4, 2021

    Gedas Bertasius, Heng Wang, and Lorenzo Torresani. Is space-time attention all you need for video understanding? In ICML, page 4, 2021. 2, 8

    2021

Show all 120 references
  1. [9]

    Dvae: deep variational auto-encoders for denoising retinal fundus image

    Biswajit Biswas, Swarup Kr Ghosh, and Anupam Ghosh. Dvae: deep variational auto-encoders for denoising retinal fundus image. Hybrid machine intelligence for medical im- age analysis, pages 257–273, 2020. 2

    2020

  2. [10]

    Language models are few-shot learners

    Tom B Brown. Language models are few-shot learners. arXiv preprint arXiv:2005.14165, 2020. 2, 3

    2005 arXiv

  3. [11]

    Caetano, F

    C. Caetano, F. Bremond, and W. Schwartz. Skeleton image representation for 3d action recognition based on tree struc- ture and reference joints. In 2019 32nd SIBGRAPI Confer- ence on Graphics, Patterns and Images (SIBGRAPI), pages 16–23, Los Alamitos, CA, USA, 2019. IEEE Compu...

    2019

  4. [12]

    Chen et al

    K. Chen et al. InternVL: Vision-language pretraining with large-scale data. arXiv preprint arXiv:2201.00000, 2022. 3

    2022

  5. [13]

    Multiscale spatial tempo- ral attention graph convolution network for skeleton-based anomaly behavior detection

    Xiaoyu Chen, Shichao Kan, Fanghui Zhang, Yigang Cen, Linna Zhang, and Damin Zhang. Multiscale spatial tempo- ral attention graph convolution network for skeleton-based anomaly behavior detection. Journal of Visual Communi- cation and Image Representation, 90:103707, 2023. 8

    2023

  6. [14]

    Multi-scale spatial temporal graph convolutional net- work for skeleton-based action recognition

    Zhan Chen, Sicheng Li, Bing Yang, Qinghan Li, and Hong Liu. Multi-scale spatial temporal graph convolutional net- work for skeleton-based action recognition. In Proceed- ings of the AAAI conference on artificial intelligence, pages 1113–1122, 2021. 6, 8

    2021

  7. [15]

    Internvl: Scaling up vision founda- tion models and aligning for generic visual-linguistic tasks

    Zhe Chen, Jiannan Wu, Wenhai Wang, Weijie Su, Guo Chen, Sen Xing, Muyan Zhong, Qinglong Zhang, Xizhou Zhu, Lewei Lu, et al. Internvl: Scaling up vision founda- tion models and aligning for generic visual-linguistic tasks. In Proceedings of the IEEE/CVF Conference on Computer V...

    2024

  8. [16]

    Higherhrnet: Scale- aware representation learning for bottom-up human pose estimation

    Bowen Cheng, Bin Xiao, Jingdong Wang, Honghui Shi, Thomas S Huang, and Lei Zhang. Higherhrnet: Scale- aware representation learning for bottom-up human pose estimation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5386–5395,

  9. [17]

    Skeleton-based action recognition with shift graph convolutional network

    Ke Cheng, Yifan Zhang, Xiangyu He, Weihan Chen, Jian Cheng, and Hanqing Lu. Skeleton-based action recognition with shift graph convolutional network. In2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 180–189, 2020. 6, 8

    2020

  10. [18]

    Skeleton-based action recognition with shift graph convolutional network

    Ke Cheng, Yifan Zhang, Xiangyu He, Weihan Chen, Jian Cheng, and Hanqing Lu. Skeleton-based action recognition with shift graph convolutional network. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 183–192, 2020. 8

    2020

  11. [19]

    Self-attention network for skeleton-based human action recognition

    Sangwoo Cho, Muhammad Maqbool, Fei Liu, and Hassan Foroosh. Self-attention network for skeleton-based human action recognition. In Proceedings of the IEEE/CVF winter conference on applications of computer vision, pages 635– 644, 2020. 6 9

    2020

  12. [20]

    K2: A foundation lan- guage model for geoscience knowledge understanding and utilization

    Cheng Deng, Tianhang Zhang, Zhongmou He, Qiyuan Chen, Yuanyuan Shi, Yi Xu, Luoyi Fu, Weinan Zhang, Xin- bing Wang, Chenghu Zhou, et al. K2: A foundation lan- guage model for geoscience knowledge understanding and utilization. In Proceedings of the 17th ACM International Confer...

    2024

  13. [21]

    Bert: Pre-training of deep bidirectional trans- formers for language understanding

    Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. Bert: Pre-training of deep bidirectional trans- formers for language understanding. In North American Chapter of the Association for Computational Linguistics ,

  14. [22]

    An im- age is worth 16x16 words: Transformers for image recog- nition at scale

    Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, and Neil Houlsby. An im- age is worth 16x16 words: Transformers for image recog- nitio...

    2021

  15. [23]

    Revisiting skeleton-based action recognition

    Haodong Duan, Yue Zhao, Kai Chen, Dahua Lin, and Bo Dai. Revisiting skeleton-based action recognition. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 2959–2968, 2022. 2, 6

    2022

  16. [24]

    Artificial intelligence (ai)-aided computer vision (cv) in healthcare system

    Ushaa Eswaran and Alex Khang. Artificial intelligence (ai)-aided computer vision (cv) in healthcare system. In Computer Vision and AI-Integrated IoT Technologies in the Medical Ecosystem, pages 125–137. CRC Press, 2024. 2

    2024

  17. [25]

    Al- phapose: Whole-body regional multi-person pose estima- tion and tracking in real-time

    Hao-Shu Fang, Jiefeng Li, Hongyang Tang, Chao Xu, Haoyi Zhu, Yuliang Xiu, Yong-Lu Li, and Cewu Lu. Al- phapose: Whole-body regional multi-person pose estima- tion and tracking in real-time. IEEE Transactions on Pat- tern Analysis and Machine Intelligence , 45(6):7157–7173,

  18. [26]

    Diffpose: Spatiotemporal dif- fusion model for video-based human pose estimation

    Runyang Feng, Yixing Gao, Tze Ho Elden Tse, Xueqing Ma, and Hyung Jin Chang. Diffpose: Spatiotemporal dif- fusion model for video-based human pose estimation. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 14861–14872, 2023. 2

    2023

  19. [27]

    Focusing fine-grained action by self-attention- enhanced graph neural networks with contrastive learning

    Pei Geng, Xuequan Lu, Chunyu Hu, Hong Liu, and Lei Lyu. Focusing fine-grained action by self-attention- enhanced graph neural networks with contrastive learning. IEEE Transactions on Circuits and Systems for Video Tech- nology, 33(9):4754–4768, 2023. 2

    2023

  20. [28]

    A background-agnostic framework with adversarial train- ing for abnormal event detection in video

    Mariana Iuliana Georgescu, Radu Tudor Ionescu, Fa- had Shahbaz Khan, Marius Popescu, and Mubarak Shah. A background-agnostic framework with adversarial train- ing for abnormal event detection in video. IEEE transac- tions on pattern analysis and machine intelligence , 44(9): 4...

    2021

  21. [29]

    Learning tempo- ral regularity in video sequences

    Mahmudul Hasan, Jonghyun Choi, Jan Neumann, Amit K Roy-Chowdhury, and Larry S Davis. Learning tempo- ral regularity in video sequences. In Proceedings of the IEEE conference on computer vision and pattern recogni- tion, pages 733–742, 2016. 8

    2016

  22. [30]

    Normalizing flows for human pose anomaly detection

    Or Hirschorn and Shai Avidan. Normalizing flows for human pose anomaly detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision , pages 13545–13554, 2023. 2, 7, 8

    2023

  23. [31]

    Hierarchical graph em- bedded pose regularity learning via spatio-temporal trans- former for abnormal behavior detection

    Chao Huang, Yabo Liu, Zheng Zhang, Chengliang Liu, Jie Wen, Yong Xu, and Yaowei Wang. Hierarchical graph em- bedded pose regularity learning via spatio-temporal trans- former for abnormal behavior detection. In Proceedings of the 30th ACM international conference on multimedia...

    2022

  24. [32]

    Posecvae: Anomalous human activity detection

    Yashswi Jain, Ashvini Kumar Sharma, Rajbabu Velmuru- gan, and Biplab Banerjee. Posecvae: Anomalous human activity detection. In 2020 25th International Conference on Pattern Recognition (ICPR) , pages 2927–2934. IEEE,

    2020

  25. [33]

    Categorical repa- rameterization with gumbel-softmax

    Eric Jang, Shixiang Gu, and Ben Poole. Categorical repa- rameterization with gumbel-softmax. In International Con- ference on Learning Representations, 2017. 3, 4

    2017

  26. [34]

    Multi-scale struc- tural graph convolutional network for skeleton-based action recognition

    Sungjun Jang, Heansung Lee, Woo Jin Kim, Jungho Lee, Sungmin Woo, and Sangyoun Lee. Multi-scale struc- tural graph convolutional network for skeleton-based action recognition. IEEE Transactions on Circuits and Systems for Video Technology, 2024. 6, 8

    2024

  27. [35]

    Learning clip representa- tions for skeleton-based 3d action recognition.IEEE Trans- actions on Image Processing, 27(6):2842–2855, 2018

    Qiuhong Ke, Mohammed Bennamoun, Senjian An, Fer- dous Sohel, and Farid Boussaid. Learning clip representa- tions for skeleton-based 3d action recognition.IEEE Trans- actions on Image Processing, 27(6):2842–2855, 2018. 8

    2018

  28. [36]

    Bert: Pre-training of deep bidirectional trans- formers for language understanding

    Jacob Devlin Ming-Wei Chang Kenton and Lee Kristina Toutanova. Bert: Pre-training of deep bidirectional trans- formers for language understanding. In Proceedings of naacL-HLT, page 2. Minneapolis, Minnesota, 2019. 2

    2019

  29. [37]

    Application of computer vision (cv) in the health- care ecosystem

    Alex Khang, Vugar Abdullayev, Eugenia Litvinova, Svet- lana Chumachenko, Abuzarova Vusala Alyar, and PTN Anh. Application of computer vision (cv) in the health- care ecosystem. In Computer Vision and AI-Integrated IoT Technologies in the Medical Ecosystem, pages 1–16. CRC Pres...

    2024

  30. [38]

    Supervised contrastive learning

    Prannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna, Yonglong Tian, Phillip Isola, Aaron Maschinot, Ce Liu, and Dilip Krishnan. Supervised contrastive learning. Advances in neural information processing systems , 33: 18661–18673, 2020. 6, 1

    2020

  31. [39]

    Berg, et al

    Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Paul Rolland, Laura Gustafson, Tete Xiao, Spencer White- head, Alexander C. Berg, et al. Segment anything. arXiv preprint arXiv:2304.02643, 2023. 3

    2023 arXiv

  32. [40]

    Self-supervised learning of 3d human pose using multi- view geometry

    Muhammed Kocabas, Salih Karagoz, and Emre Akbas. Self-supervised learning of 3d human pose using multi- view geometry. In Proceedings of the IEEE/CVF confer- ence on computer vision and pattern recognition , pages 1077–1086, 2019. 2

    2019

  33. [41]

    Crowdpose: Efficient crowded scenes pose estimation and a new benchmark

    Jiefeng Li, Can Wang, Hao Zhu, Yihuan Mao, Hao-Shu Fang, and Cewu Lu. Crowdpose: Efficient crowded scenes pose estimation and a new benchmark. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10863–10872, 2019. 7

    2019

  34. [42]

    3d human action rep- resentation learning via cross-view consistency pursuit

    Linguo Li, Minsi Wang, Bingbing Ni, Hang Wang, Jiancheng Yang, and Wenjun Zhang. 3d human action rep- resentation learning via cross-view consistency pursuit. In 2021 IEEE/CVF Conference on Computer Vision and Pat- tern Recognition (CVPR), pages 4739–4748, 2021. 6 10

    2021

  35. [43]

    Actional-structural graph convolutional networks for skeleton-based action recognition

    Maosen Li, Siheng Chen, Xu Chen, Ya Zhang, Yanfeng Wang, and Qi Tian. Actional-structural graph convolutional networks for skeleton-based action recognition. In Pro- ceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 3595–3603, 2019. 6, 8

    2019

  36. [44]

    Independently recurrent neural network (indrnn): Building a longer and deeper rnn

    Shuai Li, Wanqing Li, Chris Cook, Ce Zhu, and Yanbo Gao. Independently recurrent neural network (indrnn): Building a longer and deeper rnn. In Proceedings of the IEEE con- ference on computer vision and pattern recognition , pages 5457–5466, 2018. 6

    2018

  37. [45]

    K. Lin, L. Wang, and Z. Liu. Mesh graphormer. In 2021 IEEE/CVF International Conference on Computer Vi- sion (ICCV), pages 12919–12928, Los Alamitos, CA, USA,

    2021

  38. [46]

    Spatio-temporal lstm with trust gates for 3d human action recognition

    Jun Liu, Amir Shahroudy, Dong Xu, and Gang Wang. Spatio-temporal lstm with trust gates for 3d human action recognition. In Computer Vision–ECCV 2016: 14th Eu- ropean Conference, Amsterdam, The Netherlands, Octo- ber 11-14, 2016, Proceedings, Part III 14, pages 816–833. Springe...

    2016

  39. [47]

    Skeleton-based action recognition using spatio- temporal lstm network with trust gates

    Jun Liu, Amir Shahroudy, Dong Xu, Alex C Kot, and Gang Wang. Skeleton-based action recognition using spatio- temporal lstm network with trust gates. IEEE transactions on pattern analysis and machine intelligence, 40(12):3007– 3021, 2017. 8

    2017

  40. [48]

    Jun Liu, Gang Wang, Ping Hu, Ling-Yu Duan, and Alex C. Kot. Global context-aware attention lstm networks for 3d action recognition. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 3671–3680,

    2017

  41. [49]

    Global context-aware attention lstm networks for 3d action recognition

    Jun Liu, Gang Wang, Ping Hu, Ling-Yu Duan, and Alex C Kot. Global context-aware attention lstm networks for 3d action recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition , pages 1647– 1656, 2017. 8

    2017

  42. [50]

    Ntu rgb+ d 120: A large-scale benchmark for 3d human activity understand- ing

    Jun Liu, Amir Shahroudy, Mauricio Perez, Gang Wang, Ling-Yu Duan, and Alex C Kot. Ntu rgb+ d 120: A large-scale benchmark for 3d human activity understand- ing. IEEE transactions on pattern analysis and machine intelligence, 42(10):2684–2701, 2019. 8

    2019

  43. [51]

    Jun Liu, Amir Shahroudy, Mauricio Perez, Gang Wang, Ling-Yu Duan, and Alex C. Kot. Ntu rgb+d 120: A large-scale benchmark for 3d human activity understand- ing. IEEE Trans. Pattern Anal. Mach. Intell. , 42(10): 2684–2701, 2020. 6, 8, 1

    2020

  44. [52]

    Future frame prediction for anomaly detection – a new baseline

    Wen Liu, Weixin Luo, Dongze Lian, and Shenghua Gao. Future frame prediction for anomaly detection – a new baseline. In Proceedings of the IEEE Conference on Com- puter Vision and Pattern Recognition (CVPR), 2018. 8

    2018

  45. [53]

    Future frame prediction for anomaly detection–a new base- line

    Wen Liu, Weixin Luo, Dongze Lian, and Shenghua Gao. Future frame prediction for anomaly detection–a new base- line. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 6536–6545, 2018. 7, 8, 1

    2018

  46. [54]

    General- ized video anomaly event detection: Systematic taxonomy and comparison of deep models

    Yang Liu, Dingkang Yang, Yan Wang, Jing Liu, Jun Liu, Azzedine Boukerche, Peng Sun, and Liang Song. General- ized video anomaly event detection: Systematic taxonomy and comparison of deep models. 56(7), 2024. 7

    2024

  47. [55]

    Disentangling and unifying graph convolutions for skeleton-based action recognition

    Ziyu Liu, Hongwen Zhang, Zhenghao Chen, Zhiyong Wang, and Wanli Ouyang. Disentangling and unifying graph convolutions for skeleton-based action recognition. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 140–149, 2020. 6, 8

    2020

  48. [56]

    Disentangling and unifying graph convolutions for skeleton-based action recognition

    Ziyu Liu, Hongwen Zhang, Zhenghao Chen, Zhiyong Wang, and Wanli Ouyang. Disentangling and unifying graph convolutions for skeleton-based action recognition. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 143–152, 2020. 8

    2020

  49. [57]

    Computer vision-based bridge inspection and monitoring: A review

    Kui Luo, Xuan Kong, Jie Zhang, Jiexuan Hu, Jinzhao Li, and Hao Tang. Computer vision-based bridge inspection and monitoring: A review. Sensors, 23(18):7863, 2023. 2

    2023

  50. [58]

    A revisit of sparse coding based anomaly detection in stacked rnn framework

    Weixin Luo, Wen Liu, and Shenghua Gao. A revisit of sparse coding based anomaly detection in stacked rnn framework. In Proceedings of the IEEE International Con- ference on Computer Vision (ICCV), 2017. 8

    2017

  51. [59]

    Rethinking the heatmap regression for bottom-up human pose estimation

    Zhengxiong Luo, Zhicheng Wang, Yan Huang, Liang Wang, Tieniu Tan, and Erjin Zhou. Rethinking the heatmap regression for bottom-up human pose estimation. In Pro- ceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 13264–13273, 2021. 2

    2021

  52. [60]

    Zixian Ma, Jerry Hong, Mustafa Omer Gul, Mona Gandhi, Irena Gao, and Ranjay Krishna. Crepe: Can vision- language foundation models reason compositionally? In Proceedings of the IEEE/CVF Conference on Computer Vi- sion and Pattern Recognition , pages 10910–10921, 2023. 2

    2023

  53. [61]

    Graph embedded pose clustering for anomaly detection

    Amir Markovitz, Gilad Sharir, Itamar Friedman, Lihi Zelnik-Manor, and Shai Avidan. Graph embedded pose clustering for anomaly detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10539–10547, 2020. 7, 8

    2020

  54. [62]

    Sl-dml: Signal level deep metric learning for mul- timodal one-shot action recognition

    Raphael Memmesheimer, Nick Theisen, and Dietrich Paulus. Sl-dml: Signal level deep metric learning for mul- timodal one-shot action recognition. In 2020 25th Inter- national conference on pattern recognition (ICPR) , pages 4573–4580. IEEE, 2021. 8

    2020

  55. [63]

    Skeleton-dml: Deep metric learning for skeleton-based one-shot action recognition

    Raphael Memmesheimer, Simon H ¨aring, Nick Theisen, and Dietrich Paulus. Skeleton-dml: Deep metric learning for skeleton-based one-shot action recognition. In Proceed- ings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 3702–3710, 2022. 8

    2022

  56. [64]

    A central difference graph convolu- tional operator for skeleton-based action recognition

    Shuangyan Miao, Yonghong Hou, Zhimin Gao, Mingliang Xu, and Wanqing Li. A central difference graph convolu- tional operator for skeleton-based action recognition. IEEE Transactions on Circuits and Systems for Video Technology, 32(7):4893–4899, 2021. 6, 8

    2021

  57. [65]

    Learning regular- ity in skeleton trajectories for anomaly detection in videos

    Romero Morais, Vuong Le, Truyen Tran, Budhaditya Saha, Moussa Mansour, and Svetha Venkatesh. Learning regular- ity in skeleton trajectories for anomaly detection in videos. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 11996–12004,...

    2019

  58. [66]

    Foundation 11 and large language models: fundamentals, challenges, opportunities, and social impacts

    Devon Myers, Rami Mohawesh, Venkata Ishwarya Chellaboina, Anantha Lakshmi Sathvik, Praveen Venkatesh, Yi-Hui Ho, Hanna Henshaw, Muna Al- hawawreh, David Berdik, and Yaser Jararweh. Foundation 11 and large language models: fundamentals, challenges, opportunities, and social imp...

    2024

  59. [67]

    Re- vamp 2 t: real-time edge video analytics for multicamera privacy-aware pedestrian tracking

    Christopher Neff, Mat ´ıas Mendieta, Shrey Mohan, Moham- madreza Baharani, Samuel Rogers, and Hamed Tabkhi. Re- vamp 2 t: real-time edge video analytics for multicamera privacy-aware pedestrian tracking. IEEE Internet of Things Journal, 7(4):2591–2602, 2019. 2

    2019

  60. [68]

    An exploratory study on human-centric video anomaly detection through variational autoencoders and trajectory prediction

    Ghazal Alinezhad Noghre, Armin Danesh Pazho, and Hamed Tabkhi. An exploratory study on human-centric video anomaly detection through variational autoencoders and trajectory prediction. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) W...

    2024

  61. [69]

    An exploratory study on human-centric video anomaly detection through variational autoencoders and trajectory prediction

    Ghazal Alinezhad Noghre, Armin Danesh Pazho, and Hamed Tabkhi. An exploratory study on human-centric video anomaly detection through variational autoencoders and trajectory prediction. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision , pages ...

    2024

  62. [70]

    Ordinal depth supervision for 3d human pose estimation

    Georgios Pavlakos, Xiaowei Zhou, and Kostas Daniilidis. Ordinal depth supervision for 3d human pose estimation. In 2018 IEEE/CVF Conference on Computer Vision and Pat- tern Recognition, pages 7307–7316, 2018. 2

    2018

  63. [71]

    Ancilia: Scalable intelligent video surveillance for the artificial intelligence of things

    Armin Danesh Pazho, Christopher Neff, Ghazal Alinezhad Noghre, Babak Rahimi Ardabili, Shanle Yao, Moham- madreza Baharani, and Hamed Tabkhi. Ancilia: Scalable intelligent video surveillance for the artificial intelligence of things. IEEE Internet of Things Journal, 10(17):1494...

    2023

  64. [72]

    Zero-shot text-to-image generation

    Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea V oss, Alec Radford, Mark Chen, and Ilya Sutskever. Zero-shot text-to-image generation. In Pro- ceedings of the 38th International Conference on Machine Learning, pages 8821–8831. PMLR, 2021. 3, 4

    2021

  65. [73]

    Fine-tuned clip models are efficient video learners

    Hanoona Rasheed, Muhammad Uzair Khattak, Muhammad Maaz, Salman Khan, and Fahad Shahbaz Khan. Fine-tuned clip models are efficient video learners. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6545–6554, 2023. 2

    2023

  66. [74]

    Curran Associates Inc., Red Hook, NY , USA, 2019

    Ali Razavi, A ¨aron van den Oord, and Oriol Vinyals.Gener- ating diverse high-fidelity images with VQ-VAE-2 . Curran Associates Inc., Red Hook, NY , USA, 2019. 3

    2019

  67. [75]

    Multi-timescale trajectory predic- tion for abnormal human activity detection

    Royston Rodrigues, Neha Bhargava, Rajbabu Velmurugan, and Subhasis Chaudhuri. Multi-timescale trajectory predic- tion for abnormal human activity detection. In Proceedings of the IEEE/CVF winter conference on applications of com- puter vision, pages 2626–2634, 2020. 7, 8

    2020

  68. [76]

    One- shot action recognition in challenging therapy scenarios

    Alberto Sabater, Laura Santos, Jose Santos-Victor, Alexan- dre Bernardino, Luis Montesano, and Ana C Murillo. One- shot action recognition in challenging therapy scenarios. In Proceedings of the IEEE/CVF conference on computer vi- sion and pattern recognition, pages 2777–2785, 2021. 8

    2021

  69. [77]

    Arras, and Bastian Leibe

    Istv ´an S ´ar´andi, Timm Linder, Kai O. Arras, and Bastian Leibe. MeTRAbs: metric-scale truncation-robust heatmaps for absolute 3D human pose estimation. IEEE Transactions on Biometrics, Behavior, and Identity Science, 3(1):16–30,

  70. [78]

    Shahroudy, J

    A. Shahroudy, J. Liu, T. Ng, and G. Wang. Ntu rgb+d: A large scale dataset for 3d human activity analysis. In 2016 IEEE Conference on Computer Vision and Pattern Recog- nition (CVPR), pages 1010–1019, Los Alamitos, CA, USA,

    2016

  71. [79]

    Skeleton-based action recognition with directed graph neu- ral networks

    Lei Shi, Yifan Zhang, Jian Cheng, and Hanqing Lu. Skeleton-based action recognition with directed graph neu- ral networks. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 7912– 7921, 2019. 6

    2019

  72. [80]

    Two- stream adaptive graph convolutional networks for skeleton- based action recognition

    Lei Shi, Yifan Zhang, Jian Cheng, and Hanqing Lu. Two- stream adaptive graph convolutional networks for skeleton- based action recognition. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 12026–12035, 2019. 2, 6, 8

    2019

  73. [81]

    L. Shi, Y . Zhang, J. Cheng, and H. Lu. Two-stream adap- tive graph convolutional networks for skeleton-based action recognition. In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pages 12018– 12027, Los Alamitos, CA, USA, 2019. IEEE Computer So- ciety. 6

    2019

  74. [82]

    Richly activated graph convolutional network for robust skeleton-based action recognition

    Yi-Fan Song, Zhang Zhang, Caifeng Shan, and Liang Wang. Richly activated graph convolutional network for robust skeleton-based action recognition. IEEE Transac- tions on Circuits and Systems for Video Technology, 31(5): 1915–1925, 2020. 6, 8

    1915

  75. [83]

    Interpretable 3d human ac- tion analysis with temporal convolutional networks

    Tae Soo Kim and Austin Reiter. Interpretable 3d human ac- tion analysis with temporal convolutional networks. InPro- ceedings of the IEEE conference on computer vision and pattern recognition workshops, pages 20–28, 2017. 6

    2017

  76. [84]

    Self- supervised 3d skeleton action representation learning with motion consistency and continuity

    Yukun Su, Guosheng Lin, and Qingyao Wu. Self- supervised 3d skeleton action representation learning with motion consistency and continuity. In 2021 IEEE/CVF In- ternational Conference on Computer Vision (ICCV), pages 13308–13318, 2021. 6

    2021

  77. [85]

    Deep high-resolution representation learning for human pose es- timation

    Ke Sun, Bin Xiao, Dong Liu, and Jingdong Wang. Deep high-resolution representation learning for human pose es- timation. In 2019 IEEE/CVF Conference on Computer Vi- sion and Pattern Recognition (CVPR) , pages 5686–5696,

    2019

  78. [86]

    Deep high-resolution representation learning for human pose es- timation

    Ke Sun, Bin Xiao, Dong Liu, and Jingdong Wang. Deep high-resolution representation learning for human pose es- timation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5693–5703,

  79. [87]

    Dvae#: Discrete variational autoencoders with relaxed boltzmann priors

    Arash Vahdat, Evgeny Andriyash, and William Macready. Dvae#: Discrete variational autoencoders with relaxed boltzmann priors. Advances in Neural Information Process- ing Systems, 31, 2018. 2

    2018

  80. [88]

    Dvae++: Discrete variational autoencoders with overlapping transformations

    Arash Vahdat, William Macready, Zhengbing Bian, Amir Khoshaman, and Evgeny Andriyash. Dvae++: Discrete variational autoencoders with overlapping transformations. In International conference on machine learning , pages 5035–5044. PMLR, 2018. 2

    2018

  81. [89]

    Neural discrete representation learning

    Aaron van den Oord, Oriol Vinyals, and Koray Kavukcuoglu. Neural discrete representation learning. In Proceedings of the 31st International Conference on 12 Neural Information Processing Systems , page 6309–6318, Red Hook, NY , USA, 2017. Curran Associates Inc. 3

    2017

  82. [90]

    Gomez, Łukasz Kaiser, and Illia Polosukhin

    Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. In Proceed- ings of the 31st International Conference on Neural Infor- mation Processing Systems , page 6000–6010, Red Hook,...

    2017

  83. [91]

    Gomez, Łukasz Kaiser, and Illia Polosukhin

    Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. In Ad- vances in Neural Information Processing Systems , pages 5998–6008, 2017. 3

    2017

  84. [92]

    Human action recognition by representing 3d skeletons as points in a lie group

    Raviteja Vemulapalli, Felipe Arrate, and Rama Chellappa. Human action recognition by representing 3d skeletons as points in a lie group. In Proceedings of the IEEE con- ference on computer vision and pattern recognition , pages 588–595, 2014. 6

    2014

  85. [93]

    Video anomaly detec- tion by solving decoupled spatio-temporal jigsaw puzzles

    Guodong Wang, Yunhong Wang, Jie Qin, Dongming Zhang, Xiuguo Bao, and Di Huang. Video anomaly detec- tion by solving decoupled spatio-temporal jigsaw puzzles. In Computer Vision – ECCV 2022, pages 494–511, Cham,

    2022

  86. [94]

    Sam-clip: Merging vision foundation models towards semantic and spatial understanding

    Haoxiang Wang, Pavan Kumar Anasosalu Vasu, Fartash Faghri, Raviteja Vemulapalli, Mehrdad Farajtabar, Sachin Mehta, Mohammad Rastegari, Oncel Tuzel, and Hadi Pouransari. Sam-clip: Merging vision foundation models towards semantic and spatial understanding. In Proceed- ings of t...

    2024

  87. [95]

    Temporal-viewpoint trans- portation plan for skeletal few-shot action recognition

    Lei Wang and Piotr Koniusz. Temporal-viewpoint trans- portation plan for skeletal few-shot action recognition. In Proceedings of the Asian Conference on Computer Vision , pages 4176–4193, 2022. 8

    2022

  88. [96]

    Uncertainty-dtw for time se- ries and sequences

    Lei Wang and Piotr Koniusz. Uncertainty-dtw for time se- ries and sequences. In European Conference on Computer Vision, pages 176–195. Springer, 2022. 8

    2022

  89. [97]

    Memory-augmented appearance-motion net- work for video anomaly detection

    Le Wang, Junwen Tian, Sanping Zhou, Haoyue Shi, and Gang Hua. Memory-augmented appearance-motion net- work for video anomaly detection. Pattern Recognition, 138:109335, 2023. 2, 8

    2023

  90. [98]

    Internimage: Exploring large-scale vi- sion foundation models with deformable convolutions

    Wenhai Wang, Jifeng Dai, Zhe Chen, Zhenhang Huang, Zhiqi Li, Xizhou Zhu, Xiaowei Hu, Tong Lu, Lewei Lu, Hongsheng Li, et al. Internimage: Exploring large-scale vi- sion foundation models with deformable convolutions. In Proceedings of the IEEE/CVF conference on computer vi- si...

    2023

  91. [99]

    Probabilistic monocular 3d human pose estimation with normalizing flows

    Tom Wehrbein, Marco Rudolph, Bodo Rosenhahn, and Bastian Wandt. Probabilistic monocular 3d human pose estimation with normalizing flows. In 2021 IEEE/CVF In- ternational Conference on Computer Vision (ICCV), pages 11179–11188, 2021. 2

    2021

  92. [100]

    Graph2net: Perceptually-enriched graph learning for skeleton-based ac- tion recognition

    Cong Wu, Xiao-Jun Wu, and Josef Kittler. Graph2net: Perceptually-enriched graph learning for skeleton-based ac- tion recognition. IEEE transactions on circuits and systems for video technology, 32(4):2120–2132, 2021. 8

    2021

  93. [101]

    Laga-net: Local-and-global attention network for skeleton based ac- tion recognition

    Rongjie Xia, Yanshan Li, and Wenhan Luo. Laga-net: Local-and-global attention network for skeleton based ac- tion recognition. IEEE Transactions on Multimedia , 24: 2648–2661, 2021. 6, 8

    2021

  94. [102]

    Dynamic semantic-based spatial graph convolution network for skeleton-based hu- man action recognition

    Jianyang Xie, Yanda Meng, Yitian Zhao, Anh Nguyen, Xi- aoyun Yang, and Yalin Zheng. Dynamic semantic-based spatial graph convolution network for skeleton-based hu- man action recognition. In Proceedings of the AAAI Con- ference on Artificial Intelligence , pages 6225–6233, 2024. 2

    2024

  95. [103]

    Graph stacked hourglass networks for 3d human pose estimation

    Tianhan Xu and Wataru Takano. Graph stacked hourglass networks for 3d human pose estimation. In2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 16100–16109, 2021. 2

    2021

  96. [104]

    Spatial tem- poral graph convolutional networks for skeleton-based ac- tion recognition

    Sijie Yan, Yuanjun Xiong, and Dahua Lin. Spatial tem- poral graph convolutional networks for skeleton-based ac- tion recognition. In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence and Thirtieth Innova- tive Applications of Artificial Intelligence C...

    2018

  97. [105]

    Spatial tempo- ral graph convolutional networks for skeleton-based action recognition

    Sijie Yan, Yuanjun Xiong, and Dahua Lin. Spatial tempo- ral graph convolutional networks for skeleton-based action recognition. In Proceedings of the AAAI conference on ar- tificial intelligence, 2018. 2, 8

    2018

  98. [106]

    Unik: A unified framework for real-world skeleton-based action recognition

    Di Yang, Yaohui Wang, Antitza Dantcheva, Lorenzo Garat- toni, Gianpiero Francesca, and Francois Bremond. Unik: A unified framework for real-world skeleton-based action recognition. BMVC, 2021. 2

    2021

  99. [107]

    Skeleton cloud colorization for unsupervised 3d action representation learning

    Siyuan Yang, Jun Liu, Shijian Lu, Meng Hwa Er, and Alex C Kot. Skeleton cloud colorization for unsupervised 3d action representation learning. In Proceedings of the IEEE/CVF International Conference on Computer Vision , pages 13423–13433, 2021. 6

    2021

  100. [108]

    One-shot action recognition via multi-scale spatial-temporal skeleton matching

    Siyuan Yang, Jun Liu, Shijian Lu, Er Meng Hwa, and Alex C Kot. One-shot action recognition via multi-scale spatial-temporal skeleton matching. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024. 2

    2024

  101. [109]

    Regularity learning via explicit distribution mod- eling for skeletal video anomaly detection

    Shoubin Yu, Zhongyin Zhao, Haoshu Fang, Andong Deng, Haisheng Su, Dongliang Wang, Weihao Gan, Cewu Lu, and Wei Wu. Regularity learning via explicit distribution mod- eling for skeletal video anomaly detection. IEEE Transac- tions on Circuits and Systems for Video Technology, 2023. 7

    2023

  102. [110]

    Generative cooperative learning for unsupervised video anomaly detection

    M Zaigham Zaheer, Arif Mahmood, M Haris Khan, Mattia Segu, Fisher Yu, and Seung-Ik Lee. Generative cooperative learning for unsupervised video anomaly detection. In Pro- ceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 14744–14754, 2022. 2, 8

    2022

  103. [111]

    A hierarchical spatio- temporal graph convolutional neural network for anomaly detection in videos

    Xianlin Zeng, Yalong Jiang, Wenrui Ding, Hongguang Li, Yafeng Hao, and Zifeng Qiu. A hierarchical spatio- temporal graph convolutional neural network for anomaly detection in videos. IEEE Transactions on Circuits and Sys- tems for Video Technology, 33(1):200–212, 2021. 7

    2021

  104. [112]

    Mixste: Seq2seq mixed spatio-temporal encoder for 3d human pose estimation in video

    Jinlu Zhang, Zhigang Tu, Jianyu Yang, Yujin Chen, and Junsong Yuan. Mixste: Seq2seq mixed spatio-temporal encoder for 3d human pose estimation in video. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 13222–13232, 2022. 2 13

    2022

  105. [113]

    View adaptive recurrent neural networks for high performance human action recog- nition from skeleton data

    Pengfei Zhang, Cuiling Lan, Junliang Xing, Wenjun Zeng, Jianru Xue, and Nanning Zheng. View adaptive recurrent neural networks for high performance human action recog- nition from skeleton data. InProceedings of the IEEE inter- national conference on computer vision, pages 2117–2126,

  106. [114]

    3d human pose estima- tion with spatial and temporal transformers

    Ce Zheng, Sijie Zhu, Matias Mendieta, Taojiannan Yang, Chen Chen, and Zhengming Ding. 3d human pose estima- tion with spatial and temporal transformers. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2021. 2

    2021

  107. [115]

    Towards 3d human pose estimation in the wild: A weakly-supervised approach

    Xingyi Zhou, Qixing Huang, Xiao Sun, Xiangyang Xue, and Yichen Wei. Towards 3d human pose estimation in the wild: A weakly-supervised approach. In 2017 IEEE In- ternational Conference on Computer Vision (ICCV), pages 398–407, 2017. 2

    2017

  108. [116]

    Adaptive local-component-aware graph convolutional network for one-shot skeleton-based action recognition

    Anqi Zhu, Qiuhong Ke, Mingming Gong, and James Bai- ley. Adaptive local-component-aware graph convolutional network for one-shot skeleton-based action recognition. In Proceedings of the IEEE/CVF Winter Conference on Appli- cations of Computer Vision, pages 6038–6047, 2023. 8 1...

    2023

  109. [120]

    Experimental Setup Details 7.1. Hyperparameters for DT1: Action Classifica- tion As discussed in Section 5.1, we evaluate MoFM on NTU- RGB+D [78] (60 classes) and NTU-RGB+D-120 [51] (120 classes) for action recognition. The detailed hyperparame- ters for training on both datas...

  110. [2016]

    IEEE Computer Society. 6, 8, 1

  111. [2021]

    IEEE Computer Society. 2

  112. [2022]

    Springer Nature Switzerland. 7

Pith tools

Reviewed August 8, 2026 · model on record in the stance chip above.