DAP: Doppler-aware Point Network for Heterogeneous mmWave Action Recognition
Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel 2026-07-04 01:45 UTCgrok-4.3pith:LBBHR5BXrecord.jsonopen to challenge →
The pith
DAP-Net uses consistent Doppler patterns as anchors to achieve source-invariant mmWave action recognition across heterogeneous radars.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
By introducing the UniMM-HAR dataset with standardized heterogeneous radar configurations and the DAP-Net architecture that leverages action-consistent spatio-temporal Doppler patterns for intra-modal enhancement and cross-modal alignment via D2R and TAM modules, the work establishes that Doppler-aware processing enables state-of-the-art performance and robustness in heterogeneous mmWave action recognition.
What carries the argument
Doppler-aware Point Cloud Network (DAP-Net) with its Dual-space Doppler Reparameterization (D2R) module for sample-adaptive geometric densification and Doppler-guided feature recalibration, plus the Text Alignment Module (TAM) for stable semantic anchors.
Load-bearing premise
Action-consistent spatio-temporal Doppler patterns can reliably serve as anchors for learning source-invariant semantics across heterogeneous radar sources.
What would settle it
Evaluating DAP-Net on mmWave point clouds from a fourth, unseen radar configuration and observing whether accuracy remains comparable to the cross-source results within UniMM-HAR.
Figures
read the original abstract
Millimeter-wave (mmWave) radar provides privacy-preserving sensing and is valuable for human action recognition (HAR). Existing mmWave point cloud datasets are limited in scale and mostly collected under homogeneous single-source settings, preventing current methods from handling real-world distribution shifts caused by heterogeneous radar sources, such as different devices and frequency bands. To address this, we introduce UniMM-HAR, the largest and first mmWave point cloud HAR dataset for heterogeneous multi-source scenarios, standardizing three distinct radar configurations to realistically evaluate cross-source generalization. We further propose the Doppler-aware Point Cloud Network (DAP-Net) to tackle heterogeneity challenges. DAP-Net enhances intra-modal representations and performs cross-modal alignment to learn source-invariant action semantics. Leveraging action-consistent spatio-temporal Doppler patterns as anchors, the Dual-space Doppler Reparameterization (D2R) module performs sample-adaptive geometric densification and Doppler-guided feature recalibration, while the Text Alignment Module (TAM) provides stable semantic anchors via a pretrained textual space. Experiments show that DAP-Net significantly outperforms existing methods under heterogeneous radar settings, achieving state-of-the-art accuracy and strong cross-source robustness.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces UniMM-HAR, the first large-scale mmWave point cloud dataset for heterogeneous multi-source human action recognition by standardizing three distinct radar configurations, and proposes DAP-Net consisting of the Dual-space Doppler Reparameterization (D2R) module and Text Alignment Module (TAM). It claims that leveraging action-consistent spatio-temporal Doppler patterns enables source-invariant semantics, yielding state-of-the-art accuracy and strong cross-source robustness over existing methods.
Significance. If the quantitative claims hold with proper baselines and ablations, the work would address a genuine gap in handling distribution shifts from heterogeneous mmWave sources (devices and frequency bands) for privacy-preserving HAR. The new dataset and Doppler-aware modules could provide a useful benchmark and technical direction, particularly if the cross-source evaluations demonstrate generalization beyond controlled settings.
major comments (3)
- [Dataset] Dataset section: The central claim that the three standardized radar configurations 'realistically evaluate cross-source generalization' is load-bearing but lacks supporting analysis of shift magnitude; specifically, no quantification of frequency-band differences or Doppler scaling (f_d = 2v f_c / c) is provided to show that the induced shifts match real-world heterogeneous sources rather than controlled parameter variations.
- [Method] Method, D2R module: The assumption that spatio-temporal Doppler patterns remain action-consistent anchors across sources without explicit per-source normalization is not empirically tested; if frequency scaling alters the patterns, the sample-adaptive geometric densification and feature recalibration may not reliably produce source-invariant features.
- [Experiments] Experiments: The abstract asserts significant outperformance and robustness, yet the provided text supplies no quantitative results, baseline comparisons, error bars, dataset statistics, or cross-source protocol details, preventing evaluation of whether the central claims are supported.
minor comments (2)
- [Abstract] Abstract and introduction: Ensure all claims of 'state-of-the-art accuracy' are backed by explicit numerical comparisons and ablation studies in the main text rather than asserted without numbers.
- [Method] Notation: Define all module acronyms (D2R, TAM) and their inputs/outputs at first use for clarity.
Simulated Author's Rebuttal
We thank the referee for the constructive feedback. We address each major comment below and indicate planned revisions to strengthen the manuscript.
read point-by-point responses
-
Referee: [Dataset] Dataset section: The central claim that the three standardized radar configurations 'realistically evaluate cross-source generalization' is load-bearing but lacks supporting analysis of shift magnitude; specifically, no quantification of frequency-band differences or Doppler scaling (f_d = 2v f_c / c) is provided to show that the induced shifts match real-world heterogeneous sources rather than controlled parameter variations.
Authors: We agree that explicit quantification would better substantiate the claim of realistic evaluation. In the revision, we will add analysis in the dataset section computing the frequency-band differences across the three configurations and the resulting Doppler scaling factors via f_d = 2v f_c / c for typical action velocities (e.g., 0.5-2 m/s), to demonstrate alignment with real-world device heterogeneity. revision: yes
-
Referee: [Method] Method, D2R module: The assumption that spatio-temporal Doppler patterns remain action-consistent anchors across sources without explicit per-source normalization is not empirically tested; if frequency scaling alters the patterns, the sample-adaptive geometric densification and feature recalibration may not reliably produce source-invariant features.
Authors: This concern is well-taken. We will augment the method section with empirical validation, including cross-source Doppler pattern similarity metrics or visualizations for identical actions, to test the consistency assumption and confirm the D2R module's robustness without per-source normalization. revision: yes
-
Referee: [Experiments] Experiments: The abstract asserts significant outperformance and robustness, yet the provided text supplies no quantitative results, baseline comparisons, error bars, dataset statistics, or cross-source protocol details, preventing evaluation of whether the central claims are supported.
Authors: The full manuscript includes these elements in Section 4 (dataset statistics, baseline tables, cross-source protocols, and accuracy metrics). To address the concern directly, we will ensure a concise summary of key quantitative results (with error bars) appears in the main body or is more prominently referenced, and add any missing protocol details if not already explicit. revision: partial
Circularity Check
No circularity; claims rest on empirical evaluation of new dataset and proposed modules
full rationale
The manuscript presents no mathematical derivations, equations, or parameter-fitting steps that reduce to self-definitions or prior self-citations. UniMM-HAR is introduced as a new standardized dataset, and DAP-Net (with D2R and TAM) is proposed as an architecture whose performance is assessed via experiments on cross-source generalization. These elements are independent of any load-bearing self-referential reductions; the central claims of outperformance and robustness are falsifiable through external replication on the released data rather than being forced by construction.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption mmWave radar provides privacy-preserving sensing valuable for human action recognition
invented entities (4)
-
UniMM-HAR dataset
no independent evidence
-
DAP-Net
no independent evidence
-
D2R module
no independent evidence
-
TAM
no independent evidence
Reference graph
Works this paper leans on
-
[1]
An, S., Li, Y., Ogras, U.: mri: Multi-modal 3d human pose estimation dataset using mmwave, rgb-d, and inertial sensors. NeurIPS35, 27414–27426 (2022)
work page 2022
-
[2]
ACM Transactions on Embedded Computing Systems20(5s), 1–22 (2021)
An, S., Ogras, U.Y.: Mars: mmwave-based assistive rehabilitation system for smart healthcare. ACM Transactions on Embedded Computing Systems20(5s), 1–22 (2021)
work page 2021
- [3]
-
[4]
Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation
Bengio, Y., Léonard, N., Courville, A.: Estimating or propagating gradi- ents through stochastic neurons for conditional computation. arXiv preprint arXiv:1308.3432 (2013)
work page internal anchor Pith review Pith/arXiv arXiv 2013
-
[5]
IEEE Transactions on Radar Systems2, 484–497 (2024)
Biswas, S., Manavi Alam, A., Gurbuz, A.C.: Hrspecnet: A deep learning-based high-resolution radar micro-doppler signature reconstruction for improved har clas- sification. IEEE Transactions on Radar Systems2, 484–497 (2024)
work page 2024
-
[6]
IEEE TPAMI 45(3), 3522–3538 (2022)
Bruce, X., Liu, Y., Zhang, X., Zhong, S.h., Chan, K.C.: Mmnet: A model-based multimodal network for human action recognition in rgb-d videos. IEEE TPAMI 45(3), 3522–3538 (2022)
work page 2022
- [7]
- [8]
- [9]
-
[10]
Courbariaux,M.,Hubara,I.,Soudry,D.,El-Yaniv,R.,Bengio,Y.:Binarizedneural networks: Training deep neural networks with weights and activations constrained to+ 1 or-1. arXiv preprint arXiv:1602.02830 (2016)
work page internal anchor Pith review Pith/arXiv arXiv 2016
-
[11]
Cui, H., Zhong, S., Wu, J., Shen, Z., Dahnoun, N., Zhao, Y.: Milipoint: A point cloud dataset for mmwave radar. NeurIPS36, 62713–62726 (2023)
work page 2023
-
[12]
Applied Sciences14(16), 7253 (2024)
Dang, X., Fan, K., Li, F., Tang, Y., Gao, Y., Wang, Y.: Multi-person action recog- nition based on millimeter-wave radar point cloud. Applied Sciences14(16), 7253 (2024)
work page 2024
- [13]
- [14]
- [15]
-
[16]
IEEE TPAMI45(2), 2181–2192 (2022)
Fan, H., Yang, Y., Kankanhalli, M.: Point spatio-temporal transformer networks for point cloud video modeling. IEEE TPAMI45(2), 2181–2192 (2022)
work page 2022
-
[17]
arXiv preprint arXiv:2512.12378 (2025)
Fan, J., Zhou, Y., Yang, Y., Cui, X., Zhang, J., Xie, L., Yang, J., Lu, C.X., Ding, F.: M4human: A large-scale multimodal mmwave radar benchmark for human mesh reconstruction. arXiv preprint arXiv:2512.12378 (2025)
- [18]
-
[19]
IEEE Sensors Letters3(12), 1–4 (2019) 16 J
Fhager, L.O., Heunisch, S., Dahlberg, H., Evertsson, A., Wernersson, L.E.: Pulsed millimeter wave radar for hand gesture sensing and classification. IEEE Sensors Letters3(12), 1–4 (2019) 16 J. Lin et al
work page 2019
-
[20]
In: Youth Academic Annual Conference of Chinese Association of Automation
Gao, G., Liu, Q., Wang, W., Yu, Z., Liu, X.: Human activity recognition based on 4d millimeter-wave radar. In: Youth Academic Annual Conference of Chinese Association of Automation. pp. 1822–1828. IEEE (2025)
work page 2025
-
[21]
arXiv preprint arXiv:2405.01882 (2024)
Gu, Z., He, X., Fang, G., Xu, C., Xia, F., Jia, W.: Millimeter wave radar- based human activity recognition for healthcare monitoring robot. arXiv preprint arXiv:2405.01882 (2024)
- [22]
- [23]
-
[24]
NeurIPS36, 58064– 58074 (2023)
Hor, S., Yang, S., Choi, J., Arbabian, A.: Mvdoppler: Unleashing the power of multi-view doppler for micromotion-based gait classification. NeurIPS36, 58064– 58074 (2023)
work page 2023
- [25]
- [26]
- [27]
- [28]
- [29]
-
[30]
Liu, J., Wang, X., Wang, C., Gao, Y., Liu, M.: Temporal decoupling graph convo- lutional network for skeleton-based gesture recognition. IEEE TMM26, 811–823 (2024)
work page 2024
- [31]
-
[32]
Liu, M., Liu, H., Chen, C.: Enhanced skeleton visualization for view invariant human action recognition. PR68, 346–362 (2017)
work page 2017
-
[33]
IEEE TPAMI48(3), 3726–3743 (2026)
Liu, M., Liu, J., Jiang, Y., He, B.: Heatmap pooling network for action recognition from rgb videos. IEEE TPAMI48(3), 3726–3743 (2026)
work page 2026
- [34]
-
[35]
Liu, Y., Wang, F., Wang, N., Zhang, Z.X.: Echoes beyond points: Unleashing the power of raw radar data in multi-modality fusion. NeurIPS36, 53964–53982 (2023)
work page 2023
-
[36]
IEEE Transactions on Mobile Computing23(5), 5479–5493 (2023)
Luo,F.,Khan,S.,Li,A.,Huang,Y.,Wu,K.:Edgeactnet:Edgeintelligence-enabled human activity recognition using radar point cloud. IEEE Transactions on Mobile Computing23(5), 5479–5493 (2023)
work page 2023
-
[37]
Ma, X., Qin, C., You, H., Ran, H., Fu, Y.: Rethinking network design and lo- cal geometry in point cloud: A simple residual mlp framework. arXiv preprint arXiv:2202.07123 (2022)
- [38]
- [39]
-
[40]
Palipana, S., Salami, D., Leiva, L.A., Sigg, S.: Pantomime: Mid-air gesture recog- nition with sparse millimeter-wave radar point clouds. IMWUT5(1), 1–27 (2021)
work page 2021
- [41]
-
[42]
Neural Networks108, 533–543 (2018)
Phan, A.V., Le Nguyen, M., Nguyen, Y.L.H., Bui, L.T.: Dgcnn: A convolutional neural network over large-scale labeled graphs. Neural Networks108, 533–543 (2018)
work page 2018
- [43]
- [44]
-
[45]
Qi, C.R., Yi, L., Su, H., Guibas, L.J.: Pointnet++: Deep hierarchical feature learn- ing on point sets in a metric space. NeurIPS30(2017)
work page 2017
- [46]
- [47]
-
[48]
IEEE Transactions on Mobile Computing22(8), 4946–4960 (2022)
Salami, D., Hasibi, R., Palipana, S., Popovski, P., Michoel, T., Sigg, S.: Tesla- rapture: A lightweight gesture recognition system from mmwave radar sparse point clouds. IEEE Transactions on Mobile Computing22(8), 4946–4960 (2022)
work page 2022
-
[49]
IEEE Transactions on Neu- ral Networks and Learning Systems34(11), 8418–8429 (2022)
Sengupta, A., Cao, S.: mmpose-nlp: A natural language processing approach to precise skeletal pose estimation using mmwave radars. IEEE Transactions on Neu- ral Networks and Learning Systems34(11), 8418–8429 (2022)
work page 2022
-
[50]
Seo, H.I., Bae, J.W., Seo, D.H.: Radar-based human activity recognition using adaptive range selection and deep neural network. IEEE Sensors Journal pp. 1–1 (2026)
work page 2026
- [52]
-
[53]
In: Pro- ceedings of the 3rd ACM Workshop on Millimeter-wave Networks and Sensing Systems
Singh, A.D., Sandha, S.S., Garcia, L., Srivastava, M.: Radhar: Human activity recognition from point clouds generated through a millimeter-wave radar. In: Pro- ceedings of the 3rd ACM Workshop on Millimeter-wave Networks and Sensing Systems. pp. 51–56 (2019)
work page 2019
-
[54]
Tan, T.H., Tian, J.H., Sharma, A.K., Liu, S.H., Huang, Y.F.: Human activity recognition based on deep learning and micro-doppler radar data. Sensors24(8) (2024)
work page 2024
-
[55]
Texas Instruments: IWR1443BOOST single-chip 77- and 79-ghz mmwave sensor evaluation module.https://www.ti.com/tool/IWR1443BOOST(2014), accessed: 2020-09-29
work page 2014
-
[56]
Texas Instruments: IWR6843 single-chip 60-ghz mmwave radar sensor.https: //www.ti.com/product/IWR6843(2019), accessed: 2020-09-29
work page 2019
- [57]
- [58]
-
[59]
In: International Conference on AI in Healthcare
Tunau, M., Zakka, V.G., Dai, Z.: Enhanced sparse point cloud data processing for privacy-aware human action recognition. In: International Conference on AI in Healthcare. pp. 142–155. Springer (2025)
work page 2025
- [60]
- [61]
-
[62]
Wang, S., Cao, D., Liu, R., Jiang, W., Yao, T., Lu, C.X.: Human parsing with joint learning for dynamic mmwave radar point cloud. IMWUT7(1), 1–22 (2023)
work page 2023
-
[63]
Wang, Y., Liu, H., Cui, K., Zhou, A., Li, W., Ma, H.: m-activity: Accurate and real-time human activity recognition via millimeter wave radar. In: ICASSP. pp. 8298–8302. IEEE (2021)
work page 2021
-
[64]
arXiv preprint arXiv:2503.02300 (2025)
Wu, R., Li, Z., Wang, J., Xu, X., Zheng, Z., Huang, K., Lu, G.: Diffusion-based mmwave radar point cloud enhancement driven by range images. arXiv preprint arXiv:2503.02300 (2025)
-
[65]
IEEE Transactions on Radar Systems4, 261–272 (2025)
Wu, Y., Fioranelli, F., Gao, C.: Radmamba: Efficient human activity recognition through a radar-based micro-doppler-oriented mamba state-space model. IEEE Transactions on Radar Systems4, 261–272 (2025)
work page 2025
-
[66]
IEEE Transactions on Mobile Computing 23(12), 10734–10751 (2024)
Xia, S., Chu, L., Pei, L., Yang, J., Yu, W., Qiu, R.C.: Timestamp-supervised wearable-based activity segmentation and recognition with contrastive learning and order-preserving optimal transport. IEEE Transactions on Mobile Computing 23(12), 10734–10751 (2024)
work page 2024
- [67]
-
[68]
Xu, R., Wang, X., Wang, T., Chen, Y., Pang, J., Lin, D.: Pointllm: Empowering largelanguagemodelstounderstandpointclouds.In:ECCV.pp.131–147.Springer (2024)
work page 2024
-
[69]
Xue, H., Ju, Y., Miao, C., Wang, Y., Wang, S., Zhang, A., Su, L.: mmmesh: Towards 3d real-time dynamic human mesh construction using millimeter-wave. In: MobiSys. pp. 269–282 (2021)
work page 2021
-
[70]
arXiv preprint arXiv:2511.08910 (2025)
Yan, J., Xu, C., Liu, D.: Og-pcl: Efficient sparse point cloud processing for human activity recognition. arXiv preprint arXiv:2511.08910 (2025)
- [71]
-
[72]
Yang, J., Huang, H., Zhou, Y., Chen, X., Xu, Y., Yuan, S., Zou, H., Lu, C.X., Xie, L.: Mm-fi: Multi-modal non-intrusive 4d human dataset for versatile wireless sensing. NeurIPS36, 18756–18768 (2023)
work page 2023
-
[73]
IEEE Systems Journal16(2), 3036–3047 (2022)
Yu, C., Xu, Z., Yan, K., Chien, Y.R., Fang, S.H., Wu, H.C.: Noninvasive human activity recognition using millimeter-wave radar. IEEE Systems Journal16(2), 3036–3047 (2022)
work page 2022
-
[74]
In: 2020 IEEE 91st Vehicular Technology Conference
Yu, J.T., Yen, L., Tseng, P.H.: mmwave radar-based hand gesture recognition using range-angle image. In: 2020 IEEE 91st Vehicular Technology Conference. pp. 1–5 (2020)
work page 2020
-
[75]
In: International Conference on Computer and Communications
Zeng, X., Shi, Y., Zhou, A.: Multi-har: Human activity recognition in multi-person scenes based on mmwave sensing. In: International Conference on Computer and Communications. pp. 1789–1793. IEEE (2022)
work page 2022
- [76]
-
[77]
IEEE Sensors Letters3(2), 1–4 (2018)
Zhang, R., Cao, S.: Real-time human motion behavior detection via cnn using mmwave radar. IEEE Sensors Letters3(2), 1–4 (2018)
work page 2018
-
[78]
Zhao, M., Tian, Y., Zhao, H., Alsheikh, M.A., Li, T., Hristov, R., Kabelac, Z., Katabi,D.,Torralba,A.:Rf-based3dskeletons.In:SIGCOMM.pp.267–281(2018)
work page 2018
-
[79]
IEEE Internet of Things Journal10(12), 10236–10249 (2023)
Zhao, P., Lu, C.X., Wang, B., Trigoni, N., Markham, A.: Cubelearn: End-to-end learning for human motion recognition from raw mmwave radar signals. IEEE Internet of Things Journal10(12), 10236–10249 (2023)
work page 2023
-
[80]
IEEE TPAMI45(4), 4396–4415 (2022)
Zhou, K., Liu, Z., Qiao, Y., Xiang, T., Loy, C.C.: Domain generalization: A survey. IEEE TPAMI45(4), 4396–4415 (2022)
work page 2022
-
[81]
Zhou, R., Li, S., Zhang, H., Liu, C., Sun, J.: mmmulti: Multi-person action recog- nition based on multi-task learning using millimeter waves. IMWUT9(2), 1–25 (2025) 20 J. Lin et al. Supplementary Material In this supplementary material, we provide a comprehensive overview of the UniMM-HAR dataset, an analysis of its heterogeneous multi-source characteris...
work page 2025
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.