REVIEW 3 major objections 7 minor 2 cited by
Joint Multitarget Detection and Tracking with mmWave Radar
T0 review · 3 major / 7 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read An integrated detection-association-tracking pipeline with a Cramér-Rao-bound-based measurement model lets an mmWave radar track multiple weak targets in clutter.
desk verdict A coherent applied integration of NOMP, SPA, and KF with a real runtime win, but the weak-target claim rests on a CRB-efficiency assumption that only holds above 17 dB. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the pseudo-measurement model $z(t)=[p_x,p_y]^T+v(t)$ with $v(t)\sim \mathcal{N}(0,R(t))$ and $R(t)=\kappa\,\mathrm{CRB}([p_x,p_y]^T)$ evaluated at the 2D-MNOMP estimates, with $\kappa=1.2$. This turns line-spectral estimates into a standard measurement model and lets the Kalman filter and SPA gate use the elliptical uncertainty of the estimates instead of an isotropic approximation. A second mechanism is the 3D validation gate, which augments the two position coordinates with the estimated radial velocity using the augmented measurement matrix $H'_k$ and $R'_k(t)=\kappa\,\mathrm{CRB}([p_x,p_y,v]^T)$. A third mechanism is the forward-only 2D-MNOMP-CFAR with an invalid-target counter $K_{\mathrm{invalid}}$, which stops detection after a run of sub-threshold candidates and thereby removes the backward step's cost while limiting target masking.
What would settle it
Run 2D-MNOMP on a single target at integrated SNRs of 5, 10, 15 and 20 dB over hundreds of Monte Carlo trials and compare the empirical error covariance of the position estimates with $\kappa$ times the Cramér-Rao bound; if at 5 dB the empirical covariance is much larger or differently shaped than the scaled bound, then the pseudo-measurement covariance and the 3D gate are mis-specified at the weak-target operating point.
Extended reading notes
Core claim
The paper's central claim is that joint multi-target detection and tracking is best done by treating the mmWave radar's range-velocity-azimuth measurements as a pseudo-position measurement with a Cramér-Rao-bound-derived covariance, then feeding those measurements through radial-velocity-gated SPA and a Kalman filter. The proposed MNOMP-SPA-KF uses a forward-only 2D multisnapshot Newtonized orthogonal matching pursuit with a CFAR stopping rule and an invalid-target counter to avoid masking by strong targets; azimuth is obtained by least squares fit of the snapshot gains; the resulting position estimates are modeled as Gaussian with covariance $\kappa\,\mathrm{CRB}([p_x,p_y]^T)$. The SPA gate includes radial velocity as a third measurement dimension. The paper states that 3DNOMP-SPA-KF and MNOMP-SPA-KF generate the most stable trajectories and can accurately track the targets all the time in the simulated scenes, and that the pipeline detects a weak target that 2D-MNOMP alone misses.
Load-bearing premise
The load-bearing premise is that the detector's position estimates are accurate enough that their true error spread is well described by 1.2 times the theoretical best possible spread (the Cramér-Rao bound) evaluated at the estimate; the paper demonstrates this only at integrated SNR above about 17 dB, while its weak-target demonstration runs at 5.2 dB.
Editorial extensions
If this is right
- Higher detection-stage false-alarm rates become usable, because the SPA-KF tracking stage suppresses most false alarms while preserving the weak target.
- Targets separated by less than the nominal range resolution (0.5 m apart, versus 0.78 m resolution) can still be resolved and tracked as distinct objects thanks to the super-resolution MNOMP detector.
- Using the scaled Cramér-Rao covariance in the Kalman filter outperforms using a scaled identity covariance, and adding radial velocity to the SPA gate outperforms the position-only 2D gate, in both simulations and real experiments.
- The forward-only 2D-MNOMP drops the per-frame sensing time from about 1.69 seconds to about 0.075 seconds, making the pipeline compatible with the 0.1-second frame interval in the experiments.
Reading between the lines
- The transferable idea is probably the elliptical pseudo-measurement covariance itself: any super-resolution estimator with a computable Cramér-Rao bound could be plugged into the same SPA-KF architecture, and the paper's comparisons suggest the gain comes more from using the true error shape than from the specific detector.
- The weak-target gain in the paper's Section IV-D likely comes mostly from temporal integration by the tracker (gating, extrapolation, and track maintenance) rather than from improved single-frame detection; a per-frame detection-probability comparison before and after tracking would make that division explicit.
- The radial-velocity gate should be tested at the same low-SNR operating point used for the weak target, because the velocity estimate is part of the gate and its error also grows as SNR drops; the 3D gate's advantage over the 2D gate may shrink or reverse there.
- The constant-velocity motion model and fixed extrapolation count are simple track-management choices; the rest of the pipeline would survive replacing them with a maneuver-aware model, which is an extension the paper does not explore.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper proposes an end-to-end detection–association–tracking pipeline for mmWave LFMCW radar. The detection module is a low-complexity forward-only 2D multisnapshot Newtonized orthogonal matching pursuit with CFAR (2D-MNOMP), which extracts range, Doppler, and azimuth; the association module is a sum-product algorithm whose validation gate includes radial velocity; the tracking module is a Kalman filter whose measurement covariance is set to a scaled Cramér–Rao bound (Proposition 1, Eq. (17)). The paper validates the CRB approximation in simulation, compares the integrated MNOMP-SPA-KF with FFT/PDA/JPDA/SPA variants on MOSPA, demonstrates a weak-target tracking scenario, and reports three real-data experiments with an AWR1642 radar. The central claim is that the integrated framework, especially with the 3D radial-velocity gate, produces the most stable trajectories and can track targets that 2D-MNOMP alone misses.
Significance. If the claims hold, the paper offers a useful engineering framework: the CRB-based pseudo-measurement covariance is a principled way to capture range–angle measurement correlation, the forward-only NOMP with a masking countermeasure and a single FFT is a meaningful complexity reduction, and the radial-velocity 3D gate is a sensible extension of SPA data association. The reported per-frame runtime of 0.075 s is attractive for real-time mmWave radar tracking. The paper also gives a closed-form CRB derivation with a proof, which is a concrete theoretical contribution. However, the evaluation currently leaves open whether the CRB-efficiency assumption holds in the weak-target regime, and the numerical and real-data comparisons lack the statistical or ground-truth support needed to substantiate the strongest claims.
major comments (3)
- [IV-D and III-A (Eqs. (21), (34c))] The advertised weak-target advantage is not quantitatively supported. Fig. 5 shows that 2D-MNOMP estimates approach the CRB only above roughly 17 dB integrated SNR, yet the weak-target scenario in Section IV-D uses an integrated SNR of 5.2 dB, about 12 dB below that threshold. In this regime the pseudo-measurement model (21) with R(t)=kappa CRB, the 3D gate (34c), and the Kalman gain (38) are likely misspecified because the estimator is probably biased and non-Gaussian. Moreover, Section IV-D reports no metric (e.g., track-loss probability, MOSPA, detection probability), and Fig. 8 shows a single realization; the maintained trajectory may be due to extrapolation (Section III-D) rather than to valid detections. Please add quantitative weak-target experiments, including the empirical covariance of 2D-MNOMP versus kappa CRB at 5.2 dB, and report detection probability and track-loss metrics averaged over many trials.
- [IV-C, Fig. 7] The central MOSPA comparison is averaged over 300 Monte Carlo trials but is plotted without error bars, confidence intervals, or statistical tests. The trajectory plots in Fig. 6 are single realizations, so the reader cannot assess whether the reported advantage of MNOMP-SPA-KF and 3DNOMP-SPA-KF over, e.g., MNOMP-SPA-subKF is significant or seed-dependent. Please report means with standard errors or boxplots, state whether all algorithms process identical scene realizations, and give the number of independent trials underlying each curve.
- [V, Figs. 11-17] The real-data evaluation is purely qualitative. The text asserts that MNOMP-SPA-KF (3D-Gate) tracks people while suppressing false alarms, but no ground-truth comparison (e.g., hand-labeled positions, GPS, or optical reference), no RMSE, and no track completeness or false-track statistics are presented. Since Section V is used to support the claim of superior real-world performance, please add quantitative evaluation: trajectory error against ground truth, track detection rate, false track rate, and a direct 2D-Gate versus 3D-Gate comparison using these metrics.
minor comments (7)
- [Abstract] The abstract contains typographical and grammatical errors, including 'Newtonalized' for 'Newtonized' and the phrase 'create smart, efficient, automated system'; these should be corrected.
- [III-A, Eq. (14)] The notation F_omega(Y_l) is used before its definition; please define the 2D FFT convention explicitly and state over which frequency grid it is evaluated.
- [III-A, Eq. (15), Abstract] The abstract describes the azimuth extraction as a conventional Bartlett beamformer, but Eq. (15) is a least-squares fit of the gain vector under the constraint (9); the terminology should be aligned with the actual computation.
- [Table I] The real-data experiments use L=4 receivers while the simulations use L=8; please comment on how this difference affects the CRB and the expected performance of the 3D gate.
- [III-D, Eq. (43)] The new-target initialization in Eq. (43) implicitly sets the lateral velocity to zero by aligning velocity with the radial direction; this assumption should be stated explicitly, since it may bias tracking of crossing targets.
- [IV-A, V] Several hyperparameters (K_invalid, N_ext, P_FA, PG, kappa, SPA iteration count) are set to fixed values without sensitivity analysis or a default-selection procedure; a short sensitivity study or a stated selection rule would improve reproducibility.
- [V, runtime paragraph] The runtime comparison reports 1.69 s versus 0.075 s per frame for the detector alone, and separately reports total runtimes for the full pipeline; please clarify the hardware/software environment and whether the 0.075 s figure includes SPA and KF or only the detector.
Circularity Check
There is no significant circularity: the CRB model is derived from the measurement equation and the tracking metric is external to the fitted κ parameter.
full rationale
The paper's derivation chain is self-contained. The CRB in Proposition 1 and eq. (67) is obtained from the baseband measurement model (1) through standard Fisher-information and reparameterization arguments (Lemmas 1-2), not from the tracking output. The pseudo-measurement covariance R(t)=κCRB(...) in eq. (21) is an approximation assumption about the 2D-MNOMP estimator; Fig. 5 directly checks estimator MSE against the CRB, and κ=1.2 is calibrated to the empirical coverage in Fig. 3. This is parameter calibration, not a prediction that reduces to the fit, because the performance metric (MOSPA, eq. (46)) is computed against ground truth and is independent of how κ was chosen. The SPA validation gate (33) and 3D-Gate (34c) use the same CRB model as part of the algorithm design, not as a post-hoc justification. The only self-citation, ref. [11], supplies the underlying NOMP-CFAR algorithm; it is a published prior result and does not by itself force the integrated tracking conclusions. The weak-target demonstration (Section IV-D) relies on extrapolation across missed detections; that is temporal filtering behavior, not a tautology. A genuine robustness concern exists—CRB efficiency is demonstrated only for SNR ≳17 dB while the weak-target example operates at 5.2 dB—but this is a validity limitation, not a circularity.
Assumptions & free parameters
free parameters (8)
- kappa (CRB scaling) =
1.2
- K_invalid =
not stated
- N_ext =
not stated
- P_FA =
0.01/(128x64) or 0.1/(128x64)
- CFAR training and guard cells =
[5,4] training, [3,3] guard; 60 training cells in real data
- Gate probability PG =
0.95
- SPA iterations =
10
- K_max =
30
assumptions (5)
- domain assumption Received signal follows the point-target Gaussian model in eq. (1), with i.i.d. complex Gaussian noise across fast-time, slow-time, and spatial domains.
- domain assumption Targets follow a constant-velocity motion model with known process noise covariance Q (eq. 3).
- ad hoc to paper The 2D-MNOMP estimator is asymptotically unbiased and CRB-efficient, so its error covariance equals the single-target CRB (eq. 18-21).
- domain assumption Data association is one-to-one between targets and measurements, with i.i.d. clutter modeled by the distribution fc (eq. 23-27).
- ad hoc to paper New targets are initialized with velocity aligned with the radial direction (eq. 43).
Cite this review
Pith. "Pith review of Joint Multitarget Detection and Tracking with mmWave Radar." pith.science (2026). https://pith.science/paper/KD3ZWSDM
@misc{pith2026241217211,
author = {Pith},
title = {Pith review of: Joint Multitarget Detection and Tracking with mmWave Radar},
year = {2026},
howpublished = {\url{https://pith.science/paper/KD3ZWSDM}},
note = {Machine review of arXiv:2412.17211}
}
read the original abstract
Accurate targets detection and tracking with mmWave radar is a key sensing capability that will enable more intelligent systems, create smart, efficient, automated system. This paper proposes an end-to-end detection-estimation-track framework named MNOMP-SPA-KF consisting of the target detection and estimation module, the data association (DA) module and the target tracking module. In the target estimation and detection module, a low complexity, super-resolution and constant false alarm rate (CFAR) based two dimensional multisnapshot Newtonalized orthogonal matching pursuit (2D-MNOMP) is designed to extract the multitarget's radial distances and velocities, followed by the conventional (Bartlett) beamformer to extract the multitarget's azimuths. In the DA module, a sum product algorithm (SPA) is adopted to obtain the association probabilities of the existed targets and measurements by incorporating the radial velocity information. The Kalman filter (KF) is implemented to perform target tracking in the target tracking module by exploiting the asymptotic distribution of the estimators. To improve the detection probability of the weak targets, extrapolation is also coupled into the MNOMP-SPA-KF. Numerical and real data experiments demonstrate the effectiveness of the MNOMP-SPA-KF algorithm, compared to other benchmark algorithms.
Figures
Figures from the paper (14 more)
Forward citations
Cited by 2 Pith papers
-
mmFlux: Crowd Flow Analytics with Commodity mmWave MIMO Radar
mmFlux estimates a crowd flow field from commodity mmWave radar point clouds, reconstructs a directed graph of splits and merges, and uses divergence and curl to identify gatherings, dispersions, and turns.
-
Message Passing for Track-Before-Detect
A scalable belief-propagation track-before-detect method tracks multiple objects directly from correlated raw sensor data with fluctuating amplitudes and unknown noise, outperforming detect-then-track baselines.
Reference graph
Works this paper leans on
-
[1]
Design Guide: TIDEP-01000 People Tracking and Counting Reference Design Using mmWave Radar Sensor
-
[2]
Multiple-target tracking and track management for an FMCW radar network,
D. B. Kim, S. M. Hong, “Multiple-target tracking and track management for an FMCW radar network,” EURASIP J. Adv. Signal Process. , 2013
work page 2013
-
[3]
People Tracking and Counting Reference Design Using mmWave Radar Sensor
Texas Instrument, “People Tracking and Counting Reference Design Using mmWave Radar Sensor” [Online]. Available: https://www.ti.com/lit/ug/tidue71d/tidue71d.pdf
-
[4]
Create an Intelligent Building System: Use mmWave to Count and Track People
Texas Instrument, “Create an Intelligent Building System: Use mmWave to Count and Track People” [Online]. Available: https://www.ti.com.cn/cn/lit/ta/sszt725/sszt725.pdf
-
[5]
DFT-based estimation of damped oscillation parameters in low-frequency mechanical spectroscopy,
K. Duda, L. B. Magalas, M. Majewski, and T. P. Zielinski, “DFT-based estimation of damped oscillation parameters in low-frequency mechanical spectroscopy,” IEEE Trans. Instrum. Meas. , vol. 60, no. 11, pp. 3608-3618, 2011
work page 2011
-
[6]
M. A. Richards, Fundamentals of Radar Signal Processing , Second edition. New York: McGraw- Hill Education, 2014
work page 2014
-
[7]
Sensitivity of basis mismatch to compressed sensing,
Y . Chi, L. L. Scharf, A. Pezeshki and R. Calderbank, “Sensitivity of basis mismatch to compressed sensing,” IEEE Trans. Signal Process. , vol. 59, pp. 2182-2195, 2011
work page 2011
-
[8]
Variational Bayesian inference of line spectra,
M.-A. Badiu, T. L. Hansen, and B. H. Fleury, “Variational Bayesian inference of line spectra,” IEEE Trans. Signal Process., vol. 65, no. 9, pp. 2247-2261, 2017
work page 2017
Show all 34 references
-
[9]
Atomic norm denoising with applications to line spectral estimation,
B. N. Bhaskar, G. Tang, and B. Recht, “Atomic norm denoising with applications to line spectral estimation,” IEEE Trans. Signal Process. , vol. 61, no. 23, pp. 5987-5999, 2013. September 25, 2025 DRAFT 35
2013
-
[10]
Newtonized orthogonal matching pursuit: frequency estimation over the continuum,
B. Mamandipoor, D. Ramasamy, and U. Madhow, “Newtonized orthogonal matching pursuit: frequency estimation over the continuum,” IEEE Trans. Signal Process. , vol. 64, no. 19, pp. 5066- 5081, 2016
2016
-
[11]
CFAR based NOMP for line spectral estimation and detection
M. Xu, J. Zhu, J. Fang, N. Zhang and Z. Xu, “CFAR based NOMP for line spectral estimation and detection”, IEEE Trans. Aerosp. and Electron. Syst. , vol. 59, no. 5, pp. 6971-6990, 2023
2023
-
[12]
Challa, M
S. Challa, M. R. Morelande, D. Mu ˇsicki, and R. J. Evans, Fundamentals of Object Tracking, 2011, Cambridge, U.K.: Cambridge University Press
2011
-
[13]
An optimal tracking filter for processing sensor data of imprecisely determined origin in surveillance systems,
R. A. Singer and J. J. Stein, “An optimal tracking filter for processing sensor data of imprecisely determined origin in surveillance systems,” 1971 IEEE Conference on Decision and Control , pp. 171-175, 1971
1971
-
[14]
Tracking in a cluttered environment with probabilistic data association,
Y . Bar-Shalom and E. Tse, “Tracking in a cluttered environment with probabilistic data association,” Automatica, vol. 11, no. 3, pp. 451-460, 1975
1975
-
[15]
Sonar tracking of multiple targets using joint probabilistic data association,
T. Fortmann, Y . Bar-Shalom and M. Scheffe, “Sonar tracking of multiple targets using joint probabilistic data association,” IEEE J. Ocean. , vol. 8, no. 3, pp. 173-184, 1983
1983
-
[16]
trackerJPDA
MATLAB function “trackerJPDA”, available at https://jp.mathworks.com/help/fusion/ref/trackerjpda- system-object.html, 2024
2024
-
[17]
Density-based spatial clustering of applications with noise,
M. Ester, H.-P. Kriegel, J. Sander, and X. Xu, “Density-based spatial clustering of applications with noise,” in Proc. Int. Conf. Knowl. Discovery Data Mining , vol. 240, 1996, p.6
1996
-
[18]
Approximate evaluation of marginal association probabilities with belief propagation,
J. L. Williams and R. A. Lau, “Approximate evaluation of marginal association probabilities with belief propagation,” IEEE Trans. Aeros. and Electron. Syst. , vol. 50, no. 4, pp. 2942-2959, 2014
2014
-
[19]
A scalable algorithm for tracking an unknown number of targets using multiple sensors,
F. Meyer, P. Braca, P. Willett, and F. Hlawatsch, “A scalable algorithm for tracking an unknown number of targets using multiple sensors,” IEEE Trans. Signal Process. , vol. 65, no. 13, pp. 3478- 3493, 2017
2017
-
[20]
Message passing algorithms for scalable multitarget tracking,
F. Meyer et al., “Message passing algorithms for scalable multitarget tracking,” Proc. IEEE, vol. 106, no. 2, pp. 221-259, 2018
2018
-
[21]
Scalable detection and tracking of geometric extended objects
F. Meyer and J. L. Williams, “Scalable detection and tracking of geometric extended objects”, IEEE Trans. Signal Process., vol. 69, pp.6283-6298, 2021
2021
-
[22]
Self-tuning algorithms for multisensor-multitarget tracking using belief propagation
G. Soldi, F. Meyer, P. Braca, and F. Hlawatsch, “Self-tuning algorithms for multisensor-multitarget tracking using belief propagation”, IEEE Trans. Signal Process. , vol. 67, no. 15, pp. 3922-3937, 2019
2019
-
[23]
Neural enhanced belief propagation for multiobject tracking
M. Liang and F. Meyer, “Neural enhanced belief propagation for multiobject tracking”, IEEE Trans. Signal Process., vol. 72, pp. 15-30, 2024
2024
-
[24]
Introduction to mmwave Sensing: FMCW Radars
Texas Instrument, “Introduction to mmwave Sensing: FMCW Radars.” [Online]. Available: September 25, 2025 DRAFT 36 https://training.ti.com/sites/default/files/docs/mmwaveSensing-FMCW-offlineviewing 0.pdf
2025
-
[25]
Bar-Shalom, P
Y . Bar-Shalom, P. K. Willet and X. Tian, Tracking and Data Fusion , 2011, YBS Publishing
2011
-
[26]
S. M. Kay, Fundamentals of Statistical Signal Processing: Estimation Theory , 1993, Englewood Cliffs, NJ: Prentice Hall
1993
-
[27]
Max sum based data associations for tracking point and extended Targets,
W. Ma, Z. Jing, P. Dong and H. Leung, “Max sum based data associations for tracking point and extended Targets,” IEEE Trans. Aeros. and Electron. Syst. , doi: 10.1109/TAES.2024.3482287
2024
-
[28]
An introduction to factor graphs,
H.-A. Loeliger, “An introduction to factor graphs,” IEEE Signal Process. Mag. , vol. 21, no. 1, pp. 28-41, 2004
2004
-
[29]
Bar-Shalom, X
Y . Bar-Shalom, X. R. Li, and T. Kirubarajan, Estimation with applications to tracking and navigation: theory, algorithms and software , 2004, John Wiley & Sons
2004
-
[30]
The probabilistic data association filter,
Y . Bar-Shalom, F. Daum and J. Huang, “The probabilistic data association filter,” IEEE Control Systems Magazine, vol. 29, no. 6, pp. 82-100, 2009
2009
-
[31]
A metric for performance evaluation of multi-Target tracking algorithms,
B. Ristic, B. -N. V o, D. Clark and B. -T. V o, “A metric for performance evaluation of multi-Target tracking algorithms,” IEEE Trans. Signal Process. , vol. 59, no. 7, pp. 3452-3457, 2011
2011
-
[32]
S. M. Kay, Fundamentals of Statistical Signal Processing: Detection Theory , 1993, Englewood Cliffs, NJ: Prentice Hall
1993
-
[33]
Iovescu and S
C. Iovescu and S. Rao, The fundamentals of millimeter wave sensors, Texas Instruments, pages 1–8, 2017
2017
-
[34]
Huang, Indoor Localization and Mapping with 4D mmWave Imaging Radar, Master Thesis, available at https://www.ri.cmu.edu/app/uploads/2024/05/MSR thesis juite-1.pdf
J. Huang, Indoor Localization and Mapping with 4D mmWave Imaging Radar, Master Thesis, available at https://www.ri.cmu.edu/app/uploads/2024/05/MSR thesis juite-1.pdf. September 25, 2025 DRAFT
2024
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.