Dr-BA: Separable Optimization for Direct Radar Bundle Adjustment & Localization
Pith reviewed 2026-05-11 01:12 UTC · model grok-4.3
The pith
Dr-BA performs radar bundle adjustment directly on full intensity images by separating pose estimation from map construction.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Dr-BA formulates the radar bundle adjustment problem as a separable optimization that decouples the estimation of sensor poses from the recovery of dense maps built from full 2D spinning-radar intensity images. The same decoupled structure directly supports localization inside a pre-built map without any additional machinery. The method therefore avoids the information loss that occurs when radar data are first reduced to sparse point clouds.
What carries the argument
The separable optimization that decouples pose estimation from mapping, letting the full intensity images from multiple scans be used without point-cloud extraction.
If this is right
- Radar state estimation can retain dense information instead of discarding most returns during point-cloud conversion.
- The same code solves both mapping and cross-session localization without reformulation.
- Vehicle motion and scene structure can be recovered at higher density than sparse-feature approaches allow.
- All-weather navigation benefits because the method runs on a sensor that functions in precipitation.
Where Pith is reading between the lines
- The separability may allow incremental updates when new radar scans arrive, supporting online map maintenance.
- Dense maps produced by the method could be reused for radar-based object detection or terrain classification.
- The same decoupling principle might apply to other modalities that produce dense returns, such as sonar or certain thermal cameras.
Load-bearing premise
The separable formulation produces pose and map estimates whose accuracy matches what a single joint optimization would achieve while still using every intensity return.
What would settle it
On the same 200 km dataset, a non-separable joint optimizer produces measurably lower localization error than Dr-BA, or Dr-BA's errors exceed those of existing point-cloud radar methods.
Figures
read the original abstract
This paper introduces Dr-BA, a first-of-its-kind radar bundle adjustment (BA) framework that operates directly on 2D spinning radar intensity images. Unlike camera or lidar sensors, radar is largely unaffected by precipitation, making it a critical modality for autonomous systems that require all-weather robustness. Existing state estimation approaches using spinning radar typically extract sparse point clouds from range-azimuth-intensity measurements and apply point cloud alignment techniques to estimate vehicle motion, scene structure, or to localize within an existing map. In contrast, Dr-BA uses the full radar returns from multiple scans to jointly estimate dense maps and sensor poses. By formulating the problem as a separable optimization, we derive an efficient and general solution that decouples pose estimation from mapping. In addition to solving the BA problem, this formulation naturally extends to direct radar-only localization (DRL) within a previously built map. Dr-BA achieves state-of-the-art radar-based BA and cross-session localization performance, demonstrated on more than 200 km of on-road data across five distinct routes. Our implementation is publicly available at https://github.com/utiasASRL/dr_ba.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces Dr-BA, a separable optimization framework for direct radar bundle adjustment (BA) that operates on full 2D spinning radar intensity images rather than extracted point clouds. It jointly estimates dense maps and sensor poses, extends naturally to direct radar-only localization (DRL) in a pre-built map, and reports state-of-the-art radar-based BA and cross-session localization performance on more than 200 km of on-road data across five routes. The implementation is released publicly.
Significance. If the separable formulation maintains accuracy comparable to joint optimization while delivering efficiency gains and avoiding point-cloud extraction, the work would represent a meaningful advance for all-weather robust localization in robotics. The scale of the evaluation (200 km across multiple routes) and public code release are notable strengths that support reproducibility and practical impact.
major comments (2)
- [Separable optimization formulation (method section)] The central claim that the separable optimization preserves accuracy equivalent to a joint formulation over full intensity images (without point-cloud extraction) is load-bearing for the SOTA assertion but lacks direct validation. No comparison of residual norms, pose errors, or convergence behavior between the separable solver and a non-separable joint baseline on the same intensity data is provided, despite radar-specific correlations (multipath, speckle) that could violate the independence assumptions required for exact equivalence.
- [Experimental results (§5)] §5 (experimental results) and the abstract report SOTA performance on >200 km of data but provide no error bars, statistical significance tests, or ablation details on key design choices (e.g., separability impact, map density). This weakens the ability to assess whether the efficiency gains come at an accuracy cost that would affect the cross-session localization claims.
minor comments (2)
- [Abstract] The abstract states the method is 'first-of-its-kind' for direct radar BA on intensity images; a brief comparison table or sentence distinguishing it from prior radar point-cloud BA methods would improve clarity.
- [Method] Notation for the separable cost function and the mapping/pose variables could be introduced earlier with an explicit equation reference to aid readers following the decoupling argument.
Simulated Author's Rebuttal
We thank the referee for the thoughtful review and constructive suggestions. Below, we provide point-by-point responses to the major comments. We are committed to making the suggested revisions to strengthen the paper's claims regarding the separable optimization and experimental validation.
read point-by-point responses
-
Referee: [Separable optimization formulation (method section)] The central claim that the separable optimization preserves accuracy equivalent to a joint formulation over full intensity images (without point-cloud extraction) is load-bearing for the SOTA assertion but lacks direct validation. No comparison of residual norms, pose errors, or convergence behavior between the separable solver and a non-separable joint baseline on the same intensity data is provided, despite radar-specific correlations (multipath, speckle) that could violate the independence assumptions required for exact equivalence.
Authors: We appreciate the referee pointing out the need for direct empirical validation of the separable formulation. The derivation in Section 3 shows that the separable approach is mathematically equivalent to the joint optimization when solving for the map parameters analytically, assuming measurement independence. However, to rigorously address concerns about radar-specific effects such as multipath and speckle potentially affecting this equivalence, we will include a new subsection or appendix in the revised manuscript comparing the separable solver to a joint baseline on a representative subset of the data. This will report residual norms, pose errors, and convergence behavior to confirm no significant accuracy loss. revision: yes
-
Referee: [Experimental results (§5)] §5 (experimental results) and the abstract report SOTA performance on >200 km of data but provide no error bars, statistical significance tests, or ablation details on key design choices (e.g., separability impact, map density). This weakens the ability to assess whether the efficiency gains come at an accuracy cost that would affect the cross-session localization claims.
Authors: We agree that providing error bars, statistical tests, and ablations would improve the robustness of our experimental claims. In the revised version, we will augment Section 5 with error bars on all reported metrics (e.g., mean and standard deviation across routes), include p-values or significance tests for comparisons against baselines, and add ablations specifically on the effect of the separable formulation versus joint, as well as varying map density. These additions will help demonstrate that the efficiency gains do not compromise the accuracy needed for the cross-session localization results. revision: yes
Circularity Check
No significant circularity; separable formulation derived independently of performance claims
full rationale
The paper's core contribution is a mathematical formulation of separable optimization for direct radar BA that decouples pose and mapping variables, presented as a derivation from the problem structure rather than a fit to data or self-citation. Performance claims rest on empirical evaluation over 200 km of real-world radar data, not on any prediction that reduces to the inputs by construction. No equations, uniqueness theorems, or ansatzes are shown to loop back to the target result; the separability is introduced as a modeling choice whose accuracy equivalence is asserted but not derived tautologically. This is a standard non-circular engineering derivation.
Axiom & Free-Parameter Ledger
Reference graph
Works this paper leans on
-
[2]
Daniel Adolfsson, Mattias Karlsson, Vladim ´ir Kubelka, Martin Magnusson, and Henrik Andreasson. TBV Radar SLAM – Trust but Verify Loop Candidates.IEEE Robotics and Automation Letters (RA-L), 8(6):3613– 3620, 2023. doi: 10.1109/LRA.2023.3268040
-
[3]
Lilienthal, and Henrik Andreasson
Daniel Adolfsson, Martin Magnusson, Anas Alhashimi, Achim J. Lilienthal, and Henrik Andreasson. Lidar-Level Localization With Radar? The CFEAR Approach to Accurate, Fast, and Robust Large-Scale Radar Odometry in Diverse Environments.IEEE Trans. on Robotics (TRO), 39(2):1476–1495, 2023. doi: 10.1109/TRO.2022. 3221302
-
[4]
Cambridge University Press, 2024
Timothy D Barfoot.State Estimation for Robotics. Cambridge University Press, 2024
work page 2024
-
[5]
Masking by Moving: Learning Distraction-Free Radar Odometry from Pose Information
Dan Barnes, Rob Weston, and Ingmar Posner. Masking by Moving: Learning Distraction-Free Radar Odometry from Pose Information. InConf. Robot Learn., 2019. URL https://arxiv.org/pdf/1909.03752
-
[6]
Keenan Burnett, Yuchen Wu, David J Yoon, Angela P Schoellig, and Timothy D Barfoot. Are We Ready for Radar to Replace Lidar in All-weather Mapping and Localization?IEEE Robotics and Automation Letters (RA-L), 7(4):10328–10335, 2022
work page 2022
-
[7]
Boreas: A Multi-Season Autonomous Driving Dataset , url =
Keenan Burnett, David J Yoon, Yuchen Wu, Andrew Z Li, Haowei Zhang, Shichen Lu, Jingxing Qian, Wei-Kang Tseng, Andrew Lambert, Keith YK Leung, Angela P Schoellig, and Timothy D Barfoot. Boreas: A Multi- season Autonomous Driving Dataset.Int. J. Robot. Res., 42(1-2):33–42, 2023. doi: 10.1177/02783649231160195
-
[8]
Keenan Burnett, Angela P. Schoellig, and Timothy D. Barfoot. Continuous-Time Radar-Inertial and Lidar- Inertial Odometry Using a Gaussian Process Motion Prior.IEEE Trans. on Robotics (TRO), 41:1059–1076, January 2025. ISSN 1552-3098. doi: 10.1109/TRO.2024. 3521856
-
[9]
Radar SLAM Using Visual Features.EURASIP Journal on Advances in Signal Processing, 2011, 12 2011
Jonas Callmer, David T ¨ornqvist, Fredrik Gustafsson, Henrik Svensson, and Pelle Carlbom. Radar SLAM Using Visual Features.EURASIP Journal on Advances in Signal Processing, 2011, 12 2011. doi: 10.1186/ 1687-6180-2011-71
work page 2011
-
[10]
Precise Ego-Motion Estimation with Millimeter-Wave Radar Under Diverse and Challenging Conditions
Sarah Cen and Paul Newman. Precise Ego-Motion Estimation with Millimeter-Wave Radar Under Diverse and Challenging Conditions. InProc. of the IEEE Intl. Conf. on Robotics & Automation (ICRA), pages 1–8, 05 2018. doi: 10.1109/ICRA.2018.8460687
-
[11]
Radar Scan Matching SLAM Using the Fourier-Mellin Transform
Paul Checchin, Franck G ´erossier, Christophe Blanc, Roland Chapuis, and Laurent Trassoudaine. Radar Scan Matching SLAM Using the Fourier-Mellin Transform. In Field and Service Robotics: Results of the 7th Interna- tional Conference, pages 151–161. Springer, 2010
work page 2010
-
[12]
M.W.M.G. Dissanayake, P. Newman, S. Clark, H.F. Durrant-Whyte, and M. Csorba. A Solution to the Simultaneous Localization and Map Building (SLAM) Problem.IEEE Trans. on Robotics and Automation, 17 (3):229–241, 2001. doi: 10.1109/70.938381
-
[13]
Paul Furgale and Timothy D Barfoot. Visual Teach and Repeat for Long-range Rover Autonomy.Journal of Field Robotics (JFR), 27(5):534–560, 2010
work page 2010
-
[14]
Gene Golub and Victor Pereyra. Separable Nonlinear Least Squares: the Variable Projection Method and its Applications.Inverse Problems, 19:R1–R26(1), 01 2003
work page 2003
-
[15]
G.H. Golub and Victor Pereyra. The Differentiation of Pseudo-Inverses and Nonlinear Least Squares Problems Whose Variables Separate.SIAM Journal on Numerical Analysis, 10:413–432, 04 1973. doi: 10.1137/0710036
-
[16]
A New Wave in Robotics: Survey on Recent mmWave Radar Applications in Robotics , url =
Kyle Harlow, Hyesu Jang, Timothy D. Barfoot, Ay- oung Kim, and Christoffer Heckman. A New Wave in Robotics: Survey on Recent MmWave Radar Applica- tions in Robotics.IEEE Trans. on Robotics (TRO), 40: 4544–4560, 2024. doi: 10.1109/TRO.2024.3463504
-
[17]
M2DP: A Novel 3D Point Cloud Descriptor and its Application in Loop Closure Detection
Li He, Xiaolong Wang, and Hong Zhang. M2DP: A Novel 3D Point Cloud Descriptor and its Application in Loop Closure Detection. InProc. of the IEEE/RSJ Intl. Conf. on Intelligent Robots and Systems (IROS), pages 231–237, 2016. doi: 10.1109/IROS.2016.7759060
-
[18]
Large scale place recognition in 2D LIDAR scans using Geometrical Land- mark Relations
Marian Himstedt, Jan Frost, Sven Hellbach, Hans- Joachim B ¨ohme, and Erik Maehle. Large scale place recognition in 2D LIDAR scans using Geometrical Land- mark Relations. InProc. of the IEEE/RSJ Intl. Conf. on Intelligent Robots and Systems (IROS), pages 5030–5035,
-
[19]
doi: 10.1109/IROS.2014.6943277
-
[20]
Real-Time Pose Graph SLAM based on Radar
Martin Holder, Sven Hellwig, and Hermann Winner. Real-Time Pose Graph SLAM based on Radar. In2019 IEEE Intelligent V ehicles Symposium (IV), pages 1145– 1151, 2019. doi: 10.1109/IVS.2019.8813841
-
[21]
Connor Holmes and Timothy D. Barfoot. An Effi- cient Global Optimality Certificate for Landmark-Based SLAM.IEEE Robotics and Automation Letters, 8(3): 1539–1546, 2023. doi: 10.1109/LRA.2023.3238173
-
[22]
RadarSLAM: A Robust Simultaneous Localiza- tion and Mapping System for All Weather Conditions
Ziyang Hong, Yvan Petillot, Andrew Wallace, and Sen Wang. RadarSLAM: A Robust Simultaneous Localiza- tion and Mapping System for All Weather Conditions. Intl. Journal of Robotics Research (IJRR), 41(5):519– 542, 2022. doi: 10.1177/02783649221080483
-
[23]
RaPlace: Place Recognition for Imaging Radar using Radon Trans- form and Mutable Threshold
Hyesu Jang, Minwoo Jung, and Ayoung Kim. RaPlace: Place Recognition for Imaging Radar using Radon Trans- form and Mutable Threshold. InProc. of the IEEE/RSJ Intl. Conf. on Intelligent Robots and Systems (IROS), pages 11194–11201, 2023. doi: 10.1109/IROS55552. 2023.10341883
-
[24]
Hyesu Jang, Wooseong Yang, Ayoung Kim, Dongje Lee, and Hanguen Kim. XPRESS: X-Band Radar Place Recognition via Elliptical Scan Shaping.IEEE Robotics and Automation Letters, 10(12):13121–13128, 2025
work page 2025
-
[25]
Giseop Kim, Sunwook Choi, and Ayoung Kim. Scan Context++: Structural Place Recognition Robust to Rota- tion and Lateral Variations in Urban Environments.IEEE Trans. on Robotics (TRO), 38(3):1856–1874, 2022. doi: 10.1109/TRO.2021.3116424
-
[26]
Parallel Tracking and Mapping for Small AR Workspaces
Georg Klein and David Murray. Parallel Tracking and Mapping for Small AR Workspaces. InProc. Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’07), Nara, Japan, November 2007
work page 2007
-
[27]
Pou-Chun Kung, C. Wang, and Wen-Chieh Lin. A Normal Distribution Transform-Based Radar Odometry Designed For Scanning and Automotive Radars.Proc. of the IEEE Intl. Conf. on Robotics & Automation (ICRA), pages 14417–14423, 2021
work page 2021
-
[28]
Cedric Le Gentil, Leonardo Brizi, Daniil Lisus, Xinyuan Qiao, Giorgio Grisetti, and Timothy D. Barfoot. DRO: Doppler-Aware Direct Radar Odometry. InProc. of Robotics: Science and Systems (RSS), 2025
work page 2025
-
[29]
Cedric Le Gentil, Raphael Falque, Daniil Lisus, and Timothy D. Barfoot. 2FAST-2LAMAA: Large-Scale Lidar-Inertial Localization and Mapping with Continuous Distance Fields, 2025. URL https://arxiv.org/abs/2410. 05433
work page 2025
-
[30]
Cedric Le Gentil, Weican Li, Leonardo Brizi, and Tim- othy D. Barfoot. Dr-PoGO: Direct Radar Pose-Graph Optimization. InProc. of the IEEE Intl. Conf. on Robotics & Automation (ICRA), 2026
work page 2026
-
[31]
ORORA: Outlier-robust Radar Odometry
Hyungtae Lim, Kawon Han, Gunhee Shin, Giseop Kim, Songcheol Hong, and Hyun Myung. ORORA: Outlier-robust Radar Odometry. InProc. of the IEEE Intl. Conf. on Robotics & Automation (ICRA), pages 2046–2053, 2023
work page 2046
-
[32]
Yoon, Richard Poulton, John Marshall, and Timothy D
Daniil Lisus, Keenan Burnett, David J. Yoon, Richard Poulton, John Marshall, and Timothy D. Barfoot. Are Doppler Velocity Measurements Useful for Spinning Radar Odometry?IEEE Robotics and Automation Letters (RA-L), 10(1):224–231, 2025. doi: 10.1109/LRA.2024. 3505821
-
[33]
Papais, Cedric Le Gentil, Elliot Preston-Krebs, Andrew Lambert, Keith Y
Daniil Lisus, Katya M. Papais, Cedric Le Gentil, Elliot Preston-Krebs, Andrew Lambert, Keith Y . K. Leung, and Timothy D. Barfoot. Boreas Road Trip: A Multi-Sensor Autonomous Driving Dataset on Challenging Roads,
- [34]
-
[35]
David G. Lowe. Distinctive Image Features from Scale- Invariant Keypoints.Intl. Journal of Computer Vision (IJCV), 60(2):91–110, November 2004
work page 2004
-
[36]
Zhehua Mao, Liang Zhao, Shoudong Huang, Yiting Fan, and Alex P. W. Lee. DSR: Direct Simultaneous Registration for Multiple 3D Images. InMedical Image Computing and Computer Assisted Intervention – MIC- CAI 2022, pages 98–107, 2022
work page 2022
-
[37]
Alan Papalia, Nikolas Sanderson, Haoyu Han, Heng Yang, Hanumant Singh, and Michael Everett. Sparse Variable Projection in Robotic Perception: Exploiting Separable Structure for Efficient Nonlinear Optimization,
- [38]
-
[39]
Yeong Sang Park, Young-Sik Shin, and Ayoung Kim. PhaRaO: Direct Radar Odometry using Phase Corre- lation. InProc. of the IEEE Intl. Conf. on Robotics & Automation (ICRA), pages 2617–2623, 2020. doi: 10.1109/ICRA40945.2020.9197231
- [40]
-
[41]
Arthur Venon, Yohan Dupuis, Pascal Vasseur, and Pierre Merriaux. Millimeter Wave FMCW RADARs for Percep- tion, Recognition and Localization in Automotive Appli- cations: A Survey.IEEE Trans. on Intelligent V ehicles (T-IV), 7:1–1, 09 2022. doi: 10.1109/TIV .2022.3167733. SUPPLEMENTARYMATERIAL A. DETAILEDSEQUENCEVISUALS A. Suburbs 500 m Fig. A.1: Sparsity ...
work page doi:10.1109/tiv 2022
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.