INSANE: Cross-Domain UAV Data Sets with Increased Number of Sensors for developing Advanced and Novel Estimators
Pith reviewed 2026-05-24 11:02 UTC · model grok-4.3
The pith
The INSANE data sets supply MAV trajectories across indoor, transitional, and Mars-analog environments with multiple IMUs, cameras, and dual-RTK ground truth for localization research.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The INSANE data sets provide MAV recordings that span controlled indoor motion-capture trajectories, outdoor-to-building transitions requiring modality switches, and purely outdoor flights in a Mars-analog setting; each set supplies raw data from multiple IMUs and cameras together with a high-rate IMU for vibration capture and highly accurate ground truth obtained via dual RTK GNSS at sub-degree and centimeter level.
What carries the argument
The INSANE data sets, which bundle raw multi-IMU and camera measurements with dual-RTK GNSS ground truth across graded environmental scenarios.
If this is right
- Localization estimators can be tested on trajectories that force repeated changes between sensor modalities.
- The high-rate IMU recordings enable training of machine-learning methods that reduce vibration-induced errors in inertial data.
- Cross-environment data sets allow direct comparison of estimator performance from fully controlled indoor settings to Mars-analog outdoor conditions.
- Raw sensor outputs support development of sensor-fusion pipelines that must handle realistic dynamics and noise without pre-filtering.
- Availability of the data sets with post-processing tools makes results from different research groups directly comparable.
Where Pith is reading between the lines
- Navigation algorithms developed on these sets could be transferred more readily to future planetary rotorcraft that must operate without reliable GNSS.
- The multi-IMU configuration may expose whether estimator robustness improves simply by adding redundant inertial channels.
- The graded difficulty levels could serve as a benchmark ladder for measuring incremental progress in cross-domain localization.
- Vibration-focused recordings open the possibility of studying how structural resonances of specific airframes affect particular estimator architectures.
Load-bearing premise
The dual RTK GNSS setup actually delivers the stated centimeter and sub-degree accuracy under the outdoor flight conditions described, and the raw sensor streams faithfully contain the real vibration and noise effects present in flight.
What would settle it
An independent high-precision positioning system run in parallel on one outdoor flight whose positions differ from the published dual-RTK ground truth by more than the claimed 1-sigma bounds.
Figures
read the original abstract
For real-world applications, autonomous mobile robotic platforms must be capable of navigating safely in a multitude of different and dynamic environments with accurate and robust localization being a key prerequisite. To support further research in this domain, we present the INSANE data sets - a collection of versatile Micro Aerial Vehicle (MAV) data sets for cross-environment localization. The data sets provide various scenarios with multiple stages of difficulty for localization methods. These scenarios range from trajectories in the controlled environment of an indoor motion capture facility, to experiments where the vehicle performs an outdoor maneuver and transitions into a building, requiring changes of sensor modalities, up to purely outdoor flight maneuvers in a challenging Mars analog environment to simulate scenarios which current and future Mars helicopters would need to perform. The presented work aims to provide data that reflects real-world scenarios and sensor effects. The extensive sensor suite includes various sensor categories, including multiple Inertial Measurement Units (IMUs) and cameras. Sensor data is made available as raw measurements and each data set provides highly accurate ground truth, including the outdoor experiments where a dual Real-Time Kinematic (RTK) Global Navigation Satellite System (GNSS) setup provides sub-degree and centimeter accuracy (1-sigma). The sensor suite also includes a dedicated high-rate IMU to capture all the vibration dynamics of the vehicle during flight to support research on novel machine learning-based sensor signal enhancement methods for improved localization. The data sets and post-processing tools are available at: https://sst.aau.at/cns/datasets
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript presents the INSANE collection of MAV flight datasets spanning controlled indoor motion-capture trajectories, indoor-to-outdoor transitions, and purely outdoor flights in a Mars-analog environment. Each release supplies raw multi-IMU (including a dedicated high-rate unit), camera, and auxiliary sensor streams together with ground-truth poses, the latter obtained from motion capture indoors and a dual-RTK GNSS configuration outdoors that is stated to deliver centimeter-level position and sub-degree attitude accuracy (1-sigma). Post-processing tools and the data are made available at a public URL.
Significance. If the released raw measurements accurately reflect real-world vibration and sensor effects and the claimed ground-truth accuracy is substantiated, the datasets would constitute a useful public resource for cross-domain localization benchmarking and for the development of vibration-aware or learning-based estimators.
major comments (1)
- [Abstract] Abstract: the claim that the dual-RTK GNSS setup 'provides sub-degree and centimeter accuracy (1-sigma)' for the outdoor experiments is asserted without any supporting error statistics, residual plots, covariance traces, or cross-validation against motion-capture data on transition flights. Because this accuracy figure is central to the assertion of 'highly accurate ground truth' usable for localization benchmarking, the absence of empirical validation is load-bearing.
minor comments (2)
- The manuscript would benefit from an explicit table listing, for each dataset, the exact sensor models, sampling rates, and ground-truth source, together with the duration and environment label.
- The public URL should be accompanied by a permanent identifier (e.g., DOI or Zenodo record) to ensure long-term accessibility of the data and tools.
Simulated Author's Rebuttal
We thank the referee for the constructive review. The single major comment identifies a clear gap in empirical support for the claimed RTK accuracy. We address it directly below and will revise the manuscript accordingly.
read point-by-point responses
-
Referee: [Abstract] Abstract: the claim that the dual-RTK GNSS setup 'provides sub-degree and centimeter accuracy (1-sigma)' for the outdoor experiments is asserted without any supporting error statistics, residual plots, covariance traces, or cross-validation against motion-capture data on transition flights. Because this accuracy figure is central to the assertion of 'highly accurate ground truth' usable for localization benchmarking, the absence of empirical validation is load-bearing.
Authors: We agree that the abstract states the dual-RTK accuracy figure without accompanying validation data or plots. This constitutes a substantive omission for a dataset paper whose primary value rests on the quality of the ground truth. In the revision we will (1) add a dedicated subsection or appendix presenting RTK residual statistics, covariance traces, and position/attitude error histograms from the outdoor flights; (2) include any available cross-checks on the indoor-to-outdoor transition sequences (e.g., short periods where both motion-capture and RTK are simultaneously available); and (3) tone the abstract claim to reflect only what the new empirical material supports. We will also make the raw RTK solution files and processing scripts available so readers can reproduce the accuracy assessment. revision: yes
Circularity Check
No derivation chain; data-release paper with no predictions or fitted results
full rationale
The manuscript is a dataset release describing MAV trajectories, sensor suites (multiple IMUs, cameras, high-rate IMU), and ground-truth sources (motion capture indoors, dual RTK GNSS outdoors). It contains no equations, no parameter fitting, no predictions, and no derivation steps that could reduce to inputs by construction. The accuracy statement for RTK GNSS is an assertion about the collection setup rather than the output of any internal model or self-citation chain. No patterns from the enumerated circularity kinds are present.
Axiom & Free-Parameter Ledger
Reference graph
Works this paper leans on
-
[1]
Data collected with package delivery quadcopter drone,
T. A. Rodrigues, J. Patrikar, A. Choudhry, J. Feldgoise, V . Arcot, A. Gahlaut, S. Lau, B. Moon, B. Wagner, H. S. Matthews, S. Scherer, and C. Samaras, “Data collected with package delivery quadcopter drone,” 2021. [Online]. Available: https://kilthub.cmu.edu/articles/dataset/Data Collected with Package Delivery Quadcopter Drone/12683453/1
-
[2]
Relatively lazy: Indoor-outdoor navigation using vision and GNSS,
B. Congram and T. D. Barfoot, “Relatively lazy: Indoor-outdoor navigation using vision and GNSS,” in 2021 18th Conference on Robots and Vision (CRV) . IEEE, May 2021, pp. 1–8. [Online]. Available: https://doi.org/10.1109/crv52889.2021.00015
-
[3]
Long-duration autonomy for small rotorcraft UAS including recharging,
C. Brommer, D. Malyuta, D. Hentzen, and R. Brockers, “Long-duration autonomy for small rotorcraft UAS including recharging,” in 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, Oct. 2018, pp. 7252–7258. [Online]. Available: https://ieeexplore.ieee.org/document/8594111
-
[4]
A. Fornasier, M. Scheiber, A. Hardt-Stremayr, R. Jung, and S. Weiss, “VINSEval: Evaluation Framework for Unified Testing of Consistency and Robustness of Visual-Inertial Navigation System Algorithms,” in 2021 IEEE International Conference on Robotics and Automation (ICRA) , 2021, pp. 13 754–13 760. [Online]. Available: https://doi.org/10.1109/icra48506.202...
-
[5]
TartanAir: A dataset to push the limits of visual SLAM,
W. Wang, D. Zhu, X. Wang, Y . Hu, Y . Qiu, C. Wang, Y . Hu, A. Kapoor, and S. Scherer, “TartanAir: A dataset to push the limits of visual SLAM,” in 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) . IEEE, Oct. 2020, pp. 4909–4916. [Online]. Available: https://doi.org/10.1109/iros45743.2020.9341801
-
[6]
A. Antonini, W. Guerra, V . Murali, T. Sayre-McCord, and S. Karaman, “The blackbird UA V dataset,” The International Journal of Robotics Research, vol. 39, no. 10-11, pp. 1346–1364, Mar. 2020. [Online]. Available: https://doi.org/10.1177/0278364920908331 9OeWF - AMADEE20 BROMMER et al.: INSANE: CROSS-DOMAIN UA V DATA SETS 19
-
[7]
Vision meets robotics: The KITTI dataset,
A. Geiger, P. Lenz, C. Stiller, and R. Urtasun, “Vision meets robotics: The KITTI dataset,” The International Journal of Robotics Research , vol. 32, no. 11, pp. 1231–1237, Aug. 2013. [Online]. Available: https://doi.org/10.1177/0278364913491297
-
[8]
1 year, 1000 km: The oxford RobotCar dataset,
W. Maddern, G. Pascoe, C. Linegar, and P. Newman, “1 year, 1000 km: The oxford RobotCar dataset,” The International Journal of Robotics Research, vol. 36, no. 1, pp. 3–15, Nov. 2016. [Online]. Available: https://doi.org/10.1177/0278364916679498
-
[9]
Real-time kinematic ground truth for the oxford robotcar dataset,
W. Maddern, G. Pascoe, M. Gadd, D. Barnes, B. Yeomans, and P. Newman, “Real-time kinematic ground truth for the oxford robotcar dataset,” 2020. [Online]. Available: https://arxiv.org/abs/2002.10152
-
[10]
The rosario dataset: Multisensor data for localization and mapping in agricultural environments,
T. Pire, M. Mujica, J. Civera, and E. Kofman, “The rosario dataset: Multisensor data for localization and mapping in agricultural environments,” The International Journal of Robotics Research , vol. 38, no. 6, pp. 633–641, 2019. [Online]. Available: https: //doi.org/10.1177/0278364919841437
-
[11]
Image-based localization using lstms for structured feature correlation,
F. Walch, C. Hazirbas, L. Leal-Taixe, T. Sattler, S. Hilsenbeck, and D. Cremers, “Image-based localization using lstms for structured feature correlation,” in 2017 IEEE International Conference on Computer Vision (ICCV) , October 2017, pp. 627–637. [Online]. Available: https://doi.org/10.1109/iccv.2017.75
-
[12]
A large-scale dataset for indoor visual localization with high-precision ground truth,
Y . Liu, W. Gao, and Z. Hu, “A large-scale dataset for indoor visual localization with high-precision ground truth,” The International Journal of Robotics Research , vol. 41, no. 2, pp. 129–135, Oct. 2021. [Online]. Available: https://doi.org/10.1177/02783649211052064
-
[13]
Large- scale Localization Datasets in Crowded Indoor Spaces,
D. Lee, S. Ryu, S. Yeon, Y . Lee, D. Kim, C. Han, Y . Cabon, P. Weinzaepfel, N. Gu ´erin, G. Csurka, and M. Humenberger, “Large- scale Localization Datasets in Crowded Indoor Spaces,” 2021. [Online]. Available: https://arxiv.org/abs/2105.08941
-
[14]
PennCOSYVIO: A challenging Visual Inertial Odometry benchmark,
B. Pfrommer, N. Sanket, K. Daniilidis, and J. Cleveland, “PennCOSYVIO: A challenging Visual Inertial Odometry benchmark,” Proceedings - IEEE International Conference on Robotics and Automation , pp. 3847–3854, 2017. [Online]. Available: https://doi.org/10.1109/icra.2017.7989443
-
[15]
The TUM VI Benchmark for Evaluating Visual- Inertial Odometry,
D. Schubert, T. Goll, N. Demmel, V . Usenko, J. Stuckler, and D. Cremers, “The TUM VI Benchmark for Evaluating Visual- Inertial Odometry,” IEEE International Conference on Intelligent Robots and Systems , pp. 1680–1687, 2018. [Online]. Available: https://doi.org/10.1109/iros.2018.8593419
-
[16]
The EuRoC micro aerial vehicle datasets,
M. Burri, J. Nikolic, P. Gohl, T. Schneider, J. Rehder, S. Omari, M. W. Achtelik, and R. Siegwart, “The EuRoC micro aerial vehicle datasets,” The International Journal of Robotics Research , vol. 35, no. 10, pp. 1157–1163, Jan. 2016. [Online]. Available: https://doi.org/10.1177/0278364915620033
-
[17]
Are we ready for autonomous drone racing? the uzh-fpv drone racing dataset,
J. Delmerico, T. Cieslewski, H. Rebecq, M. Faessler, and D. Scaramuzza, “Are we ready for autonomous drone racing? the uzh-fpv drone racing dataset,” in 2019 International Conference on Robotics and Automation (ICRA) , 2019, pp. 6713–6719. [Online]. Available: https://doi.org/10.1109/icra.2019.8793887
-
[18]
The MADMAX data set for visual-inertial rover navigation on Mars,
L. Meyer, M. Sm ´ıˇsek, A. Fontan Villacampa, L. Oliva Maza, D. Medina, M. J. Schuster, F. Steidle, M. Vayugundla, M. G. M ¨uller, B. Rebele, A. Wedler, and R. Triebel, “The MADMAX data set for visual-inertial rover navigation on Mars,” Journal of Field Robotics, vol. 38, no. 6, pp. 833–853, 2021. [Online]. Available: https://doi.org/10.1002/rob.22016
-
[19]
Flight stack for reproducible and customizable autonomy applications in research and industry,
M. Scheiber, A. Fornasier, R. Jung, C. B ¨ohm, R. Dhakate, C. Stewart, J. Steinbrener, S. Weiss, and C. Brommer, “Flight stack for reproducible and customizable autonomy applications in research and industry,” IEEE Robotics and Automation Letters, vol. 7, no. 4, pp. 11 283–11 290,
-
[20]
Available: https://ieeexplore.ieee.org/document/9849131
[Online]. Available: https://ieeexplore.ieee.org/document/9849131
-
[21]
Skiffos: Minimal cross-compiled linux for embedded containers,
C. Stewart, “Skiffos: Minimal cross-compiled linux for embedded containers,” 2021. [Online]. Available: https://arxiv.org/abs/2104.00048
-
[22]
J. Steinbrener, C. Brommer, T. Jantos, A. Fornasier, and S. Weiss, “Im- proved State Propagation through AI-based Pre-processing and Down- sampling of High-Speed Inertial Data,” 2022 International Conference on Robotics and Automation (ICRA) , pp. 1–8, 2022
work page 2022
-
[23]
Allan Variance: Noise Analysis for Gyroscopes,
Freescale, “Allan Variance: Noise Analysis for Gyroscopes,” Freescale white paper, p. 9, 2015. [Online]. Available: http://cache.freescale.com/ files/sensors/doc/app note/AN5087.pdf
work page 2015
-
[24]
Geometric approach to strapdown magnetometer calibration in sensor frame,
J. F. Vasconcelos, G. Elkaim, C. Silvestre, P. Oliveira, and B. Cardeira, “Geometric approach to strapdown magnetometer calibration in sensor frame,” IEEE Transactions on Aerospace and Electronic Systems, vol. 47, no. 2, pp. 1293–1306, 2011. [Online]. Available: https://doi.org/10.1109/taes.2011.5751259
-
[25]
A Fast and Accurate Accelerometer and Magnetometer Alignment Algorithm,
K. Papafotis and P. P. Sotiriadis, “A Fast and Accurate Accelerometer and Magnetometer Alignment Algorithm,” IEEE Sensors Journal , vol. 20, no. 24, pp. 15 061–15 067, Dec. 2020. [Online]. Available: https://doi.org/10.1109/jsen.2020.3011579
-
[26]
Improved state estimation in distorted magnetic fields,
C. Brommer, C. B ¨ohm, J. Steinbrener, R. Brockers, and S. Weiss, “Improved state estimation in distorted magnetic fields,” in 2020 International Conference on Unmanned Aircraft Systems (ICUAS) . IEEE, Sep. 2020, pp. 1007–1013. [Online]. Available: https://doi.org/ 10.1109/icuas48674.2020.9213913
-
[27]
Extending kalibr: Calibrating the extrinsics of multiple IMUs and of individual axes,
J. Rehder, J. Nikolic, T. Schneider, T. Hinzmann, and R. Siegwart, “Extending kalibr: Calibrating the extrinsics of multiple IMUs and of individual axes,” Proceedings - IEEE International Conference on Robotics and Automation , vol. 2016-June, pp. 4304–4311, 2016. [Online]. Available: https://doi.org/10.1109/icra.2016.7487628
-
[28]
Vision-based navigation for the NASA mars helicopter,
D. S. Bayard, D. T. Conway, R. Brockers, J. H. Delaune, L. H. Matthies, H. F. Grip, G. B. Merewether, T. L. Brown, and A. M. S. Martin, “Vision-based navigation for the NASA mars helicopter,” in AIAA Scitech 2019 Forum . American Institute of Aeronautics and Astronautics, Jan. 2019, p. 1411. [Online]. Available: https://doi.org/10.2514/6.2019-1411
-
[29]
Flight control system for NASA's mars helicopter,
H. F. Grip, J. Lam, D. Bayard, D. T. Conway, G. Singh, R. Brockers, J. H. Delaune, L. H. Matthies, C. Malpica, T. L. Brown, A. Jain, A. M. S. Martin, and G. B. Merewether, “Flight control system for NASA's mars helicopter,” in AIAA Scitech 2019 Forum . American Institute of Aeronautics and Astronautics, Jan. 2019, pp. 1–20. [Online]. Available: https://do...
-
[30]
H.-n. Lin, C.-c. Lu, H.-Y . Tsai, and T.-W. Kung, “The Analysis of EMI Noise Coupling Mechanism for GPS Reception Performance Degrada- tion from SSD / USB Module,” IEICW, pp. 350–353, 2014
work page 2014
-
[31]
Generation of fiducial marker dictionaries using Mixed Integer Linear Programming,
S. Garrido-Jurado, R. Mu ˜noz-Salinas, F. J. Madrid-Cuevas, and R. Medina-Carnicer, “Generation of fiducial marker dictionaries using Mixed Integer Linear Programming,” Pattern Recognition, vol. 51, pp. 481–491, 2016. [Online]. Available: https://doi.org/10.1016/j.patcog. 2015.09.023
-
[32]
Ionet: Learning to cure the curse of drift in inertial odometry,
C. Chen, X. Lu, A. Markham, and N. Trigoni, “Ionet: Learning to cure the curse of drift in inertial odometry,” Proceedings of the AAAI Conference on Artificial Intelligence , vol. 32, Apr. 2018. [Online]. Available: https://doi.org/10.1609/aaai.v32i1.12102
-
[33]
A least squares estimate of satellite attitude,
G. Wahba, “A least squares estimate of satellite attitude,” SIAM Review, vol. 7, no. 3, pp. 409–409, Jul. 1965. [Online]. Available: https://doi.org/10.1137/1007077
-
[34]
Least-squares rigid motion using svd,
O. Sorkine-Hornung and M. Rabinovich, “Least-squares rigid motion using svd,” Computing, vol. 1, no. 1, pp. 1–5, 2017
work page 2017
-
[35]
MaRS: A modular and robust sensor-fusion framework,
C. Brommer, R. Jung, J. Steinbrener, and S. Weiss, “MaRS: A modular and robust sensor-fusion framework,” IEEE Robotics and Automation Letters, vol. 6, no. 2, pp. 359–366, Apr. 2021. [Online]. Available: https://ieeexplore.ieee.org/document/9286578
-
[36]
OpenVINS: A research platform for visual-inertial estimation,
P. Geneva, K. Eckenhoff, W. Lee, Y . Yang, and G. Huang, “OpenVINS: A research platform for visual-inertial estimation,” in 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France, 2020, pp. 4666–4672. [Online]. Available: https://github.com/rpng/open vins
work page 2020
-
[37]
Least-squares estimation of transformation parameters between two point patterns,
S. Umeyama, “Least-squares estimation of transformation parameters between two point patterns,” IEEE Transactions on Pattern Analysis and Machine Intelligence , vol. 13, no. 4, pp. 376–380, Apr. 1991. [Online]. Available: https://doi.org/10.1109/34.88573
-
[38]
A tutorial on quantitative trajectory eval- uation for visual(-inertial) odometry,
Z. Zhang and D. Scaramuzza, “A tutorial on quantitative trajectory eval- uation for visual(-inertial) odometry,” in 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , 2018, pp. 7244– 7251
work page 2018
-
[39]
A. Hardt-Stremayr and S. Weiss, “Monocular visual-inertial odometry in low-textured environments with smooth gradients: A fully dense direct filtering approach,” in 2020 IEEE International Conference on Robotics and Automation (ICRA) . IEEE, May 2020, pp. 7837–7843. [Online]. Available: https://doi.org/10.1109/icra40945.2020.9196881 20 <xyz>_experiment_dat...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.