Catheter Monitoring in Intelligent Endovascular Navigation Systems: Interactive Simulations and Mixed Reality for Enhanced Navigational Awareness
Pith reviewed 2026-05-08 10:35 UTC · model grok-4.3
The pith
Integrating real-time sensor data with finite element simulations and mixed reality enables continuous monitoring of catheter-vessel interactions during endovascular navigation.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The study demonstrates the feasibility of integrating interactive biomechanical simulation with real-time sensor data to enable continuous monitoring of catheter-vessel interactions, with mixed reality visualization serving as a user interface to support operator decision-making. In-vitro validation on a sensorized catheter advanced through a silicone replica showed simulated time exceeding real time by 12 percent initially and 45 percent in tortuous sections, stable rendering at 35-40 frames per second, and median relative displacement errors remaining below 1 mm and 2.33 mm respectively.
What carries the argument
Finite element model of the venous pathway with Lagrange multiplier contact formulation, driven by Fiber Bragg Grating and electromagnetic sensor read-outs and rendered in mixed reality.
If this is right
- Operators receive visual cues on vessel deformation that are unavailable from standard fluoroscopy alone.
- The simulation updates fast enough to remain interactive even through complex vessel paths.
- Accuracy sufficient for monitoring is achieved when validated against stereo-camera ground truth.
- Mixed reality serves as a stable interface at 35-40 frames per second for decision support.
Where Pith is reading between the lines
- The same sensor-to-simulation pipeline could be adapted to monitor other flexible instruments such as guidewires or endoscopes.
- Future versions might incorporate predictive elements to warn of impending high-stress contacts before they occur.
- If deployed in the operating room, the system could reduce reliance on repeated contrast injections for vessel visualization.
Load-bearing premise
The finite element model and silicone replica accurately represent real vessel mechanical behavior and real-time sensor data can be streamed without significant lag or error in clinical settings.
What would settle it
A clinical trial that directly measures actual vessel wall displacements during live procedures and finds the system's predictions deviate by more than a few millimeters or introduces noticeable display lag that affects navigation accuracy.
Figures
read the original abstract
Purpose: Developing and testing a framework that integrates real-time catheter shape reconstruction, interactive simulations, and mixed reality visualization to enable accurate monitoring of catheter-vessel interactions during endovascular navigation. Methods: A finite element model (FEM) of the venous pathway from the right femoral vein to the inferior vena cava was generated from computed tomography data and implemented into an interactive simulation. Catheter motion was imposed as boundary condition, and catheter-vessel contact was modeled with a Lagrange multiplier formulation to compute vessel deformation. The framework was tested in-vitro using a sensorized catheter with Fiber Bragg Grating and electromagnetic sensors as it was advanced through a silicone replica of the vascular anatomy. Real-time sensor read-outs fed the simulation, and the updated catheter and vessel geometries were streamed to Hololens 2. The performance and accuracy of FEM-computed vessel wall displacement were validated against experimental ground-truth obtained via stereo frames triangulation. Results: The simulated time exceeded the real temporal extent by 12% during initial navigation and by 45% when the catheter reached the most tortuous portion. Hololens 2 rendering remained stable at 35-40 frames per second. The median relative displacement error between FEM-computed and ground-truth vessel wall displacements remained below 1 mm and 2.33 mm for these two phases, respectively. Conclusion: The study demonstrates the feasibility of integrating interactive biomechanical simulation with real-time sensor data to enable continuous monitoring of catheter-vessel interactions, with mixed reality visualization serving as a user interface to support operator decision-making.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript presents a framework integrating real-time catheter shape reconstruction from FBG and EM sensors, an interactive FEM simulation of catheter-vessel contact (using Lagrange multipliers for deformation), and mixed-reality visualization streamed to Hololens 2. In-vitro validation in a silicone replica of the venous pathway reports median relative displacement errors below 1 mm (initial phase) and 2.33 mm (tortuous phase) against stereo-triangulation ground truth, with simulation times exceeding real temporal extent by 12% and 45% respectively, while Hololens rendering holds at 35-40 fps.
Significance. If the performance limitations can be resolved, the work offers a promising approach to enhancing navigational awareness in endovascular procedures through continuous biomechanical feedback and MR interfaces. Strengths include the use of independent experimental ground truth (avoiding circularity) and demonstration of stable MR rendering in a controlled phantom setting.
major comments (2)
- [Abstract/Results] Abstract and Results: The reported simulation times exceeding real temporal extent by 12% initially and 45% in the tortuous portion indicate that the Lagrange-multiplier contact FEM cannot process imposed boundary conditions (catheter motion from sensors) at real advancement rates. This directly undermines the central claim of 'real-time sensor data' integration and 'interactive' simulation for continuous monitoring, as geometry updates lag and the MR visualization cannot reflect live interactions without delay.
- [Methods] Methods: No details are provided on finite element model parameters (e.g., material properties, mesh density or convergence criteria), time integration scheme, or statistical analysis of the displacement errors. These omissions are load-bearing for assessing whether the median errors below 1 mm and 2.33 mm robustly support the accuracy claims against ground truth.
minor comments (1)
- [Conclusion] The conclusion should qualify the 'real-time' and 'feasibility' statements to align with the performance metrics (time exceedance) reported in the results.
Simulated Author's Rebuttal
We thank the referee for the constructive and detailed review. The comments identify key areas where our presentation of performance limitations and methodological details requires clarification and expansion. We address each point below and have prepared revisions accordingly.
read point-by-point responses
-
Referee: [Abstract/Results] Abstract and Results: The reported simulation times exceeding real temporal extent by 12% initially and 45% in the tortuous portion indicate that the Lagrange-multiplier contact FEM cannot process imposed boundary conditions (catheter motion from sensors) at real advancement rates. This directly undermines the central claim of 'real-time sensor data' integration and 'interactive' simulation for continuous monitoring, as geometry updates lag and the MR visualization cannot reflect live interactions without delay.
Authors: We agree that the reported simulation times indicate the FEM component does not run at strict real-time rates, particularly in the tortuous phase. This is a substantive limitation of the current implementation. In the revised manuscript we will update the abstract, results, and discussion sections to qualify the terminology: sensor acquisition and shape reconstruction occur in real time, while the full FEM update may lag behind catheter advancement speed. We will retain the demonstration of interactive MR visualization (stable at 35-40 fps) and add a paragraph discussing computational bottlenecks and planned optimizations such as model reduction or GPU acceleration. These changes preserve the feasibility claim while accurately reflecting the performance data. revision: yes
-
Referee: [Methods] Methods: No details are provided on finite element model parameters (e.g., material properties, mesh density or convergence criteria), time integration scheme, or statistical analysis of the displacement errors. These omissions are load-bearing for assessing whether the median errors below 1 mm and 2.33 mm robustly support the accuracy claims against ground truth.
Authors: We acknowledge that the original Methods section omitted these essential parameters, limiting reproducibility and evaluation of the error metrics. The revised manuscript will add a dedicated subsection specifying the vessel constitutive model (hyperelastic properties drawn from literature and CT-derived geometry), mesh resolution (element count, type, and average size), convergence tolerances, time-integration scheme (implicit method with adaptive stepping), and the statistical procedures used to compute median and interquartile-range displacement errors relative to the stereo-triangulation ground truth. These additions directly address the referee's concern and strengthen the accuracy claims. revision: yes
Circularity Check
No circularity: external validation against independent stereo ground-truth
full rationale
The paper applies standard finite-element methods (Lagrange-multiplier contact) to boundary conditions taken directly from FBG/EM sensor read-outs on a physical silicone replica; vessel-wall displacements are then compared to separate stereo-triangulation measurements. No result is obtained by fitting a parameter to a subset of the target data and then re-labeling it a prediction, no self-citation supplies a uniqueness theorem or ansatz that the present work merely renames, and the reported time-lag and error figures are empirical outcomes rather than tautological re-statements of the input model. The validation chain therefore remains externally grounded.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption Lagrange multiplier formulation models catheter-vessel contact to compute vessel deformation
Reference graph
Works this paper leans on
-
[1]
Transcatheter aortic-valve replacement with a balloon-expandable valve in low-risk patients,
M. J. Mack, M. B. Leon, V. H. Thourani, R. Makkar, S. K. Kodali, M. Russo, S. R. Kapadia, S. C. Malaisrie, D. J. Cohen, P. Pibarot,et al., “Transcatheter aortic-valve replacement with a balloon-expandable valve in low-risk patients,”New England Journal of Medicine, vol. 380, no. 18, pp. 1695–1705, 2019
2019
-
[2]
Safety and learning curve of percutaneous axillary artery access for complex en- dovascular aortic procedures,
Z. Al Adas, D. Uceda, A. Mazur, K. Zehner, C. J. Agrusa, G. Wang, and D. B. Schnei- der, “Safety and learning curve of percutaneous axillary artery access for complex en- dovascular aortic procedures,”Journal of Vascular Surgery, vol. 79, no. 3, pp. 487–496, 2024
2024
-
[3]
Vascular complications post-transcatheter aortic valve pro- cedures,
A. Mangla and S. Gupta, “Vascular complications post-transcatheter aortic valve pro- cedures,”Indian Heart Journal, vol. 68, no. 5, pp. 724–731, 2016
2016
-
[4]
Vascular complications in tavr: incidence, clinical impact, and management,
M. Mach, S. Okutucu, T. Kerbel, A. Arjomand, S. G. Fatihoglu, P. Werner, P. Si- mon, and M. Andreas, “Vascular complications in tavr: incidence, clinical impact, and management,”Journal of clinical medicine, vol. 10, no. 21, p. 5046, 2021
2021
-
[5]
Dejavu: Intra-operative simulation for surgical gesture rehearsal,
N. Haouchine, D. Stoyanov, F. Roy, and S. Cotin, “Dejavu: Intra-operative simulation for surgical gesture rehearsal,” inInternational Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 523–531, Springer, 2017. This manuscript has been submitted to the International Journal of Computer Assisted Radiology and Surgery and is curren...
2017
-
[6]
Perceptual limits of optical see-through visors for augmented reality guidance of manual tasks,
S. Condino, M. Carbone, R. Piazza, M. Ferrari, and V. Ferrari, “Perceptual limits of optical see-through visors for augmented reality guidance of manual tasks,”IEEE Transactions on Biomedical Engineering, vol. 67, no. 2, pp. 411–419, 2019
2019
-
[7]
Commercially available head-mounted displays are unsuitable for augmented reality surgical guidance: A call for focused research for surgical applications,
M. Carbone, R. Piazza, and S. Condino, “Commercially available head-mounted displays are unsuitable for augmented reality surgical guidance: A call for focused research for surgical applications,” 2020
2020
-
[8]
Utility of optical see-through head mounted displays in augmented reality-assisted surgery: A systematic review,
M. Birlo, P. E. Edwards, M. Clarkson, and D. Stoyanov, “Utility of optical see-through head mounted displays in augmented reality-assisted surgery: A systematic review,” Medical Image Analysis, vol. 77, p. 102361, 2022
2022
-
[9]
Comparative analysis of interactive modalities for intuitive endovascular interventions,
D. Wu, Z. Li, M. H. D. Ansari, X. T. Ha, M. Ourak, J. Dankelman, A. Menciassi, E. De Momi, and E. Vander Poorten, “Comparative analysis of interactive modalities for intuitive endovascular interventions,”IEEE Transactions on Visualization and Com- puter Graphics, vol. 31, no. 2, pp. 1371–1388, 2024
2024
-
[10]
Medical augmented reality: definition, principle components, do- main modeling, and design-development-validation process,
N. Navab, A. Martin-Gomez, M. Seibold, M. Sommersperger, T. Song, A. Winkler, K. Yu, and U. Eck, “Medical augmented reality: definition, principle components, do- main modeling, and design-development-validation process,”Journal of Imaging, vol. 9, no. 1, p. 4, 2022
2022
-
[11]
The hololens in medicine: a systematic review and taxonomy,
C. Gsaxner, J. Li, A. Pepe, Y. Jin, J. Kleesiek, D. Schmalstieg, and J. Egger, “The hololens in medicine: a systematic review and taxonomy,”Medical Image Analysis, vol. 85, p. 102757, 2023
2023
-
[12]
A review of augmented reality in robotic-assisted surgery,
L. Qian, J. Y. Wu, S. P. DiMaio, N. Navab, and P. Kazanzides, “A review of augmented reality in robotic-assisted surgery,”IEEE Transactions on Medical Robotics and Bionics, vol. 2, no. 1, pp. 1–16, 2019
2019
-
[13]
Advancements in robotic surgery: innovations, challenges and future prospects,
S. Chatterjee, S. Das, K. Ganguly, and D. Mandal, “Advancements in robotic surgery: innovations, challenges and future prospects,”Journal of Robotic Surgery, vol. 18, no. 1, p. 28, 2024
2024
-
[14]
Robust catheter tracking by fusing electromagnetic tracking, fiber bragg grating and sparse fluoroscopic images,
X. T. Ha, M. Ourak, O. Al-Ahmad, D. Wu, G. Borghesan, A. Menciassi, and E. Van- der Poorten, “Robust catheter tracking by fusing electromagnetic tracking, fiber bragg grating and sparse fluoroscopic images,”IEEE Sensors Journal, vol. 21, no. 20, pp. 23422–23434, 2021
2021
-
[15]
Improved fbg-based shape sensing methods for vascular catheterization treatment,
O. Al-Ahmad, M. Ourak, J. Van Roosbroeck, J. Vlekken, and E. Vander Poorten, “Improved fbg-based shape sensing methods for vascular catheterization treatment,” IEEE Robotics and Automation Letters, vol. 5, no. 3, pp. 4687–4694, 2020
2020
-
[16]
Force control with a novel robotic catheterization system based on braided sleeve grippers,
O. Al-Ahmad, M. Ourak, J. Vlekken, and E. Vander Poorten, “Force control with a novel robotic catheterization system based on braided sleeve grippers,”IEEE Transactions on Medical Robotics and Bionics, vol. 5, no. 3, pp. 602–613, 2023. This manuscript has been submitted to the International Journal of Computer Assisted Radiology and Surgery and is current...
2023
-
[17]
Sofa: A multi-model framework for interactive physical simulation,
F. Faure, C. Duriez, H. Delingette, J. Allard, B. Gilles, S. Marchesseau, H. Talbot, H. Courtecuisse, G. Bousquet, I. Peterlik,et al., “Sofa: A multi-model framework for interactive physical simulation,” 2012
2012
-
[18]
Biomechani- cal modelling of probe to tissue interaction during ultrasound scanning,
E. Tagliabue, D. Dall’Alba, E. Magnabosco, I. Peterlik, and P. Fiorini, “Biomechani- cal modelling of probe to tissue interaction during ultrasound scanning,”International Journal of Computer Assisted Radiology and Surgery, vol. 15, no. 8, pp. 1379–1387, 2020
2020
-
[19]
Open source computer vision library
Itseez, “Open source computer vision library.”https://github.com/itseez/opencv, 2015
2015
-
[20]
A simulation environ- ment for robot-assisted endovascular interventions,
M. Pescio, C. Li, D. Kundrat, M. Casadio, and G. Dagnino, “A simulation environ- ment for robot-assisted endovascular interventions,”International Journal of Computer Assisted Radiology and Surgery, vol. 20, no. 11, pp. 2259–2267, 2025
2025
-
[21]
Ultrasound frame-to-volume registration via deep learning for in- terventional guidance,
H. Guo, X. Xu, X. Song, S. Xu, H. Chao, J. Myers, B. Turkbey, P. A. Pinto, B. J. Wood, and P. Yan, “Ultrasound frame-to-volume registration via deep learning for in- terventional guidance,”IEEE transactions on ultrasonics, ferroelectrics, and frequency control, vol. 70, no. 9, pp. 1016–1025, 2022
2022
-
[22]
A robust and automatic ct-3d ultrasound registration method based on segmentation, context, and edge hybrid metric,
B. He, S. Zhao, Y. Dai, J. Wu, H. Luo, J. Guo, Z. Ni, T. Wu, F. Kuang, H. Jiang,et al., “A robust and automatic ct-3d ultrasound registration method based on segmentation, context, and edge hybrid metric,”Medical Physics, vol. 50, no. 10, pp. 6243–6258, 2023
2023
-
[23]
Non-invasive estimation of vascular compliance and distensibility in the arm vessels: a novel ultrasound-based protocol,
S. Cappelletti, A. Caimi, A. Caldiroli, I. Baroni, E. Votta, S. A. Riboldi, M. M. Marrocco-Trischitta, A. Redaelli, and F. Sturla, “Non-invasive estimation of vascular compliance and distensibility in the arm vessels: a novel ultrasound-based protocol,” Quantitative Imaging in Medicine and Surgery, vol. 12, no. 7, p. 3515, 2022
2022
-
[24]
Radiation protection in cardiac catheterization: Insights fromasurveyofinterventionalcardiologists,
A. Alharbi, A. Abanomy, M. Almeshari, H. Alahmad, A. M. Alshahrani, M. Alarifi, M. Almanaa, and K. Alenazi, “Radiation protection in cardiac catheterization: Insights fromasurveyofinterventionalcardiologists,”Journal of Radiation Research and Applied Sciences, vol. 18, no. 1, p. 101226, 2025
2025
-
[25]
Gpu-based real- time soft tissue deformation with cutting and haptic feedback,
H. Courtecuisse, H. Jung, J. Allard, C. Duriez, D. Y. Lee, and S. Cotin, “Gpu-based real- time soft tissue deformation with cutting and haptic feedback,”Progress in biophysics and molecular biology, vol. 103, no. 2-3, pp. 159–168, 2010. This manuscript has been submitted to the International Journal of Computer Assisted Radiology and Surgery and is curren...
2010
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.