REVIEW 3 major objections 8 minor 33 references
Koopman Representation of Nonlinear Virtual Environments in Kinesthetic Haptic Systems
T0 review · 3 major / 8 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read This paper claims that the nonlinear dynamics of a virtual environment can be lifted into a linear Koopman model that supports real-time haptic rendering and a closed-loop stability analysis that is less conservative than passivity-based…
desk verdict Koopman/EDMD is applied cleanly to haptic rendering and the experiments are credible, but the headline stability guarantee is computed on a purely linear recurrence that does not match the relifted implementation; fix that gap and the paper is a solid applied contribution. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the Koopman representation of the virtual environment: a set of lifting functions $\vartheta(x_k)$ that embed the VE state into a higher-dimensional space in which the nonlinear update is approximated as linear, $\vartheta_{k+1} = A\vartheta_k + B u_k$ with residual $r_k$. The lifted state vector here uses third-order monomials of position and velocity, and the matrices $A$ and $B$ are fit by least squares from simulated trajectories of the Duffing oscillator. This linear model is then coupled to the discrete-time device model through the virtual-coupling force, producing the closed-loop matrix $A_{\mathrm{CL}}$ in Eq. (19); stability is decided by whether all eigenvalues of $A_{\mathrm{CL}}$ lie strictly inside the unit circle. The same linear-in-the-lifted-space structure is what the authors use to explain robustness to device-modeling uncertainty: perturbations in the VE position enter through the linear combination of lifted states rather than being amplified by a standalone cubic term.
What would settle it
Run the closed-loop haptic simulation with the same parameters used in the paper but with added noise or drift in the lifted states, and compare the trajectories with the eigenvalue prediction; if a trajectory diverges while all eigenvalues of the closed-loop matrix lie inside the unit circle, the stability claim does not cover the implemented relifting loop. Alternatively, measure the per-step residual of the Koopman model on held-out trajectories; if the residual is large enough to move an eigenvalue across the unit circle, the certificate is void.
Extended reading notes
Core claim
The core discovery is that the nonlinear dynamics of a virtual environment need not be simulated with a nonlinear model or stabilized with passivity arguments; they can be lifted into a higher-dimensional linear state-space model via the Koopman operator, and that lifted model can be inserted directly into the closed-loop haptic system. For the 1-DoF Duffing-oscillator VE, lifting functions up to third-order monomials in position and velocity produce a Koopman model whose simulated and experimental responses match the nonlinear baseline, with user ratings significantly above the agreement threshold. On stability, the paper forms the closed-loop state matrix $A_{\mathrm{CL}}$ in Eq. (19) by combining the discrete-time device model with the lifted Koopman dynamics and the virtual coupling, and shows that all eigenvalues lie inside the unit circle for the case study, establishing asymptotic stability. Because passivity is only a sufficient condition, the authors argue this eigenvalue check covers a broader class of systems and is therefore less conservative. They also report that the Koopman-model VE yields lower RMSE against the rigid-body simulation across repeated trials, which they attribute to its representation of the cubic stiffness term as one component of a linear combination of lifted states rather than as a standalone amplifying nonlinearity.
Load-bearing premise
The load-bearing premise is that the linear Koopman model used to build the closed-loop stability matrix accurately represents the implemented haptic system, which re-lifts its states at every time step and therefore is not purely linear; the paper provides no bound on that approximation error and no stability guarantee covering the re-lifting step.
Editorial extensions
If this is right
- Virtual-coupling parameters can be selected by imposing the eigenvalue constraint on $A_{\mathrm{CL}}$, turning stability-guaranteed rendering into a linear design problem.
- The eigenvalue check applies to systems that are not passive, so it is less conservative than passivity-based sufficient conditions.
- The trained Koopman model is reusable across device models: changing $m_d$, $b_d$, $k_c$, or $b_c$ only reassembles $A_{\mathrm{CL}}$ from the stored $A$ and $B$.
- For nonlinear environments that require implicit integration, replacing the VE update with the Koopman model reduces per-step cost from $O(k^3)$ to $O(p^2)$.
- The Koopman-model VE's lower RMSE relative to the rigid-body simulation across repeated trials indicates it is less sensitive to unmodeled structural flexibility of the device than the nonlinear baseline.
Reading between the lines
- The implementation relifts the state at every step, so the rendered system is not literally the linear system whose eigenvalues are checked; a robustness margin that accounts for the residual $r_k$ would make the stability certificate cover the implementation, not just the fitted model.
- The robustness advantage is demonstrated for a cubic stiffness nonlinearity; for nonsmooth or hysteretic environments the lifting-function approach would need independent validation, and the sensitivity to lifting-function choice already appears in the paper's 8-function versus 9-function comparison.
- A direct comparison of the largest stable virtual-coupling stiffness allowed by the eigenvalue test versus by passivity-based criteria on the same device would quantify how much conservatism is actually removed.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes using a learned finite-dimensional Koopman model to represent a nonlinear virtual environment (a Duffing oscillator) in a kinesthetic haptic system. The Koopman model is trained in simulation from the nonlinear VE dynamics, implemented with retraction/relifting at each time step, and compared against the baseline nonlinear-model VE in both a single-user experiment and a multi-user perception study. The authors further use the linear lifted representation to build a closed-loop matrix ACL and claim that an eigenvalue check can certify asymptotic stability of the overall haptic system, that this stability analysis is less conservative than passivity-based methods, and that the Koopman representation is more robust to haptic-device modeling uncertainties than the traditional nonlinear model. The empirical trajectory matches and the multi-user ratings support the representation claim, but the stability and conservativeness claims are not rigorously connected to the actually implemented relifted system.
Significance. If the stability guarantee were rigorously established, the paper would make a useful contribution to haptic rendering by showing that data-driven Koopman models can replace nonlinear VEs and enable linear stability tools in a domain where passivity criteria are typically conservative. The empirical validation is a genuine strength: the Koopman model is tested on experimental trajectories not used in training, the multi-user study provides perceptual evidence, and the appendix reports ten additional trials with consistently lower RMSE for the Koopman-model VE. The main weakness is that the central stability claim is currently only proved for a fitted linear recurrence, not for the relifted implementation that was actually tested; the 'less conservative than passivity' comparison is asserted rather than demonstrated. The robustness claim, while empirically suggestive, is not backed by a formal uncertainty analysis.
major comments (3)
- [Section II.B, Eq. (19) and Section III.C] The closed-loop stability analysis in Eq. (19) treats the lifted state as evolving linearly according to ϑ_{k+1} = Aϑ_k + Bu_k. However, Section III.C states that the Koopman-model VE retracts and relifts the states at every step to prevent error propagation in Eq. (7). The actually implemented map is therefore the nonlinear, state-dependent composition ϑ_{k+1} = ψ(f(x_k, u_k)) evaluated through the learned A and B, not the LTI recurrence analyzed in Eq. (19). The residual r_k in Eq. (7) is introduced but never bounded, and no theorem connects the spectral radius of ACL to stability of the relifted closed loop. Consequently, the eigenvalue plot in Fig. 8 certifies only the fitted linear model, not the system that was tested in simulation and experiment. This gap is load-bearing because the abstract's headline stability advantage and the 'less conservative than passivity' claim rest on this eigenvalue check. The authors should either provide a residual bound and a stability theorem that covers the relifted dynamics, or explicitly restrict the stability claim to the linear lifted model and describe the experimental stability evidence as heuristic.
- [Section II.B and Section IV.C] The assertion that the proposed eigenvalue check is 'less conservative' than passivity-based methods is not established. The manuscript argues that passivity gives only sufficient conditions while the eigenvalue check applies to a broader class of systems, but this is not a comparison of conservativeness for the same physical haptic system. Passivity-based criteria can certify stability of the actual nonlinear VE under stated assumptions, whereas the eigenvalue check currently certifies only the fitted linear model in Eq. (19), whose relationship to the true relifted nonlinear system is not quantified. To make the claim precise, the authors should provide a formal comparison: for example, a parameter region for the virtual-coupling gains in which passivity is inconclusive but the eigenvalue condition (with a controlled approximation error) still guarantees stability of the implemented system. As written, the comparison to passivity is a logical non-sequitur rather than a proven advantage.
- [Section IV.B, Table III and Table V] The claim that the Koopman-model VE is 'more robust to uncertainties in the modeling of the haptic device' is supported only by lower RMSE values relative to a rigid-body simulation baseline across ten experimental trials. This is useful empirical evidence, but RMSE here measures closeness to an idealized rigid-body simulation, not to the measured device behavior, and no uncertainty model or statistical significance test is provided. The explanatory mechanism given in Section IV.B (that the Koopman model does not assign outsized importance to the x_v^3 term) is heuristic. The authors should either frame this as a preliminary empirical observation, add error bars and a formal sensitivity analysis with respect to device-parameter perturbations, or weaken the abstract's robustness claim accordingly.
minor comments (8)
- [Abstract] The abstract contains a typo: 'to access stability' should be 'to assess stability'.
- [Section III.B] The text reads 'Quanser's hardward-in-the-loop'; 'hardward' should be 'hardware'.
- [Section IV.B] The phrase 'sturctural flexibiliy' should be 'structural flexibility', and 'the extend to which' in Section III.D should be 'the extent to which'.
- [Section IV.C] The sentence 'the difference in the Lyapunov candidate ... is negative or closed to 0' should read 'close to 0'.
- [Section II.C, Eqs. (21)-(22)] The two Lyapunov candidates have inconsistent factors: V_nonlinear uses 1/2 multipliers for the kinetic and coupling terms while V_Koopman omits them. This is not technically wrong, but the inconsistency makes the comparison harder to follow.
- [Section IV.A] The simulation match in Fig. 3 is described qualitatively as 'align closely'; a quantitative metric such as the normalized RMSE between the Koopman and nonlinear simulated responses would strengthen the claim.
- [Section IV.D] The multi-user study has a small sample (N=11) and the Wilcoxon test is reported only via p < 0.004; reporting the test statistic and the exact p-value would improve reproducibility.
- [Section III.C] The phrase 'evolved without external force input' and later 'under free force input' could be misleading; clarify that the VE is released from an initial displacement with zero commanded force input.
Circularity Check
No circular derivation found: the Koopman representation is validated on new experimental data, and the stability analysis is a standard linear-model check rather than an input-to-output equivalence.
full rationale
The paper's central claims do not reduce to their inputs by construction. The Koopman model is identified from simulated data generated by the nonlinear Duffing VE (Section III.C) and then tested on separate experimental trajectories (Section IV.B) and a multi-user perception study (Section IV.D); this is an independent generalization test, not a self-prediction. The closed-loop stability analysis in Section II.B builds the LTI lifted recurrence (15)-(19) and checks the eigenvalues of ACL; this is a standard linear-systems criterion and is not equivalent to the training data. The robustness comparison in Section IV.B uses experimental RMSE values against a simulation baseline, so it is an empirical result rather than a quantity forced by construction. The self-citations (e.g., [22], [25], [27] by Dahdah and Forbes) are methodological and are not used as a load-bearing uniqueness argument, so they do not constitute circularity. One non-circular caveat is worth flagging: the implemented VE explicitly retracts and relifts states at every step to 'prevent error propagation in (7)' (Section III.C), so the implemented update is not the LTI recurrence (15) used to form ACL; absent a bound on the residual r_k in (7), the eigenvalue check in Figure 8 does not by itself certify the relifted implementation. This is a correctness gap, but it is not a circularity because the stability conclusion is not equivalent to the training data or to a fitted parameter by construction.
Assumptions & free parameters
free parameters (3)
- Device damping coefficient b_d =
Not given numerically in text; tuned to match baseline simulation to experiment (Section III.A)
- Koopman matrices A and B =
Estimated from 25 simulated datasets via pykoop (Section III.C)
- Lifted state dimension and polynomial order (p=9, order 3) =
9 lifted states: x_v, x_v_dot, x_v^2, x_v_dot^2, x_v*x_v_dot, x_v^3, x_v^2*x_v_dot, x_v*x_v_dot^2, x_v_dot^3
assumptions (5)
- domain assumption The finite-dimensional Koopman approximation residual r_k in (7) is negligible for simulating the VE and for closed-loop stability analysis.
- domain assumption Inputs to the Koopman model appear linearly, so only states need lifting.
- ad hoc to paper The closed-loop system (19) with the learned Koopman model accurately represents the actual haptic system with the relifted implementation.
- domain assumption The haptic device is well described by the rigid-body mass-damper model (11) for the purposes of stability analysis.
- domain assumption Stability of the free-motion closed-loop system (no hand force) is sufficient for the user-interaction stability claim.
Cite this review
Pith. "Pith review of Koopman Representation of Nonlinear Virtual Environments in Kinesthetic Haptic Systems." pith.science (2026). https://pith.science/paper/5M7S4PYT
@misc{pith2026260811461,
author = {Pith},
title = {Pith review of: Koopman Representation of Nonlinear Virtual Environments in Kinesthetic Haptic Systems},
year = {2026},
howpublished = {\url{https://pith.science/paper/5M7S4PYT}},
note = {Machine review of arXiv:2608.11461}
}
read the original abstract
Rendering haptic feedback with nonlinear virtual environments (VEs) is important in many applications that require highly accurate force feedback. This paper considers the use of the Koopman operator to represent a nonlinear VE interacting with a haptic system. Simulation and experimental results demonstrated that the proposed method provides an effective representation of the nonlinear dynamics of a Duffing-oscillator VE. A multi-user study further confirmed this conclusion. In addition, a closed-loop (CL) stability analysis is performed leveraging the Koopman representation of the nonlinear VE to access stability of the overall haptic system. This alternative way of representing nonlinear VEs enables a convenient CL stability analysis that is less conservative than traditional passivity-based methods. Since a linear combination of all lifted states is used to represent the nonlinearity, such representation is also more robust to uncertainties in the modeling of the haptic device than a traditional nonlinear model.
Figures
Figures from the paper (4 more)
Reference graph
Works this paper leans on
- [1]
-
[2]
Force feedback is noticeably different for linear versus nonlinear elastic tissue models,
S. Misra, A. M. Okamura, and K. Ramesh, “Force feedback is noticeably different for linear versus nonlinear elastic tissue models,” inSecond. Jt. EuroHaptics Conf. Symp. Haptic Interfaces Virtual Environ. Teleoperator Syst., IEEE, 2007, pp. 519–524
work page 2007
-
[3]
Haptic rendering in virtual environments,
C. Basdogan and M. A. Srinivasan, “Haptic rendering in virtual environments,” inHandbook of virtual environments, CRC Press, 2002, pp. 157–174
work page 2002
-
[4]
M. Esfandiari, S. Sadeghnejad, F. Farahmand, and G. V osoughi, “Ro- bust nonlinear neural network-based control of a haptic interaction with an admittance type virtual environment,” inRSI Int. Conf. Robot. Mechatron., IEEE, 2017, pp. 322–327
work page 2017
-
[5]
S. De, D. Deo, G. Sankaranarayanan, and V . S. Arikatla, “A physics-driven neural networks-based simulation system (phynness) for multimodal interactive virtual environments involving nonlinear deformable objects,”Presence, vol. 20, no. 4, pp. 289–308, 2011
work page 2011
-
[6]
Passivity of a class of sampled-data systems: Application to haptic interfaces,
J. Colgate and G. Schenkel, “Passivity of a class of sampled-data systems: Application to haptic interfaces,” inProc. Am. Control. Conf., vol. 3, IEEE, 1994, 3236–3240
work page 1994
-
[7]
Time-domain passivity control of haptic interfaces,
B. Hannaford and J.-H. Ryu, “Time-domain passivity control of haptic interfaces,”IEEE Trans. Robot. Autom., vol. 18, no. 1, 1–10, 2002
work page 2002
-
[8]
Time domain passivity control with reference energy following,
J.-H. Ryu, C. Preusche, B. Hannaford, and G. Hirzinger, “Time domain passivity control with reference energy following,”IEEE Trans. Control. Syst. Technol., vol. 13, no. 5, 737–742, Sep. 2005
work page 2005
Show all 33 references
-
[9]
Stable haptic interaction with virtual environments,
R. J. Adams and B. Hannaford, “Stable haptic interaction with virtual environments,”IEEE Trans. Robot. Autom., vol. 15, no. 3, pp. 465– 474, 1999
1999
-
[10]
Revisiting Llewellyn’s absolute sta- bility criterion for bilateral teleoperation systems under non-passive operator or environment,
A. Jazayeri and M. Tavakoli, “Revisiting Llewellyn’s absolute sta- bility criterion for bilateral teleoperation systems under non-passive operator or environment,” inInt. Conf. Intell. Robot. Syst., IEEE, 2012, pp. 70–75
2012
-
[11]
Passive implementa- tion for a class of static nonlinear environments in haptic display,
B. E. Miller, J. E. Colgate, and R. A. Freeman, “Passive implementa- tion for a class of static nonlinear environments in haptic display,” in IEEE Int. Conf. Robot. Autom., IEEE, vol. 4, 1999, pp. 2937–2942
1999
-
[12]
Guaranteed stability of haptic systems with nonlinear virtual environments,
B. E. Miller, J. E. Colgate, and R. A. Freeman, “Guaranteed stability of haptic systems with nonlinear virtual environments,”IEEE Trans. Robot. Autom., vol. 16, no. 6, pp. 712–719, 2000
2000
-
[13]
Mod- ern koopman theory for dynamical systems,
S. L. Brunton, M. Budi ˇsi´c, E. Kaiser, and J. N. Kutz, “Mod- ern koopman theory for dynamical systems,”arXiv preprint arXiv:2102.12086, 2021
2021 arXiv
-
[14]
Sastry,Nonlinear systems: analysis, stability, and control
S. Sastry,Nonlinear systems: analysis, stability, and control. Springer, 2013, vol. 10
2013
-
[15]
Structural dynamics and resonance in plants with nonlinear stiffness,
L. A. Miller, “Structural dynamics and resonance in plants with nonlinear stiffness,”J. Theor . Biol., vol. 234, no. 4, pp. 511–524, 2005
2005
-
[16]
Operator is the model,
I. Mezi ´c, “Operator is the model,”arXiv preprint arXiv:2310.18516, 2023
2023 arXiv
-
[17]
Applied koopmanism,
M. Budi ˇsi´c, R. Mohr, and I. Mezi ´c, “Applied koopmanism,”Chaos: Interdisip. J. Nonlinear Sci., vol. 22, no. 4, 2012
2012
-
[18]
Mauroy, Y Susuki, and I
A. Mauroy, Y Susuki, and I. Mezi ´c,Koopman operator in systems and control. Springer, 2020, vol. 7
2020
-
[19]
Limits and powers of koopman learning,
M. J. Colbrook, I. Mezi ´c, and A. Stepanenko, “Limits and powers of koopman learning,”arXiv preprint arXiv:2407.06312, 2024
2024 arXiv
-
[20]
S. L. Brunton and J. N. Kutz,Data-driven science and engineer- ing: Machine learning, dynamical systems, and control. Cambridge University Press, 2022
2022
-
[21]
Generalizing koopman theory to allow for inputs and control,
J. L. Proctor, S. L. Brunton, and J. N. Kutz, “Generalizing koopman theory to allow for inputs and control,”SIAM J. Appl. Dyn. Syst., vol. 17, no. 1, pp. 909–930, 2018
2018
-
[22]
Closed-loop Koopman operator ap- proximation,
S. Dahdah and J. R. Forbes, “Closed-loop Koopman operator ap- proximation,”Mach. Learn.: Sci. Technol., vol. 5, no. 2, p. 025 038, 2024
2024
-
[23]
Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive control,
M. Korda and I. Mezi ´c, “Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive control,”Auto- matica, vol. 93, pp. 149–160, 2018
2018
-
[24]
J. N. Kutz, S. L. Brunton, B. W. Brunton, and J. L. Proctor, Dynamic mode decomposition: data-driven modeling of complex systems. SIAM, 2016
2016
-
[25]
System norm regularization methods for Koopman operator approximation,
S. Dahdah and J. R. Forbes, “System norm regularization methods for Koopman operator approximation,”Proc. R. Soc. A, vol. 478, no. 2265, p. 20 220 162, 2022
2022
-
[26]
A data–driven approximation of the koopman operator: Extending dynamic mode decomposition,
M. O. Williams, I. G. Kevrekidis, and C. W. Rowley, “A data–driven approximation of the koopman operator: Extending dynamic mode decomposition,”J. Nonlinear Sci., vol. 25, no. 6, pp. 1307–1346, 2015
2015
-
[27]
Dahdah and J
S. Dahdah and J. R. Forbes,decargroup/pykoop v1.2.3, 2023. [On- line]. Available:https : / / doi . org / 10 . 5281 / zenodo . 7464660
2023
-
[28]
H. K. Khalil and J. W. Grizzle,Nonlinear systems. Prentice hall Upper Saddle River, NJ, 2002, vol. 3
2002
-
[29]
Lyapunov theory for discrete time systems,
N. Bof, R. Carli, and L. Schenato, “Lyapunov theory for discrete time systems,”arXiv preprint arXiv:1809.05289, 2018
2018 arXiv
-
[30]
Dynamics of coupled haptic sys- tems,
L. L. Kov ´acs and J. K ¨ovecses, “Dynamics of coupled haptic sys- tems,” inIEEE World Haptics Conf., IEEE, 2015, pp. 286–292. [31]2-dof planar pantograph reference manual, Quanser Consulting Inc., Markham, Ontario, Canada
2015
-
[32]
S. S. Amin,Modelling and analysis of haptic mechanical systems, Ph.D. dessertation, Dept. Mech. Eng., McGill University, Montreal, 2014
2014
-
[33]
Learning data- driven stable koopman operators,
G. Mamakoukas, I. Abraham, and T. D. Murphey, “Learning data- driven stable koopman operators,”CoRR, 2020
2020
-
[34]
Wilcoxon signed-rank test,
R. F. Woolson, “Wilcoxon signed-rank test,”Wiley Encycl. Clin. Trials, pp. 1–3, 2007
2007
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.