REVIEW 3 major objections 6 minor 26 references
Beyond DSA: Conjugacy-based Comparison of Dynamical Systems
T0 review · 3 major / 6 minor · reviewed 2026-07-11 · grok-4.5
Pith's one-line read Orthogonal alignment of Koopman operators is neither necessary nor sufficient for dynamical conjugacy; alignments must come from state-space bijections.
desk verdict Clean theoretical fix to DSA: orthogonal Koopman alignment is neither necessary nor sufficient for conjugacy; CSA is the right object when you can supply a conjugacy family. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The composition (pullback) operator Ch induced by a candidate bijection h, whose finite-data projection onto the observable dictionaries is the transfer matrix P heta that CSA optimizes; the CSA score is then the residual of the intertwining relation PθF ≈ GPθ.
What would settle it
Find a pair of genuinely conjugate systems, give CSA a conjugacy family that does not contain the true map (or any close approximation), and check whether CSA still reports a small residual while a ground-truth-aware method would; or exhibit non-conjugate systems whose projected composition operators still intertwine under the supplied family.
Extended reading notes
Core claim
Orthogonal similarity of finite-dimensional Koopman matrices is neither necessary nor sufficient for topological conjugacy. The correct intertwiner is the composition operator induced by a state-space bijection (or its finite-data projection onto the chosen observable dictionaries). CSA recovers that object by construction; DSA does not.
Load-bearing premise
CSA only works if the user supplies a family of candidate relabellings that already contains, or closely approximates, the true conjugacy; the paper’s experiments hand it that family.
Editorial extensions
If this is right
- A small DSA distance no longer licenses a claim that two systems implement the same computation, and a large distance no longer licenses the claim that they do not.
- Any conjugacy-aware Koopman comparison must search over alignments that can be interpreted as projected pullbacks of state-space maps, not over arbitrary orthogonal matrices.
- When observable bases are learned implicitly (Hankel/SVD pipelines), the basis-transfer problem cannot be ignored; orthogonal alignment alone conflates coordinate artefacts with dynamical differences.
- Claims of shared dynamics across recording sessions, animals, models, or architectures must make the admissible class of relabellings explicit.
- Weaker notions of similarity (spectral match, task-relevant subspace match) remain useful, but must not be conflated with conjugacy.
Reading between the lines
- If the candidate-bijection family is misspecified, CSA can fail silently; practical deployments will need diagnostics that flag empty or poorly covering families rather than reporting a residual alone.
- The same pullback-construction idea can be ported to continuous-time flows and to stochastic generators without changing the core argument that the intertwiner must be composition-induced.
- Cross-subject or cross-session BCI alignment that currently uses orthogonal Procrustes-style maps may be systematically under- or over-estimating dynamical equivalence when the true coordinate change is non-volume-preserving.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper argues that Dynamical Similarity Analysis (DSA) is neither necessary nor sufficient as a test of topological conjugacy between dynamical systems, because DSA aligns finite-dimensional Koopman matrices by arbitrary orthogonal similarity, whereas conjugacy induces a specific composition (pullback) operator that need not be unitary and is not the only source of unitary equivalence. The authors formalize Conjugacy-based Similarity Analysis (CSA), which restricts alignments to matrices P_θ obtained by least-squares projection of candidate state-space bijections h_θ, and prove (Propositions 2–4) that the fitted P_θ is the empirical/population projected composition operator. Controlled EDMD and Hankel-DMD experiments on logistic maps and linear contractions, under known conjugacies and dictionary changes, show that CSA preserves conjugacy structure in regimes where DSA does not.
Significance. If the necessity/sufficiency critique and the projection interpretation hold—and the classical counter-examples (Appendices A–C) and Propositions 2–4 make a strong case—the paper supplies a needed clarification for a method already used in systems neuroscience and deep learning. The distinction between orthogonal operator alignment and conjugacy-induced pullbacks is load-bearing for any claim that two circuits or models implement the same computation. Strengths include: (i) clean operator-theoretic framing of conjugacy as intertwining by a composition operator; (ii) classical Bernoulli-shift and non-unitary conjugacy counter-examples; (iii) explicit finite-data projection theorems for P_θ; (iv) controlled experiments that isolate alignment class rather than confounding approximation error. The work is more a principled template and diagnostic than a ready high-dimensional pipeline, which the Discussion largely acknowledges.
major comments (3)
- Appendix G.5 / §5.2: CSA-Krylov constructs Φ2 by evaluating delay-embedded Krylov features via the known maps f_i at arbitrary grid points (ϕ_i(x)=V_{i,r}^⊤(x,f_i(x),…)). This is not available in a purely data-driven setting where only trajectories are observed. The abstract and §5 claim that the distinction matters when dictionaries are chosen “implicitly from data”; the Hankel instantiation as written still requires the dynamics to build the conjugacy-induced transfer. Either restate the Hankel results as requiring known (or separately identified) maps, or provide a trajectory-only construction of P_θ and re-run the conjugate-pair sweeps.
- §5 (opening paragraph and all reported panels): every CSA experiment is given a parametric family that contains the ground-truth bijection. That design correctly isolates the alignment-class question, but it leaves the empirical claim that “CSA correctly identifies conjugate systems” untested under family misspecification. A single negative control—e.g., CSA restricted to a family that excludes h_θ, or to a wrong parametric form—would show whether the method fails gracefully (large residual) rather than spuriously reporting conjugacy. Without that, the experiments support only the weaker claim that the right alignment class works when the true map is supplied.
- §3.1 and Appendix B: the Bernoulli-shift argument shows unitary equivalence of infinite-dimensional Koopman operators without conjugacy, which correctly establishes that orthogonal/unitary alignment is not sufficient in the infinite-dimensional limit. The finite-dimensional DSA criterion (Eq. 10) is a different object. A short remark on how the finite-rank EDMD/Hankel truncations of those shifts behave under DSA would close the gap between the classical counter-example and the numerical method actually used in practice.
minor comments (6)
- Figure 1 caption: typo “comaprison” → “comparison”; also “Pairwise (comaprison) distance matrices”.
- Eq. (10) writes Q F Q^{-1} with Q∈O(m); for orthogonal matrices this is Q F Q^⊤. Stating the transpose form would match standard DSA notation and avoid implying a general GL(m) search.
- §4, Eq. (12): the normalisation ∥P_θ∥_F is sensible but not unique; a brief note on scale invariance (or lack thereof) under rescaling of dictionaries would help readers compare CSA residuals across dictionary sizes.
- Figure 5b–c: plotting d_DSA/√r alongside CSA is convenient for display, but the main text should state once that conjugacy-invariance conclusions use the raw residual behaviour, not the 1/√r factor.
- References: Ostrow et al. (2023) is the central foil; a short related-work paragraph on other conjugacy/isomorphism tests in applied Koopman theory (beyond Mezic 2020 and Korda–Mezić 2018) would situate CSA more clearly.
- Appendix I Algorithm 1: the returned d_CSA is √OBJECTIVE, while Eq. (12) is already a normalised Frobenius residual; confirm consistency between the algorithm and the displayed formula.
Circularity Check
No significant circularity: conjugacy intertwining, non-containment of orthogonal vs composition classes, and projection theorems are self-contained operator-theory arguments; controlled experiments openly supply the true bijection family.
full rationale
The paper's load-bearing claims do not reduce to their inputs by construction. Topological conjugacy is defined as h◦f=g◦h (Eq. 1); the composition operator Ch and the intertwining Ch Kg = Kf Ch (Eqs. 2–4) and matrix form PF=GP (Eqs. 6–9) follow by direct substitution, not by fitting. Necessity/sufficiency failure of orthogonal alignment is established by independent classical counter-examples: a unitary non-multiplicative map on span{1,x} (Appendix A), unitarily equivalent but non-conjugate Bernoulli shifts with unequal periodic-point counts (Appendix B, citing Rédei–Werndl 2012), and non-measure-preserving conjugacies such as hθ(x)=x+θsin(πx) whose pullbacks are non-unitary (Appendix C). Propositions 2–4 identify Pθ,M as the empirical L2 projection of Chθ onto the dictionaries and prove a.s. convergence to the population projection and strong-operator recovery under complete bases—standard least-squares/EDMD arguments, not circular redefinitions. CSA's distance (Eq. 12) is an optimization residual over a declared candidate family Θ; the experiments explicitly give CSA a family containing the ground-truth map to isolate the alignment-class distinction, and the Discussion acknowledges family misspecification as a limitation rather than hiding it. No self-citation chain, uniqueness theorem imported from the authors, or fitted parameter renamed as prediction supports the central claim. Score 0 is appropriate.
Assumptions & free parameters
free parameters (2)
- candidate conjugacy family parameter θ (and a,n for ha,n)
- observable dictionary size m / SVD rank r / delay dimension d
assumptions (4)
- domain assumption Topological conjugacy is the intended notion of 'same computation' (h∘f = g∘h for a bijection h).
- standard math Koopman operators act by composition on L2 observables and finite EDMD/Hankel-DMD matrices approximate them.
- standard math A composition operator is multiplicative and is unitary only when the inducing map is measure-preserving.
- ad hoc to paper A tractable parametric family of candidate bijections containing the true conjugacy is available to CSA.
invented entities (1)
-
Conjugacy-based Similarity Analysis (CSA) distance
independent evidence
Cite this review
Pith. "Pith review of Beyond DSA: Conjugacy-based Comparison of Dynamical Systems." pith.science (2026). https://pith.science/paper/7B553QHX
@misc{pith2026260704493,
author = {Pith},
title = {Pith review of: Beyond DSA: Conjugacy-based Comparison of Dynamical Systems},
year = {2026},
howpublished = {\url{https://pith.science/paper/7B553QHX}},
note = {Machine review of arXiv:2607.04493}
}
read the original abstract
Comparing whether two dynamical systems implement the same computation despite differences in coordinates or measurements is a central problem in neuroscience and machine learning. Dynamical Similarity Analysis [DSA; Ostrow et al., 2023] addresses this problem by aligning finite-dimensional Koopman approximations through an orthogonal similarity transformation. Here we show that orthogonal alignment is neither necessary nor sufficient for topological conjugacy: conjugate systems may require a non-orthogonal basis-transfer matrix that DSA cannot capture, while non-conjugate systems may have orthogonally equivalent Koopman operators that DSA fails to distinguish. We use this observation to formulate Conjugacy-based Similarity Analysis (CSA), which restricts alignments to those induced by candidate state-space bijections rather than arbitrary orthogonal matrices. We prove that CSA's fitted alignment is the finite-data projection of the composition operator associated with the candidate bijection, and use controlled examples to show why this distinction matters when observable dictionaries are chosen explicitly or implicitly from data. These results clarify what Koopman-based similarity measures must ensure to support claims of identifying conjugacies between computational systems.
Figures
Figures from the paper (4 more)
Reference graph
Works this paper leans on
-
[1]
Advances in Neural Information Processing Systems , volume=
Beyond geometry: Comparing the temporal structure of computation in neural circuits with dynamical similarity analysis , author=. Advances in Neural Information Processing Systems , volume=
-
[2]
Advances in Neural Information Processing Systems , volume=
Identifying equivalent training dynamics , author=. Advances in Neural Information Processing Systems , volume=
-
[3]
, author=
Spectrum of the Koopman Operator, Spectral Expansions in Functional Spaces, and State-Space Geometry. , author=. J. Nonlinear Sci. , volume=
-
[4]
Journal of Nonlinear Science , volume=
On convergence of extended dynamic mode decomposition to the Koopman operator , author=. Journal of Nonlinear Science , volume=. 2018 , publisher=
2018
-
[5]
Archive for history of exact sciences , volume=
On the history of the isomorphism problem of dynamical systems with special regard to von Neumann’s contribution , author=. Archive for history of exact sciences , volume=. 2012 , publisher=
2012
-
[6]
Proceedings of the National Academy of Sciences , volume=
Hamiltonian systems and transformation in Hilbert space , author=. Proceedings of the National Academy of Sciences , volume=
-
[7]
1993 , publisher=
Composition operators on function spaces , author=. 1993 , publisher=
1993
-
[8]
Physica D: Nonlinear Phenomena , volume=
Comparison of systems with complex behavior , author=. Physica D: Nonlinear Phenomena , volume=. 2004 , publisher=
2004
Show all 26 references
-
[9]
Annals of Mathematics and Artificial Intelligence , volume=
Data-driven Koopman operator approach for computational neuroscience , author=. Annals of Mathematics and Artificial Intelligence , volume=. 2020 , publisher=
2020
-
[10]
Chaos: An Interdisciplinary Journal of Nonlinear Science , volume=
Data-driven modelling of brain activity using neural networks, diffusion maps, and the Koopman operator , author=. Chaos: An Interdisciplinary Journal of Nonlinear Science , volume=. 2024 , publisher=
2024
-
[11]
Advances in Neural Information Processing Systems , volume=
Learning dynamical systems via Koopman operator regression in reproducing kernel Hilbert spaces , author=. Advances in Neural Information Processing Systems , volume=
-
[12]
IEEE Robotics and Automation Letters , volume=
Deep Koopman operator with control for nonlinear systems , author=. IEEE Robotics and Automation Letters , volume=. 2022 , publisher=
2022
-
[13]
Journal of Nonlinear Science , volume=
A data--driven approximation of the Koopman operator: Extending dynamic mode decomposition , author=. Journal of Nonlinear Science , volume=. 2015 , publisher=
2015
-
[14]
SIAM Journal on Applied Dynamical Systems , volume=
Ergodic theory, dynamic mode decomposition, and computation of spectral properties of the Koopman operator , author=. SIAM Journal on Applied Dynamical Systems , volume=. 2017 , publisher=
2017
-
[15]
Hosseini and Nancy Kanwisher and Joshua B
Martin Schrimpf and Idan Asher Blank and Greta Tuckute and Carina Kauf and Eghbal A. Hosseini and Nancy Kanwisher and Joshua B. Tenenbaum and Evelina Fedorenko , title =. Proceedings of the National Academy of Sciences , volume =. 2021 , doi =. https://www.pnas.org/doi/pdf/10....
2021 doi
-
[16]
bioRxiv , pages=
A new theoretical framework jointly explains behavioral and neural variability across subjects performing flexible decision-making , author=. bioRxiv , pages=. 2022 , publisher=
2022
-
[17]
Nature biomedical engineering , volume=
Stabilization of a brain--computer interface via the alignment of low-dimensional spaces of neural activity , author=. Nature biomedical engineering , volume=. 2020 , publisher=
2020
-
[18]
Nature Communications , volume=
Stabilizing brain-computer interfaces through alignment of latent dynamics , author=. Nature Communications , volume=. 2025 , publisher=
2025
-
[19]
Nature neuroscience , volume=
The intrinsic attractor manifold and population dynamics of a canonical cognitive circuit across waking and sleep , author=. Nature neuroscience , volume=. 2019 , publisher=
2019
-
[20]
Frontiers in systems neuroscience , volume=
Representational similarity analysis-connecting the branches of systems neuroscience , author=. Frontiers in systems neuroscience , volume=. 2008 , publisher=
2008
-
[21]
Advances in neural information processing systems , volume=
Svcca: Singular vector canonical correlation analysis for deep learning dynamics and interpretability , author=. Advances in neural information processing systems , volume=
-
[22]
Advances in neural information processing systems , volume=
Generalized shape metrics on neural representations , author=. Advances in neural information processing systems , volume=
-
[23]
Nature Neuroscience , volume=
Residual dynamics resolves recurrent contributions to neural computation , author=. Nature Neuroscience , volume=. 2023 , publisher=
2023
-
[24]
arXiv preprint arXiv:2402.09735 , year=
Dform: Diffeomorphic vector field alignment for assessing dynamics across learned models , author=. arXiv preprint arXiv:2402.09735 , year=
-
[25]
Chaos: An Interdisciplinary Journal of Nonlinear Science , volume=
Applied koopmanism , author=. Chaos: An Interdisciplinary Journal of Nonlinear Science , volume=. 2012 , publisher=
2012
-
[26]
arXiv preprint arXiv:2106.11911 , year=
Residual networks as flows of velocity fields for diffeomorphic time series alignment , author=. arXiv preprint arXiv:2106.11911 , year=
Reviewed July 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.