REVIEW 3 major objections 2 minor 24 references
Routing on the Stiefel Manifold: When Does Adaptive Subspace Selection Help for Cross-Domain EEG Decoding?
T0 review · 3 major / 2 minor · reviewed 2026-06-28 · grok-4.3
Pith's one-line read Dynamic routing on the Stiefel manifold improves cross-domain EEG decoding when three properties prevent collapse to ensemble averaging.
desk verdict The paper proves naive Stiefel routing collapses to averaging and claims three fixes produce genuinely committed per-sample routing with accuracy gains on EEG data, but lacks the derivations and routing diagnostics needed to confirm it works as stated. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
Dynamic Stiefel routing: a pool of K expert projection filters on the Stiefel manifold, each specialised for a different region of the SPD manifold, with inputs routed via cross-attention and degeneracy broken by the three listed structural properties.
What would settle it
A controlled experiment in which the three properties are present yet routing weights remain uniform across samples or final accuracy fails to exceed that of a single fixed filter would falsify the claim that committed domain-structured routing has been achieved.
Extended reading notes
Core claim
When routing weights are uniform the adaptive filter reduces exactly to an equal-contribution combination of experts, indistinguishable from a single fixed filter. Three structural properties break this degeneracy: a symmetric anchor W_base in St(n,k) that removes proximity bias among experts; a frozen domain-discriminative query encoder that decouples routing from task optimisation; and a decoupled key alignment loss that trains expert keys toward stable domain attractors. Together they produce the first genuinely committed and domain-structured routing on SPD manifolds, with balanced accuracy improving from 0.773 to 0.823, 0.757 to 0.809, and 0.801 to 0.839 across three datasets, the align
Load-bearing premise
The three structural properties are sufficient to break the collapse to ensemble averaging while preserving generalization and without reintroducing proximity bias or hidden per-dataset tuning.
Editorial extensions
If this is right
- Routing weights become non-uniform and sample-specific rather than reducing to averaging.
- The alignment strategy is fixed automatically by one data-driven rule with no per-dataset hyperparameter search.
- Balanced accuracy rises consistently on each of the three evaluated datasets.
- The method requires no target-domain calibration data at inference time.
Reading between the lines
- The same three-property recipe might stabilise routing on other matrix manifolds used in signal processing.
- Freezing the query encoder could be tested in other attention-based adaptation pipelines to separate routing from task loss.
- The data-driven alignment rule might generalise to unsupervised domain discovery without explicit labels.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces dynamic Stiefel routing for cross-domain EEG decoding on the SPD manifold. It claims that a naive implementation of routing a pool of K expert projection filters via cross-attention provably collapses to ensemble averaging under uniform weights. Three structural properties are proposed to break this: a symmetric anchor W_base in St(n,k), a frozen domain-discriminative query encoder, and a decoupled key alignment loss. These enable genuinely committed domain-structured routing, yielding balanced accuracy improvements from 0.773 to 0.823, 0.757 to 0.809, and 0.801 to 0.839 on three datasets, with the alignment strategy determined by a single data-driven rule without per-dataset hyperparameter search.
Significance. If the collapse result is rigorously proven and the three properties ensure non-uniform, sample-adaptive routing without reintroducing bias or requiring hidden tuning, the work would be significant for advancing adaptive methods in Riemannian geometry-based EEG decoding, offering a generalizable approach to subspace selection across domains.
major comments (3)
- [Abstract] Abstract: the claim of a 'provable collapse' result (that uniform routing weights reduce the adaptive filter exactly to an equal-contribution combination of experts) is presented as a central mathematical identity, but the manuscript provides no derivation, equation, or proof details to support it.
- [Abstract] Abstract: the reported accuracy gains (0.773→0.823, 0.757→0.809, 0.801→0.839) are stated without error bars, statistical tests, baseline definitions, or controls, which is load-bearing for the claim that the three fixes produce genuinely committed routing rather than other effects.
- [Abstract] Abstract: the assertion that the three structural properties (symmetric anchor W_base, frozen query encoder, decoupled key alignment loss) break the degeneracy while ensuring non-uniform per-sample routing and domain structure lacks any referenced analysis (e.g., routing entropy or expert utilization) or validation that the single data-driven rule generalizes without implicit tuning.
minor comments (2)
- [Abstract] The abstract introduces invented entities (symmetric anchor W_base, frozen domain-discriminative query encoder, decoupled key alignment loss) without clarifying their precise implementation or interaction with the Stiefel manifold routing mechanism.
- Notation for K (number of experts) and St(n,k) is used without explicit definition or relation to the free parameters in the model.
Simulated Author's Rebuttal
We thank the referee for the constructive feedback on the abstract. We address each major comment below and will make revisions to incorporate the requested details and references.
read point-by-point responses
-
Referee: [Abstract] Abstract: the claim of a 'provable collapse' result (that uniform routing weights reduce the adaptive filter exactly to an equal-contribution combination of experts) is presented as a central mathematical identity, but the manuscript provides no derivation, equation, or proof details to support it.
Authors: We agree that the abstract does not contain the derivation. We will revise the manuscript to include a concise statement of the key identity (uniform weights yield W_eff equal to the expert average) with a reference to the full proof, which we will ensure is explicitly derived in the main text. revision: yes
-
Referee: [Abstract] Abstract: the reported accuracy gains (0.773→0.823, 0.757→0.809, 0.801→0.839) are stated without error bars, statistical tests, baseline definitions, or controls, which is load-bearing for the claim that the three fixes produce genuinely committed routing rather than other effects.
Authors: We agree that the abstract would benefit from additional context on the reported gains. We will revise to note that the improvements are from cross-validation with error bars and statistical tests reported in the results section, along with explicit baseline definitions. revision: yes
-
Referee: [Abstract] Abstract: the assertion that the three structural properties (symmetric anchor W_base, frozen query encoder, decoupled key alignment loss) break the degeneracy while ensuring non-uniform per-sample routing and domain structure lacks any referenced analysis (e.g., routing entropy or expert utilization) or validation that the single data-driven rule generalizes without implicit tuning.
Authors: We agree that the abstract should reference the supporting analyses. We will revise to cite the routing entropy and expert utilization results from the experimental section that validate non-uniform routing and domain structure, and to note the data-driven rule's generalization across datasets. revision: yes
Circularity Check
No circularity: collapse identity and structural fixes are independent of reported gains
full rationale
The paper states a mathematical identity (naive routing with uniform weights collapses exactly to ensemble averaging) and then lists three structural properties (symmetric anchor, frozen query encoder, decoupled key loss) as additions that break the degeneracy. These are presented as independent design choices rather than quantities fitted inside the same equations or derived from self-citations. The accuracy gains (0.773→0.823 etc.) are reported as empirical outcomes with a single data-driven rule; no equations or self-citation chains are shown that would force the gains by construction. The derivation chain therefore remains self-contained against external benchmarks.
Assumptions & free parameters
free parameters (1)
- K (number of experts)
assumptions (1)
- domain assumption Covariance matrices from different subjects occupy systematically distinct regions of the SPD manifold.
invented entities (3)
-
symmetric anchor W_base in St(n,k)
-
frozen domain-discriminative query encoder
-
decoupled key alignment loss
Cite this review
Pith. "Pith review of Routing on the Stiefel Manifold: When Does Adaptive Subspace Selection Help for Cross-Domain EEG Decoding?." pith.science (2026). https://pith.science/paper/7OJ32N3Y
@misc{pith2026260531043,
author = {Pith},
title = {Pith review of: Routing on the Stiefel Manifold: When Does Adaptive Subspace Selection Help for Cross-Domain EEG Decoding?},
year = {2026},
howpublished = {\url{https://pith.science/paper/7OJ32N3Y}},
note = {Machine review of arXiv:2605.31043}
}
abstract
Cross-domain EEG decoding remains challenging despite advances in Riemannian deep learning: covariance matrices from different subjects occupy systematically distinct regions of the SPD manifold, yet existing domain adaptation methods either require target-domain calibration data or learn subject-specific components that cannot generalise across domains. We propose dynamic Stiefel routing: a pool of $K$ expert projection filters on the Stiefel manifold, each specialised for a different region of the SPD manifold, with each input covariance routed to the most appropriate filter via cross-attention, adapting the subspace projection per sample. A central finding is that this approach, implemented naively, provably collapses to ensemble averaging: when routing weights are uniform, the adaptive filter reduces exactly to an equal-contribution combination of experts, indistinguishable from a single fixed filter. Three structural properties break this degeneracy: a symmetric anchor $W_{\mathrm{base}} \in \mathrm{St}(n,k)$ that removes proximity bias among experts; a frozen domain-discriminative query encoder that decouples routing from task optimisation; and a decoupled key alignment loss that trains expert keys toward stable domain attractors. Together they produce the first genuinely committed and domain-structured routing on SPD manifolds, with consistent gains across three datasets: balanced accuracy improves from $0.773\to 0.823$, $0.757\to 0.809$, and $0.801\to 0.839$, with the alignment strategy determined automatically by a single data-driven rule and no dataset-specific hyperparameter search.
Figures
Reference graph
Works this paper leans on
-
[1]
Multiclass brain-computer interface classification by Riemannian geometry
Barachant, A., Bonnet, S., Congedo, M., and Jutten, C. Multiclass brain-computer interface classification by Riemannian geometry. IEEE Trans.\ Biomed.\ Eng., 59(4):920--928, 2012
2012
-
[2]
Optimizing spatial filters for robust EEG single-trial analysis
Blankertz, B., Tomioka, R., Lemm, S., Kawanabe, M., and Müller, K.-R. Optimizing spatial filters for robust EEG single-trial analysis. IEEE Signal Process.\ Mag., 25(1):41--56, 2008
2008
-
[3]
Riemannian batch normalization for SPD neural networks
Brooks, D., Schwander, O., Barbaresco, F., Schneider, J.-Y., and Cord, M. Riemannian batch normalization for SPD neural networks. NeurIPS, 32, 2019
2019
-
[4]
A., and Smith, S
Edelman, A., Arias, T. A., and Smith, S. T. The geometry of algorithms with orthogonality constraints. SIAM J.\ Matrix Anal.\ Appl., 20(2):303--353, 1998
1998
-
[5]
Switch transformers: Scaling to trillion parameter models with simple and efficient sparsity
Fedus, W., Zoph, B., and Shazeer, N. Switch transformers: Scaling to trillion parameter models with simple and efficient sparsity. JMLR, 23(1):1--39, 2022
2022
-
[6]
and Van Gool, L
Huang, Z. and Van Gool, L. A Riemannian network for SPD matrix learning. AAAI, 2017
2017
-
[7]
J., Hirayama, J.-I., Zhao, Q., and Kawanabe, M
Kobler, R. J., Hirayama, J.-I., Zhao, Q., and Kawanabe, M. SPD domain-specific batch normalization to crack interpretable unsupervised domain adaptation in EEG. NeurIPS, 35, 2022
2022
-
[8]
Rodrigues P. L. C., et al. Riemannian Procrustes Analysis: Transfer Learning for Brain–Computer Interfaces IEEE Transactions on Biomedical Engineering, vol. 66, no. 8, pp. 2390-2401, Aug. 2019
2019
Show all 24 references
-
[9]
Shazeer, N. et al. Outrageously large neural networks: The sparsely-gated mixture-of-experts layer. ICLR, 2017
2017
-
[10]
Faller, C
J. Faller, C. Vidaurre, T. Solis-Escalante, C. Neuper and R. Scherer, Autocalibration and Recurrent Adaptation: Towards a Plug and Play Online ERD-BCI IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 20, no. 3, pp. 313-319, May 2012
2012
-
[11]
Tangermann, M. et al. Review of the BCI competition IV. Front.\ Neurosci., 6:55, 2012
2012
-
[12]
Wang, Z. et al. Learning to prompt for continual learning. CVPR, 2022
2022
-
[13]
Wang, Z. et al. DualPrompt: Complementary prompting for rehearsal-free continual learning. ECCV, 2022
2022
-
[14]
Zanini, P. et al. Transfer learning: A Riemannian geometry framework with applications to BCIs. IEEE Trans.\ Biomed.\ Eng., 65(5):1107--1116, 2017
2017
-
[15]
Congedo, M. et al. Riemannian geometry for EEG-based brain-computer interfaces; a primer and a review. Brain-Computer Interfaces, 4(3), 155--174
-
[16]
An image is worth 16x16 words: Transformers for image recognition at scale
Dosovitskiy, et al. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929, 2020
2010 arXiv
-
[17]
Evaluation of EEG oscillatory patterns and cognitive process during simple and compound limb motor imagery
Yi, Weibo, et al. Evaluation of EEG oscillatory patterns and cognitive process during simple and compound limb motor imagery. PloS, one 9.12 (2014): e114853
2014
-
[18]
PyTorch: An imperative style, high-performance deep learning library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. PyTorch: An imperative style, high-performance deep learning library. Advances in Neural Information Processing Systems, 32, 2019
2019
-
[19]
Kingma, D. P. and Ba, J. Adam: A method for stochastic optimization. International Conference on Learning Representations, 2015
2015
-
[20]
Optimization Algorithms on Matrix Manifolds
Absil, P.-A., Mahony, R., and Sepulchre, R. Optimization Algorithms on Matrix Manifolds. Princeton University Press, 2008
2008
-
[21]
Golub, G. H. and Van Loan, C. F. Matrix Computations. Johns Hopkins University Press, 4th edition, 2013
2013
-
[22]
Aristimunha, B. et al. SPD Learn: A Geometric Deep Learning Python Library for Neural Decoding Through Trivialization. arXiv preprint arXiv:2602.22895, 2026
2026
-
[23]
ARMAGNAC: A New Parametric Batch Normalization Layer for SPDNet Architecture
Gallet, M., Bouchard, F., Mian, A., and Ginolhac, G. ARMAGNAC: A New Parametric Batch Normalization Layer for SPDNet Architecture. HAL preprint hal-05529546, 2026
2026
-
[24]
A Riemannian framework for tensor computing
Pennec, X., Fillard, P., Ayache, N. A Riemannian framework for tensor computing. Int J Comput Vision, 66(1):41--66, 2006
2006
Reviewed June 28, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.