Multi-subspace power method for decomposing partially symmetric tensors
Pith reviewed 2026-05-22 13:13 UTC · model grok-4.3
The pith
A flattening orthogonalization transforms any partially symmetric tensor so its decomposition summands become the partially symmetric singular vector tuples of the new tensor, recoverable by a globally convergent shifted power method.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
By orthogonalizing a flattening of the input tensor to obtain orthonormal slices, the summands of a low-rank partially symmetric decomposition become recoverable as the partially symmetric singular vector tuples of the resulting tensor; these tuples are computed via a shifted power iteration for which global convergence is established.
What carries the argument
Orthogonalization of a flattening to enforce orthonormal slices, allowing recovery of original decomposition factors from pSVTs of the transformed tensor, computed by the shifted power method.
If this is right
- Decompositions are obtained sequentially one summand at a time for tensors with any symmetry.
- The method applies uniformly to fully asymmetric through fully symmetric cases.
- Proven global convergence of the shifted power method guarantees reliable recovery.
- Higher accuracy and reduced runtime are observed in numerical tests versus existing techniques.
Where Pith is reading between the lines
- The orthogonalization technique might extend to other tensor factorization problems where factor alignment is an issue.
- Similar shifting strategies could improve convergence in related iterative tensor algorithms.
- This could lead to more robust tools for analyzing multi-way data with partial symmetries in applications like signal processing.
Load-bearing premise
Orthogonalizing a flattening yields a tensor whose pSVTs are precisely the factors needed to reconstruct the original tensor's decomposition.
What would settle it
Finding a counterexample tensor of low rank where applying the orthogonalization and then extracting pSVTs does not recover the true summands, or where the shifted power method diverges or converges to incorrect values.
Figures
read the original abstract
We present an algorithm for low rank decomposition of tensors of any symmetry type, from fully asymmetric to fully symmetric. It recovers the decomposition one summand at a time via the higher-order power method. This approach is known to fail in general: there need not be a relationship between the summands of a decomposition and the (partially symmetric) singular vector tuples (pSVTs) of the tensor. Our approach overcomes this problem by transforming the input to a tensor with orthonormal slices, via orthogonalization of a flattening. The summands of the decomposition of the original tensor can be recovered from the pSVTs of this new transformed tensor. We introduce a shifted power method for computing pSVTs and prove its global convergence. Numerical experiments demonstrate that our algorithm achieves higher accuracy and faster runtime than existing methods.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript proposes an algorithm for low-rank decomposition of tensors with arbitrary symmetry (from fully asymmetric to fully symmetric). It transforms the input tensor via orthogonalization of a flattening to produce a new tensor with orthonormal slices; the summands of the original decomposition are recovered from the partially symmetric singular vector tuples (pSVTs) of this transformed tensor. A shifted power method is introduced to compute the pSVTs, and a proof of its global convergence is provided. Numerical experiments are reported to demonstrate higher accuracy and faster runtime relative to existing methods.
Significance. If the transformation step correctly ensures that pSVTs of the orthonormal-slice tensor correspond to the original factors (via the inverse mapping) and if the global convergence proof for the shifted power method holds under the stated symmetry classes, the work would supply a principled way to circumvent the known failure mode of direct higher-order power iteration on general tensors. The explicit construction, the convergence argument, and the empirical gains constitute the main strengths.
major comments (2)
- [Section 3 (construction of the transformed tensor)] The central recovery claim (that pSVTs of the transformed tensor yield the original summands after the inverse mapping) is load-bearing. The manuscript should explicitly verify that the orthogonalization step preserves the partial symmetry and the factor structure for all symmetry types claimed, including the fully symmetric case; a short counter-example or additional lemma would strengthen this.
- [Section 4 (convergence analysis)] The global convergence proof for the shifted power method is presented as a new result. It would be useful to clarify the precise genericity assumptions (e.g., distinct singular values, strict inequality in the shift parameter) and to state whether the proof extends to tensors with repeated pSVTs or to the boundary cases of the symmetry spectrum.
minor comments (2)
- [Numerical experiments] In the numerical section, the comparison baselines and the precise definition of 'accuracy' (e.g., relative Frobenius error, factor recovery error) should be stated more explicitly so that the reported improvements can be reproduced.
- [Throughout] Notation for the flattening operator and the orthogonalization step could be made uniform across the text and any pseudocode to avoid minor ambiguity for readers.
Simulated Author's Rebuttal
We thank the referee for their thoughtful review and constructive feedback on our manuscript. We address each of the major comments below.
read point-by-point responses
-
Referee: [Section 3 (construction of the transformed tensor)] The central recovery claim (that pSVTs of the transformed tensor yield the original summands after the inverse mapping) is load-bearing. The manuscript should explicitly verify that the orthogonalization step preserves the partial symmetry and the factor structure for all symmetry types claimed, including the fully symmetric case; a short counter-example or additional lemma would strengthen this.
Authors: We concur that an explicit verification of this key property would strengthen the exposition. Accordingly, in the revised manuscript we will insert a new lemma in Section 3. The lemma states that the orthogonalization of the flattening preserves both the partial symmetry of the tensor and the correspondence between the original factors and the pSVTs of the transformed tensor. The argument holds uniformly across the full range of symmetry types, including the fully symmetric case, and we will provide a concise proof. revision: yes
-
Referee: [Section 4 (convergence analysis)] The global convergence proof for the shifted power method is presented as a new result. It would be useful to clarify the precise genericity assumptions (e.g., distinct singular values, strict inequality in the shift parameter) and to state whether the proof extends to tensors with repeated pSVTs or to the boundary cases of the symmetry spectrum.
Authors: We are grateful for this recommendation to refine the statement of the convergence theorem. In the revision we will explicitly list the genericity assumptions required by the proof: the pSVTs must correspond to distinct singular values, and the shift parameter must satisfy a strict inequality relative to the next singular value. We will also include a remark clarifying that the global convergence guarantee does not extend to tensors possessing repeated pSVTs or to the boundary cases of the symmetry spectrum, since the proof strategy relies on these strict conditions to rule out other attractors. revision: yes
Circularity Check
No significant circularity identified
full rationale
The paper's central construction applies standard linear-algebra operations (flattening followed by orthogonalization) to produce a transformed tensor whose partially symmetric singular vector tuples recover the original decomposition factors via an explicit inverse mapping. The shifted power method is then defined and analyzed with a new global convergence proof on this transformed object. No step reduces by construction to a fitted parameter, self-citation chain, or renamed known result; the derivation remains independent and self-contained against external benchmarks.
Axiom & Free-Parameter Ledger
axioms (2)
- domain assumption Orthogonalization of a flattening preserves the recoverable relationship between pSVTs of the transformed tensor and the original decomposition summands.
- domain assumption The shifted power method converges globally to the desired pSVTs for the class of tensors considered.
Lean theorems connected to this paper
-
IndisputableMonolith/Cost/FunctionalEquation.leanwashburn_uniqueness_aczel unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
We show that for tensors with orthonormal slices and low rank, the summands of their decomposition are in one-to-one correspondence with the partially symmetric singular vector tuples (pSVTs) with singular value one.
-
IndisputableMonolith/Foundation/DimensionForcing.leanreality_from_one_distinction unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
We introduce a shifted power method for computing pSVTs and prove its global convergence.
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Forward citations
Cited by 1 Pith paper
-
Simplicial Regularizability of the Pseudo-Moment Cone and Carath\'eodory-Type Atomic Decomposition of Moment Matrices
For generically generated moment matrices with O(n^d) atoms, the minimal face of the pseudo-moment cone is simplicial, enabling an efficient Carathéodory-type atomic decomposition algorithm.
Reference graph
Works this paper leans on
-
[1]
Abubakar Abid, Martin J Zhang, Vivek K Bagaria, and James Zou. Exploring patterns enriched in a dataset with contrastive principal component analysis.Nature Communications, 9(1):2134, 2018. 28 KEXIN W ANG, JO ˜AO M. PEREIRA, JOE KILEEL, AND ANNA SEIGAL
work page 2018
-
[2]
Hirotachi Abo. On non-defectivity of certain Segre–Veronese varieties.Journal of Symbolic Computation, 45(12):1254–1269, 2010
work page 2010
-
[3]
Hirotachi Abo, Maria Chiara Brambilla, Francesco Galuppi, and Alessandro Oneto. Non-defectivity of Segre–Veronese varieties.Proceedings of the American Mathematical Society, Series B, 11(51):589–602, 2024
work page 2024
-
[4]
Simple LU and QR based non-orthogonal matrix joint diagonalization
Bijan Afsari. Simple LU and QR based non-orthogonal matrix joint diagonalization. InInternational Conference on Independent Component Analysis and Signal Separation, pages 1–7. Springer, 2006
work page 2006
-
[5]
Animashree Anandkumar, Rong Ge, Daniel J Hsu, Sham M Kakade, Matus Telgarsky, et al. Tensor decompositions for learning latent variable models.Journal of Machine Learning Research, 15(1):2773– 2832, 2014
work page 2014
-
[6]
Homotopycontinuation.jl: A package for homotopy continuation in julia
Paul Breiding and Sascha Timme. Homotopycontinuation.jl: A package for homotopy continuation in julia. InInternational Congress on Mathematical Software, pages 458–465. Springer, 2018
work page 2018
-
[7]
Jean-Fran¸ cois Cardoso and Antoine Souloumiac. Jacobi angles for simultaneous diagonalization.SIAM Journal on Matrix Analysis and Applications, 17(1):161–164, 1996
work page 1996
-
[8]
Weakly defective varieties.Transactions of the American Mathemat- ical Society, 354(1):151–178, 2002
Luca Chiantini and Ciro Ciliberto. Weakly defective varieties.Transactions of the American Mathemat- ical Society, 354(1):151–178, 2002
work page 2002
-
[9]
Independent component analysis, a new concept?Signal Processing, 36(3):287–314, 1994
Pierre Comon. Independent component analysis, a new concept?Signal Processing, 36(3):287–314, 1994
work page 1994
-
[10]
Lieven De Lathauwer. A link between the canonical decomposition in multilinear algebra and simul- taneous matrix diagonalization.SIAM Journal on Matrix Analysis and Applications, 28(3):642–666, 2006
work page 2006
-
[11]
Lieven De Lathauwer, Pierre Comon, Bart De Moor, and Joos Vandewalle. Higher-order power method. Nonlinear Theory and its Applications, NOLTA95, 1(4), 1995
work page 1995
-
[12]
Lieven De Lathauwer, Bart De Moor, and Joos Vandewalle. Computation of the canonical decomposition by means of a simultaneous generalized Schur decomposition.SIAM Journal on Matrix Analysis and Applications, 26(2):295–327, 2004
work page 2004
-
[13]
Vin De Silva and Lek-Heng Lim. Tensor rank and the ill-posedness of the best low-rank approximation problem.SIAM Journal on Matrix Analysis and Applications, 30(3):1084–1127, 2008
work page 2008
-
[14]
Distinguishing separable and entangled states.Physical Review Letters, 88(18):187904, 2002
Andrew C Doherty, Pablo A Parrilo, and Federico M Spedalieri. Distinguishing separable and entangled states.Physical Review Letters, 88(18):187904, 2002
work page 2002
-
[15]
Jan Draisma, Giorgio Ottaviani, and Alicia Tocino. Best rank-k approximations for tensors: generalizing Eckart–Young.Research in the Mathematical Sciences, 5(2):27, 2018
work page 2018
-
[16]
William Feller.An Introduction to Probability Theory and its Applications, volume 2. John Wiley & Sons, 1991
work page 1991
-
[17]
American Mathematical Soc., 2021
Gerald B Folland.Quantum Field Theory: A Tourist Guide for Mathematicians, volume 149. American Mathematical Soc., 2021
work page 2021
-
[18]
Shmuel Friedland and Giorgio Ottaviani. The number of singular vector tuples and uniqueness of best rank-one approximation of tensors.Foundations of Computational Mathematics, 14(6):1209–1242, 2014
work page 2014
-
[19]
Laetitia Gauvin, Andr´ e Panisson, and Ciro Cattuto. Detecting the community structure and activity patterns of temporal networks: A non-negative tensor factorization approach.PloS One, 9(1):e86028, 2014
work page 2014
-
[20]
Rong Ge and Tengyu Ma. On the optimization landscape of tensor decompositions.Advances in Neural Information Processing Systems, 30, 2017
work page 2017
-
[21]
Conditions for strong ellipticity of anisotropic elastic materials
Deren Han, Hui-Hui Dai, and Liqun Qi. Conditions for strong ellipticity of anisotropic elastic materials. Journal of Elasticity, 97(1):1–13, 2009
work page 2009
-
[22]
Springer Science & Business Media, 2013
Joe Harris.Algebraic Geometry: A First Course, volume 133. Springer Science & Business Media, 2013
work page 2013
-
[23]
Richard A Harshman et al. Foundations of the PARAFAC procedure: Models and conditions for an “explanatory” multi-modal factor analysis.UCLA Working papers in Phonetics, 16(1):84, 1970
work page 1970
-
[24]
Tensor rank is NP-complete.Journal of Algorithms, 11(4):644–654, 1990
Johan H˚ astad. Tensor rank is NP-complete.Journal of Algorithms, 11(4):644–654, 1990
work page 1990
-
[25]
Most tensor problems are NP-hard.Journal of the ACM (JACM), 60(6):1–39, 2013
Christopher J Hillar and Lek-Heng Lim. Most tensor problems are NP-hard.Journal of the ACM (JACM), 60(6):1–39, 2013
work page 2013
-
[26]
Cambridge University Press, 2012
Roger A Horn and Charles R Johnson.Matrix Analysis. Cambridge University Press, 2012
work page 2012
-
[27]
Emil Horobet ¸ and Ettore Teixeira Turatti. When does subtracting a rank-one approximation decrease tensor rank?Linear Algebra and its Applications, 709:397–415, 2025. MULTI-SUBSPACE POWER METHOD 29
work page 2025
-
[28]
Computing linear sections of varieties: quantum entanglement, tensor decompositions and beyond
Nathaniel Johnston, Benjamin Lovitz, and Aravindan Vijayaraghavan. Computing linear sections of varieties: quantum entanglement, tensor decompositions and beyond. In2023 IEEE 64th Annual Sym- posium on Foundations of Computer Science (FOCS), pages 1316–1336. IEEE, 2023
work page 2023
-
[29]
Subspace power method for symmetric tensor decomposition.Numerical Algorithms, pages 1–38, 2025
Joe Kileel and Jo˜ ao M Pereira. Subspace power method for symmetric tensor decomposition.Numerical Algorithms, pages 1–38, 2025
work page 2025
-
[30]
Eleftherios Kofidis and Phillip A Regalia. On the best rank-1 approximation of higher-order supersym- metric tensors.SIAM Journal on Matrix Analysis and Applications, 23(3):863–884, 2002
work page 2002
-
[31]
Tensor decompositions and applications.SIAM Review, 51(3):455– 500, 2009
Tamara G Kolda and Brett W Bader. Tensor decompositions and applications.SIAM Review, 51(3):455– 500, 2009
work page 2009
-
[32]
Tamara G Kolda and Jackson R Mayo. Shifted power method for computing tensor eigenpairs.SIAM Journal on Matrix Analysis and Applications, 32(4):1095–1124, 2011
work page 2011
-
[33]
Joseph B Kruskal. Three-way arrays: Rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics.Linear algebra and its applications, 18(2):95–138, 1977
work page 1977
-
[34]
Cambridge University Press, 2017
Joseph M Landsberg.Geometry and Complexity Theory, volume 169. Cambridge University Press, 2017
work page 2017
-
[35]
Suhua Li, Chaoqian Li, and Yaotang Li. M-eigenvalue inclusion intervals for a fourth-order partially symmetric tensor.Journal of Computational and Applied Mathematics, 356:391–401, 2019
work page 2019
-
[36]
Singular values and eigenvalues of tensors: a variational approach
Lek-Heng Lim. Singular values and eigenvalues of tensors: a variational approach. In1st IEEE In- ternational Workshop on Computational Advances in Multi-Sensor Adaptive Processing, 2005., pages 129–132. IEEE, 2005
work page 2005
-
[37]
Ensembles semi-analytiques.IHES Notes, page 220, 1965
Stanislaw Lojasiewicz. Ensembles semi-analytiques.IHES Notes, page 220, 1965
work page 1965
-
[38]
Daniel Miao, Gilad Lerman, and Joe Kileel. Tensor-based synchronization and the low-rankness of the block trifocal tensor.Advances in Neural Information Processing Systems, 37:69505–69532, 2024
work page 2024
-
[39]
Jie Ni, Yuhong Dai, and Zheng Peng. An alternating algorithm for structure preserving CP- decompositions of partially symmetric tensors.Computational Optimization and Applications, pages 1–33, 2025
work page 2025
-
[40]
A three-way model for collective learning on multi-relational data
Maximilian Nickel, Volker Tresp, Hans-Peter Kriegel, et al. A three-way model for collective learning on multi-relational data. InInternational Conference on Machine Learning, volume 11, pages 3104482– 3104584, 2011
work page 2011
-
[41]
Jo˜ ao M Pereira, Joe Kileel, and Tamara G Kolda. Tensor moments of Gaussian mixture models: Theory and applications.arXiv preprint arXiv:2202.06930, 2022
-
[42]
Sri Priya Ponnapalli, Michael A Saunders, Charles F Van Loan, and Orly Alter. A higher-order general- ized singular value decomposition for comparison of global mRNA expression from multiple organisms. PloS One, 6(12):e28072, 2011
work page 2011
-
[43]
A real generalized trisecant trichotomy.arXiv preprint arXiv:2409.01356, 2024
Kristian Ranestad, Anna Seigal, and Kexin Wang. A real generalized trisecant trichotomy.arXiv preprint arXiv:2409.01356, 2024
-
[44]
Monotonic convergence of fixed-point algorithms for ICA
Phillip A Regalia and Eleftherios Kofidis. Monotonic convergence of fixed-point algorithms for ICA. IEEE Transactions on Neural Networks, 14(4):943–949, 2003
work page 2003
-
[45]
Werner C Rheinboldt.Methods for Solving Systems of Nonlinear Equations. SIAM, 1998
work page 1998
-
[46]
Decomposing tensors via rank- one approximations.arXiv:2411.15935, 2024
Alvaro Ribot, Emil Horobet, Anna Seigal, and Ettore Teixeira Turatti. Decomposing tensors via rank- one approximations.arXiv:2411.15935, 2024
-
[47]
Elina Robeva. Orthogonal decomposition of symmetric tensors.SIAM Journal on Matrix Analysis and Applications, 37(1):86–102, 2016
work page 2016
-
[48]
Elina Robeva and Anna Seigal. Singular vectors of orthogonally decomposable tensors.Linear and Multilinear Algebra, 65(12):2457–2471, 2017
work page 2017
-
[49]
Reinhold Schneider and Andr´ e Uschmajew. Convergence results for projected line-search methods on varieties of low-rank matrices via Lojasiewicz inequality.SIAM Journal on Optimization, 25(1):622–646, 2015
work page 2015
-
[50]
Subtracting a best rank-1 approximation may increase tensor rank
Alwin Stegeman and Pierre Comon. Subtracting a best rank-1 approximation may increase tensor rank. Linear Algebra and its Applications, 433(7):1276–1300, 2010
work page 2010
-
[51]
A new convergence proof for the higher-order power method and generalizations
Andr´ e Uschmajew. A new convergence proof for the higher-order power method and generalizations. arXiv preprint arXiv:1407.4586, 2014
work page internal anchor Pith review Pith/arXiv arXiv 2014
-
[52]
Identifiability of deep poly- nomial neural networks.arXiv preprint arXiv:2506.17093, 2025
Konstantin Usevich, Clara D´ erand, Ricardo Borsoi, and Marianne Clausel. Identifiability of deep poly- nomial neural networks.arXiv preprint arXiv:2506.17093, 2025. 30 KEXIN W ANG, JO ˜AO M. PEREIRA, JOE KILEEL, AND ANNA SEIGAL
-
[53]
Nick Vannieuwenhoven, Johannes Nicaise, Raf Vandebril, and Karl Meerbergen. On generic nonexistence of the Schmidt–Eckart–Young decomposition for complex tensors.SIAM Journal on Matrix Analysis and Applications, 35(3):886–903, 2014
work page 2014
-
[54]
Nico Vervliet, Otto Debals, Laurent Sorber, Marc Van Barel, and Lieven De Lathauwer. Tensorlab 3.0, Mar. 2016. Available online
work page 2016
-
[55]
Contrastive independent component analysis.arXiv preprint arXiv:2407.02357, 2024
Kexin Wang, Aida Maraj, and Anna Seigal. Contrastive independent component analysis.arXiv preprint arXiv:2407.02357, 2024
-
[56]
American Mathematical Soc., 1934
Joseph Henry Maclagan Wedderburn.Lectures on Matrices, volume 17. American Mathematical Soc., 1934
work page 1934
-
[57]
Yifan Zhang and Joe Kileel. Moment estimation for nonparametric mixture models through implicit tensor decomposition.SIAM Journal on Mathematics of Data Science, 5(4):1130–1159, 2023
work page 2023
-
[58]
Andreas Ziehe, Pavel Laskov, Guido Nolte, and Klaus-Robert M¨ uller. A fast algorithm for joint diago- nalization with non-orthogonal transformations and its application to blind source separation.Journal of Machine Learning Research, 5(Jul):777–800, 2004. Appendix A. Proofs in Section 5 LemmaA.1.Fix a tensorT (f) ∈⊗ℓ i=1 Sfi(Rmi)⊗Rr whose last slicesS 1,...
work page 2004
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.