pith. sign in

arxiv: 2510.18627 · v2 · pith:EOLQM7PWnew · submitted 2025-10-21 · 🧮 math.NA · cs.NA

Multi-subspace power method for decomposing partially symmetric tensors

Pith reviewed 2026-05-22 13:13 UTC · model grok-4.3

classification 🧮 math.NA cs.NA
keywords tensor decompositionpower methodpartially symmetric tensorsorthogonalizationlow-rank decompositionsingular vector tuplesnumerical algorithm
0
0 comments X

The pith

A flattening orthogonalization transforms any partially symmetric tensor so its decomposition summands become the partially symmetric singular vector tuples of the new tensor, recoverable by a globally convergent shifted power method.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper develops an algorithm to decompose low-rank tensors regardless of their symmetry type. Standard higher-order power methods fail in general because decomposition summands are not aligned with the tensor's singular vector tuples. The key step is to orthogonalize a flattening of the input tensor, producing a new tensor with orthonormal slices from which the original summands can be read off the partially symmetric singular vector tuples. A shifted power method is proposed to compute these tuples and is proven to converge globally. Tests confirm better accuracy and speed compared to previous approaches.

Core claim

By orthogonalizing a flattening of the input tensor to obtain orthonormal slices, the summands of a low-rank partially symmetric decomposition become recoverable as the partially symmetric singular vector tuples of the resulting tensor; these tuples are computed via a shifted power iteration for which global convergence is established.

What carries the argument

Orthogonalization of a flattening to enforce orthonormal slices, allowing recovery of original decomposition factors from pSVTs of the transformed tensor, computed by the shifted power method.

If this is right

  • Decompositions are obtained sequentially one summand at a time for tensors with any symmetry.
  • The method applies uniformly to fully asymmetric through fully symmetric cases.
  • Proven global convergence of the shifted power method guarantees reliable recovery.
  • Higher accuracy and reduced runtime are observed in numerical tests versus existing techniques.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The orthogonalization technique might extend to other tensor factorization problems where factor alignment is an issue.
  • Similar shifting strategies could improve convergence in related iterative tensor algorithms.
  • This could lead to more robust tools for analyzing multi-way data with partial symmetries in applications like signal processing.

Load-bearing premise

Orthogonalizing a flattening yields a tensor whose pSVTs are precisely the factors needed to reconstruct the original tensor's decomposition.

What would settle it

Finding a counterexample tensor of low rank where applying the orthogonalization and then extracting pSVTs does not recover the true summands, or where the shifted power method diverges or converges to incorrect values.

Figures

Figures reproduced from arXiv: 2510.18627 by Anna Seigal, Jo\~ao M. Pereira, Joe Kileel, Kexin Wang.

Figure 1
Figure 1. Figure 1: Building a tensor with last slices orthonormal from a general ten￾sor. A fourth-order tensor T is represented as a 4D hypercube. Flattening with f = (1, 1, 0, 0) combines the first two directions to be columns in the flat￾tening matrix T(f) . The SVD yields the left singular vectors U. The columns of U are reshaped into tensors and stacked to form the tensor T (f) . approximation of a tensor to the rank-on… view at source ↗
Figure 2
Figure 2. Figure 2: The maximal rank r(f) for S 4(R20)⊗ Rm with m ∈ [2, 120] for all flattenings f. The quantity r(f) is piecewise linear in m in this case. 5. A partially symmetric power method In this section we consider a power method for computing pSVTs of partially sym￾metric tensors, which unifies two classical algorithms: the Higher-Order Power Method (HOPM) [11] and the shifted power method for symmetric tensors [32].… view at source ↗
Figure 3
Figure 3. Figure 3: Symmetry–breaking case d = (1, 2, 1), f = (1, 1, 0): use shared vectors and the row space of T(f) to recover the full summand. When f is not symmetry breaking (for example d = (1, 1, 1, 1), f = (1, 1, 0, 0)), one flattening is insufficient. In this case we use two tuples f, f′ satisfying (20) f ′ ≠ d − f, min(f, f′ ) ≠ 0, f ≯ f ′ , where min(f, f′) ≠ 0 means ∄i such that fi = f ′ i = 0 and proceed as follo… view at source ↗
Figure 4
Figure 4. Figure 4: Steps to recover the rank-one tensor in the non-symmetry breaking case where d = (1, 1, 1, 1), f = (1, 1, 0, 0), f′ = (1, 0, 1, 0). We summarize the procedure for recovering R(d−f) in Algorithm 3. We next show how to recover a rank-one tensor in a linear subspace when some of its factors are known. Theorem 6.2. Let A = span{ ⊗ ℓ j=1 (v (j) i ) ⊗dj ∶ 1 ≤ i ≤ r }, where the vectors v (j) i are generic with n… view at source ↗
Figure 5
Figure 5. Figure 5: Basin of attraction for pSVTs of T (f) under random initialization. Each point is an initialization vector c = [1, x, y] T. It is colored according to which rank-one component (ai ,bi) PS-HOPM converges to. The three pSVTs are all attractors, converged to with comparable frequency. ● r(2, 1) = min {(n+1 2 ), ( n+1 2 )k + 1 − n − k} = ( n+1 2 ) ● r(3, 1) = min {n, ( n+2 3 )k + 1 − n − k} = n We have r(3, 1)… view at source ↗
Figure 6
Figure 6. Figure 6: Comparison of methods to decompose a (2, 1)-partially symmetric tensor in terms of accuracy and runtime. The ground truth tensor is Ttrue = ∑ 80 i=1 λia ⊗2 i ⊗bi ∈ S 2(R100) × R50 where ai are orthogonal. Larger, more opaque markers indicate runs that occurred with higher frequency across 40 trials. 7.1.2. Generic Case. When ai are drawn from normalized Gaussian vectors without or￾thogonalization, the prob… view at source ↗
Figure 7
Figure 7. Figure 7: Comparison of methods for decomposing a (2, 1)-partially sym￾metric tensor in terms of accuracy and runtime. The ground truth tensor is Ttrue = ∑ 80 i=1 λia ⊗2 i ⊗ bi ∈ S 2(R100) × R50 where ai are generic Gaussian vectors normalized to unit length. 7.2. (4,1) Symmetry. We generate the ground-truth low-rank tensor as Ttrue = r ∑ i=1 λia ⊗4 i ⊗ bi ∈ S 4 (R 25) ⊗ R 10, r = 50, where ai and bi are sampled wit… view at source ↗
Figure 8
Figure 8. Figure 8: plots the runtime and reconstruction error in log-log scale for all seven methods over 40 noisy synthetic tensors. Across all trials in the (4,1) case, MSPM is the most accurate and the fastest. The asym-avg variants reach similar accuracy but require longer runtimes. Enforcing symmetry within MSPM provides a 1.3× speedup. 10−1 10−0.5 100 100.5 101 10−0.5 100 100.5 101 101.5 102 Reconstruction Error Runtim… view at source ↗
Figure 9
Figure 9. Figure 9: Comparison of decomposition methods for asymmetric tensors in R100×100×100 with rank 80. Each point is a single run. 8. Conclusion We introduced the Multi-Subspace Power Method (MSPM), an algorithm for decomposing tensors with arbitrary partial symmetries. Our algorithm transforms an input tensor into one with orthonormal slices. We showed that such tensors have rank decompositions whose summands are in on… view at source ↗
read the original abstract

We present an algorithm for low rank decomposition of tensors of any symmetry type, from fully asymmetric to fully symmetric. It recovers the decomposition one summand at a time via the higher-order power method. This approach is known to fail in general: there need not be a relationship between the summands of a decomposition and the (partially symmetric) singular vector tuples (pSVTs) of the tensor. Our approach overcomes this problem by transforming the input to a tensor with orthonormal slices, via orthogonalization of a flattening. The summands of the decomposition of the original tensor can be recovered from the pSVTs of this new transformed tensor. We introduce a shifted power method for computing pSVTs and prove its global convergence. Numerical experiments demonstrate that our algorithm achieves higher accuracy and faster runtime than existing methods.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

2 major / 2 minor

Summary. The manuscript proposes an algorithm for low-rank decomposition of tensors with arbitrary symmetry (from fully asymmetric to fully symmetric). It transforms the input tensor via orthogonalization of a flattening to produce a new tensor with orthonormal slices; the summands of the original decomposition are recovered from the partially symmetric singular vector tuples (pSVTs) of this transformed tensor. A shifted power method is introduced to compute the pSVTs, and a proof of its global convergence is provided. Numerical experiments are reported to demonstrate higher accuracy and faster runtime relative to existing methods.

Significance. If the transformation step correctly ensures that pSVTs of the orthonormal-slice tensor correspond to the original factors (via the inverse mapping) and if the global convergence proof for the shifted power method holds under the stated symmetry classes, the work would supply a principled way to circumvent the known failure mode of direct higher-order power iteration on general tensors. The explicit construction, the convergence argument, and the empirical gains constitute the main strengths.

major comments (2)
  1. [Section 3 (construction of the transformed tensor)] The central recovery claim (that pSVTs of the transformed tensor yield the original summands after the inverse mapping) is load-bearing. The manuscript should explicitly verify that the orthogonalization step preserves the partial symmetry and the factor structure for all symmetry types claimed, including the fully symmetric case; a short counter-example or additional lemma would strengthen this.
  2. [Section 4 (convergence analysis)] The global convergence proof for the shifted power method is presented as a new result. It would be useful to clarify the precise genericity assumptions (e.g., distinct singular values, strict inequality in the shift parameter) and to state whether the proof extends to tensors with repeated pSVTs or to the boundary cases of the symmetry spectrum.
minor comments (2)
  1. [Numerical experiments] In the numerical section, the comparison baselines and the precise definition of 'accuracy' (e.g., relative Frobenius error, factor recovery error) should be stated more explicitly so that the reported improvements can be reproduced.
  2. [Throughout] Notation for the flattening operator and the orthogonalization step could be made uniform across the text and any pseudocode to avoid minor ambiguity for readers.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for their thoughtful review and constructive feedback on our manuscript. We address each of the major comments below.

read point-by-point responses
  1. Referee: [Section 3 (construction of the transformed tensor)] The central recovery claim (that pSVTs of the transformed tensor yield the original summands after the inverse mapping) is load-bearing. The manuscript should explicitly verify that the orthogonalization step preserves the partial symmetry and the factor structure for all symmetry types claimed, including the fully symmetric case; a short counter-example or additional lemma would strengthen this.

    Authors: We concur that an explicit verification of this key property would strengthen the exposition. Accordingly, in the revised manuscript we will insert a new lemma in Section 3. The lemma states that the orthogonalization of the flattening preserves both the partial symmetry of the tensor and the correspondence between the original factors and the pSVTs of the transformed tensor. The argument holds uniformly across the full range of symmetry types, including the fully symmetric case, and we will provide a concise proof. revision: yes

  2. Referee: [Section 4 (convergence analysis)] The global convergence proof for the shifted power method is presented as a new result. It would be useful to clarify the precise genericity assumptions (e.g., distinct singular values, strict inequality in the shift parameter) and to state whether the proof extends to tensors with repeated pSVTs or to the boundary cases of the symmetry spectrum.

    Authors: We are grateful for this recommendation to refine the statement of the convergence theorem. In the revision we will explicitly list the genericity assumptions required by the proof: the pSVTs must correspond to distinct singular values, and the shift parameter must satisfy a strict inequality relative to the next singular value. We will also include a remark clarifying that the global convergence guarantee does not extend to tensors possessing repeated pSVTs or to the boundary cases of the symmetry spectrum, since the proof strategy relies on these strict conditions to rule out other attractors. revision: yes

Circularity Check

0 steps flagged

No significant circularity identified

full rationale

The paper's central construction applies standard linear-algebra operations (flattening followed by orthogonalization) to produce a transformed tensor whose partially symmetric singular vector tuples recover the original decomposition factors via an explicit inverse mapping. The shifted power method is then defined and analyzed with a new global convergence proof on this transformed object. No step reduces by construction to a fitted parameter, self-citation chain, or renamed known result; the derivation remains independent and self-contained against external benchmarks.

Axiom & Free-Parameter Ledger

0 free parameters · 2 axioms · 0 invented entities

Based on abstract only; the approach relies on standard assumptions from multilinear algebra and numerical analysis such as existence of low-rank decompositions and properties of orthogonal transformations.

axioms (2)
  • domain assumption Orthogonalization of a flattening preserves the recoverable relationship between pSVTs of the transformed tensor and the original decomposition summands.
    Invoked when the paper states that summands can be recovered from pSVTs of the new tensor.
  • domain assumption The shifted power method converges globally to the desired pSVTs for the class of tensors considered.
    Central to the claimed proof of global convergence.

pith-pipeline@v0.9.0 · 5672 in / 1409 out tokens · 35963 ms · 2026-05-22T13:13:53.393067+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Lean theorems connected to this paper

Citations machine-checked in the Pith Canon. Every link opens the source theorem in the public Lean library.

What do these tags mean?
matches
The paper's claim is directly supported by a theorem in the formal canon.
supports
The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
extends
The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
uses
The paper appears to rely on the theorem as machinery.
contradicts
The paper's claim conflicts with a theorem or certificate in the canon.
unclear
Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Simplicial Regularizability of the Pseudo-Moment Cone and Carath\'eodory-Type Atomic Decomposition of Moment Matrices

    math.OC 2026-05 unverdicted novelty 7.0

    For generically generated moment matrices with O(n^d) atoms, the minimal face of the pseudo-moment cone is simplicial, enabling an efficient Carathéodory-type atomic decomposition algorithm.

Reference graph

Works this paper leans on

58 extracted references · 58 canonical work pages · cited by 1 Pith paper · 1 internal anchor

  1. [1]

    Exploring patterns enriched in a dataset with contrastive principal component analysis.Nature Communications, 9(1):2134, 2018

    Abubakar Abid, Martin J Zhang, Vivek K Bagaria, and James Zou. Exploring patterns enriched in a dataset with contrastive principal component analysis.Nature Communications, 9(1):2134, 2018. 28 KEXIN W ANG, JO ˜AO M. PEREIRA, JOE KILEEL, AND ANNA SEIGAL

  2. [2]

    On non-defectivity of certain Segre–Veronese varieties.Journal of Symbolic Computation, 45(12):1254–1269, 2010

    Hirotachi Abo. On non-defectivity of certain Segre–Veronese varieties.Journal of Symbolic Computation, 45(12):1254–1269, 2010

  3. [3]

    Non-defectivity of Segre–Veronese varieties.Proceedings of the American Mathematical Society, Series B, 11(51):589–602, 2024

    Hirotachi Abo, Maria Chiara Brambilla, Francesco Galuppi, and Alessandro Oneto. Non-defectivity of Segre–Veronese varieties.Proceedings of the American Mathematical Society, Series B, 11(51):589–602, 2024

  4. [4]

    Simple LU and QR based non-orthogonal matrix joint diagonalization

    Bijan Afsari. Simple LU and QR based non-orthogonal matrix joint diagonalization. InInternational Conference on Independent Component Analysis and Signal Separation, pages 1–7. Springer, 2006

  5. [5]

    Tensor decompositions for learning latent variable models.Journal of Machine Learning Research, 15(1):2773– 2832, 2014

    Animashree Anandkumar, Rong Ge, Daniel J Hsu, Sham M Kakade, Matus Telgarsky, et al. Tensor decompositions for learning latent variable models.Journal of Machine Learning Research, 15(1):2773– 2832, 2014

  6. [6]

    Homotopycontinuation.jl: A package for homotopy continuation in julia

    Paul Breiding and Sascha Timme. Homotopycontinuation.jl: A package for homotopy continuation in julia. InInternational Congress on Mathematical Software, pages 458–465. Springer, 2018

  7. [7]

    Jacobi angles for simultaneous diagonalization.SIAM Journal on Matrix Analysis and Applications, 17(1):161–164, 1996

    Jean-Fran¸ cois Cardoso and Antoine Souloumiac. Jacobi angles for simultaneous diagonalization.SIAM Journal on Matrix Analysis and Applications, 17(1):161–164, 1996

  8. [8]

    Weakly defective varieties.Transactions of the American Mathemat- ical Society, 354(1):151–178, 2002

    Luca Chiantini and Ciro Ciliberto. Weakly defective varieties.Transactions of the American Mathemat- ical Society, 354(1):151–178, 2002

  9. [9]

    Independent component analysis, a new concept?Signal Processing, 36(3):287–314, 1994

    Pierre Comon. Independent component analysis, a new concept?Signal Processing, 36(3):287–314, 1994

  10. [10]

    A link between the canonical decomposition in multilinear algebra and simul- taneous matrix diagonalization.SIAM Journal on Matrix Analysis and Applications, 28(3):642–666, 2006

    Lieven De Lathauwer. A link between the canonical decomposition in multilinear algebra and simul- taneous matrix diagonalization.SIAM Journal on Matrix Analysis and Applications, 28(3):642–666, 2006

  11. [11]

    Higher-order power method

    Lieven De Lathauwer, Pierre Comon, Bart De Moor, and Joos Vandewalle. Higher-order power method. Nonlinear Theory and its Applications, NOLTA95, 1(4), 1995

  12. [12]

    Computation of the canonical decomposition by means of a simultaneous generalized Schur decomposition.SIAM Journal on Matrix Analysis and Applications, 26(2):295–327, 2004

    Lieven De Lathauwer, Bart De Moor, and Joos Vandewalle. Computation of the canonical decomposition by means of a simultaneous generalized Schur decomposition.SIAM Journal on Matrix Analysis and Applications, 26(2):295–327, 2004

  13. [13]

    Tensor rank and the ill-posedness of the best low-rank approximation problem.SIAM Journal on Matrix Analysis and Applications, 30(3):1084–1127, 2008

    Vin De Silva and Lek-Heng Lim. Tensor rank and the ill-posedness of the best low-rank approximation problem.SIAM Journal on Matrix Analysis and Applications, 30(3):1084–1127, 2008

  14. [14]

    Distinguishing separable and entangled states.Physical Review Letters, 88(18):187904, 2002

    Andrew C Doherty, Pablo A Parrilo, and Federico M Spedalieri. Distinguishing separable and entangled states.Physical Review Letters, 88(18):187904, 2002

  15. [15]

    Best rank-k approximations for tensors: generalizing Eckart–Young.Research in the Mathematical Sciences, 5(2):27, 2018

    Jan Draisma, Giorgio Ottaviani, and Alicia Tocino. Best rank-k approximations for tensors: generalizing Eckart–Young.Research in the Mathematical Sciences, 5(2):27, 2018

  16. [16]

    John Wiley & Sons, 1991

    William Feller.An Introduction to Probability Theory and its Applications, volume 2. John Wiley & Sons, 1991

  17. [17]

    American Mathematical Soc., 2021

    Gerald B Folland.Quantum Field Theory: A Tourist Guide for Mathematicians, volume 149. American Mathematical Soc., 2021

  18. [18]

    The number of singular vector tuples and uniqueness of best rank-one approximation of tensors.Foundations of Computational Mathematics, 14(6):1209–1242, 2014

    Shmuel Friedland and Giorgio Ottaviani. The number of singular vector tuples and uniqueness of best rank-one approximation of tensors.Foundations of Computational Mathematics, 14(6):1209–1242, 2014

  19. [19]

    Detecting the community structure and activity patterns of temporal networks: A non-negative tensor factorization approach.PloS One, 9(1):e86028, 2014

    Laetitia Gauvin, Andr´ e Panisson, and Ciro Cattuto. Detecting the community structure and activity patterns of temporal networks: A non-negative tensor factorization approach.PloS One, 9(1):e86028, 2014

  20. [20]

    On the optimization landscape of tensor decompositions.Advances in Neural Information Processing Systems, 30, 2017

    Rong Ge and Tengyu Ma. On the optimization landscape of tensor decompositions.Advances in Neural Information Processing Systems, 30, 2017

  21. [21]

    Conditions for strong ellipticity of anisotropic elastic materials

    Deren Han, Hui-Hui Dai, and Liqun Qi. Conditions for strong ellipticity of anisotropic elastic materials. Journal of Elasticity, 97(1):1–13, 2009

  22. [22]

    Springer Science & Business Media, 2013

    Joe Harris.Algebraic Geometry: A First Course, volume 133. Springer Science & Business Media, 2013

  23. [23]

    explanatory

    Richard A Harshman et al. Foundations of the PARAFAC procedure: Models and conditions for an “explanatory” multi-modal factor analysis.UCLA Working papers in Phonetics, 16(1):84, 1970

  24. [24]

    Tensor rank is NP-complete.Journal of Algorithms, 11(4):644–654, 1990

    Johan H˚ astad. Tensor rank is NP-complete.Journal of Algorithms, 11(4):644–654, 1990

  25. [25]

    Most tensor problems are NP-hard.Journal of the ACM (JACM), 60(6):1–39, 2013

    Christopher J Hillar and Lek-Heng Lim. Most tensor problems are NP-hard.Journal of the ACM (JACM), 60(6):1–39, 2013

  26. [26]

    Cambridge University Press, 2012

    Roger A Horn and Charles R Johnson.Matrix Analysis. Cambridge University Press, 2012

  27. [27]

    When does subtracting a rank-one approximation decrease tensor rank?Linear Algebra and its Applications, 709:397–415, 2025

    Emil Horobet ¸ and Ettore Teixeira Turatti. When does subtracting a rank-one approximation decrease tensor rank?Linear Algebra and its Applications, 709:397–415, 2025. MULTI-SUBSPACE POWER METHOD 29

  28. [28]

    Computing linear sections of varieties: quantum entanglement, tensor decompositions and beyond

    Nathaniel Johnston, Benjamin Lovitz, and Aravindan Vijayaraghavan. Computing linear sections of varieties: quantum entanglement, tensor decompositions and beyond. In2023 IEEE 64th Annual Sym- posium on Foundations of Computer Science (FOCS), pages 1316–1336. IEEE, 2023

  29. [29]

    Subspace power method for symmetric tensor decomposition.Numerical Algorithms, pages 1–38, 2025

    Joe Kileel and Jo˜ ao M Pereira. Subspace power method for symmetric tensor decomposition.Numerical Algorithms, pages 1–38, 2025

  30. [30]

    On the best rank-1 approximation of higher-order supersym- metric tensors.SIAM Journal on Matrix Analysis and Applications, 23(3):863–884, 2002

    Eleftherios Kofidis and Phillip A Regalia. On the best rank-1 approximation of higher-order supersym- metric tensors.SIAM Journal on Matrix Analysis and Applications, 23(3):863–884, 2002

  31. [31]

    Tensor decompositions and applications.SIAM Review, 51(3):455– 500, 2009

    Tamara G Kolda and Brett W Bader. Tensor decompositions and applications.SIAM Review, 51(3):455– 500, 2009

  32. [32]

    Shifted power method for computing tensor eigenpairs.SIAM Journal on Matrix Analysis and Applications, 32(4):1095–1124, 2011

    Tamara G Kolda and Jackson R Mayo. Shifted power method for computing tensor eigenpairs.SIAM Journal on Matrix Analysis and Applications, 32(4):1095–1124, 2011

  33. [33]

    Three-way arrays: Rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics.Linear algebra and its applications, 18(2):95–138, 1977

    Joseph B Kruskal. Three-way arrays: Rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics.Linear algebra and its applications, 18(2):95–138, 1977

  34. [34]

    Cambridge University Press, 2017

    Joseph M Landsberg.Geometry and Complexity Theory, volume 169. Cambridge University Press, 2017

  35. [35]

    M-eigenvalue inclusion intervals for a fourth-order partially symmetric tensor.Journal of Computational and Applied Mathematics, 356:391–401, 2019

    Suhua Li, Chaoqian Li, and Yaotang Li. M-eigenvalue inclusion intervals for a fourth-order partially symmetric tensor.Journal of Computational and Applied Mathematics, 356:391–401, 2019

  36. [36]

    Singular values and eigenvalues of tensors: a variational approach

    Lek-Heng Lim. Singular values and eigenvalues of tensors: a variational approach. In1st IEEE In- ternational Workshop on Computational Advances in Multi-Sensor Adaptive Processing, 2005., pages 129–132. IEEE, 2005

  37. [37]

    Ensembles semi-analytiques.IHES Notes, page 220, 1965

    Stanislaw Lojasiewicz. Ensembles semi-analytiques.IHES Notes, page 220, 1965

  38. [38]

    Tensor-based synchronization and the low-rankness of the block trifocal tensor.Advances in Neural Information Processing Systems, 37:69505–69532, 2024

    Daniel Miao, Gilad Lerman, and Joe Kileel. Tensor-based synchronization and the low-rankness of the block trifocal tensor.Advances in Neural Information Processing Systems, 37:69505–69532, 2024

  39. [39]

    An alternating algorithm for structure preserving CP- decompositions of partially symmetric tensors.Computational Optimization and Applications, pages 1–33, 2025

    Jie Ni, Yuhong Dai, and Zheng Peng. An alternating algorithm for structure preserving CP- decompositions of partially symmetric tensors.Computational Optimization and Applications, pages 1–33, 2025

  40. [40]

    A three-way model for collective learning on multi-relational data

    Maximilian Nickel, Volker Tresp, Hans-Peter Kriegel, et al. A three-way model for collective learning on multi-relational data. InInternational Conference on Machine Learning, volume 11, pages 3104482– 3104584, 2011

  41. [41]

    Tensor moments of Gaussian mixture models: Theory and applications.arXiv preprint arXiv:2202.06930, 2022

    Jo˜ ao M Pereira, Joe Kileel, and Tamara G Kolda. Tensor moments of Gaussian mixture models: Theory and applications.arXiv preprint arXiv:2202.06930, 2022

  42. [42]

    A higher-order general- ized singular value decomposition for comparison of global mRNA expression from multiple organisms

    Sri Priya Ponnapalli, Michael A Saunders, Charles F Van Loan, and Orly Alter. A higher-order general- ized singular value decomposition for comparison of global mRNA expression from multiple organisms. PloS One, 6(12):e28072, 2011

  43. [43]

    A real generalized trisecant trichotomy.arXiv preprint arXiv:2409.01356, 2024

    Kristian Ranestad, Anna Seigal, and Kexin Wang. A real generalized trisecant trichotomy.arXiv preprint arXiv:2409.01356, 2024

  44. [44]

    Monotonic convergence of fixed-point algorithms for ICA

    Phillip A Regalia and Eleftherios Kofidis. Monotonic convergence of fixed-point algorithms for ICA. IEEE Transactions on Neural Networks, 14(4):943–949, 2003

  45. [45]

    SIAM, 1998

    Werner C Rheinboldt.Methods for Solving Systems of Nonlinear Equations. SIAM, 1998

  46. [46]

    Decomposing tensors via rank- one approximations.arXiv:2411.15935, 2024

    Alvaro Ribot, Emil Horobet, Anna Seigal, and Ettore Teixeira Turatti. Decomposing tensors via rank- one approximations.arXiv:2411.15935, 2024

  47. [47]

    Orthogonal decomposition of symmetric tensors.SIAM Journal on Matrix Analysis and Applications, 37(1):86–102, 2016

    Elina Robeva. Orthogonal decomposition of symmetric tensors.SIAM Journal on Matrix Analysis and Applications, 37(1):86–102, 2016

  48. [48]

    Singular vectors of orthogonally decomposable tensors.Linear and Multilinear Algebra, 65(12):2457–2471, 2017

    Elina Robeva and Anna Seigal. Singular vectors of orthogonally decomposable tensors.Linear and Multilinear Algebra, 65(12):2457–2471, 2017

  49. [49]

    Convergence results for projected line-search methods on varieties of low-rank matrices via Lojasiewicz inequality.SIAM Journal on Optimization, 25(1):622–646, 2015

    Reinhold Schneider and Andr´ e Uschmajew. Convergence results for projected line-search methods on varieties of low-rank matrices via Lojasiewicz inequality.SIAM Journal on Optimization, 25(1):622–646, 2015

  50. [50]

    Subtracting a best rank-1 approximation may increase tensor rank

    Alwin Stegeman and Pierre Comon. Subtracting a best rank-1 approximation may increase tensor rank. Linear Algebra and its Applications, 433(7):1276–1300, 2010

  51. [51]

    A new convergence proof for the higher-order power method and generalizations

    Andr´ e Uschmajew. A new convergence proof for the higher-order power method and generalizations. arXiv preprint arXiv:1407.4586, 2014

  52. [52]

    Identifiability of deep poly- nomial neural networks.arXiv preprint arXiv:2506.17093, 2025

    Konstantin Usevich, Clara D´ erand, Ricardo Borsoi, and Marianne Clausel. Identifiability of deep poly- nomial neural networks.arXiv preprint arXiv:2506.17093, 2025. 30 KEXIN W ANG, JO ˜AO M. PEREIRA, JOE KILEEL, AND ANNA SEIGAL

  53. [53]

    On generic nonexistence of the Schmidt–Eckart–Young decomposition for complex tensors.SIAM Journal on Matrix Analysis and Applications, 35(3):886–903, 2014

    Nick Vannieuwenhoven, Johannes Nicaise, Raf Vandebril, and Karl Meerbergen. On generic nonexistence of the Schmidt–Eckart–Young decomposition for complex tensors.SIAM Journal on Matrix Analysis and Applications, 35(3):886–903, 2014

  54. [54]

    Tensorlab 3.0, Mar

    Nico Vervliet, Otto Debals, Laurent Sorber, Marc Van Barel, and Lieven De Lathauwer. Tensorlab 3.0, Mar. 2016. Available online

  55. [55]

    Contrastive independent component analysis.arXiv preprint arXiv:2407.02357, 2024

    Kexin Wang, Aida Maraj, and Anna Seigal. Contrastive independent component analysis.arXiv preprint arXiv:2407.02357, 2024

  56. [56]

    American Mathematical Soc., 1934

    Joseph Henry Maclagan Wedderburn.Lectures on Matrices, volume 17. American Mathematical Soc., 1934

  57. [57]

    Moment estimation for nonparametric mixture models through implicit tensor decomposition.SIAM Journal on Mathematics of Data Science, 5(4):1130–1159, 2023

    Yifan Zhang and Joe Kileel. Moment estimation for nonparametric mixture models through implicit tensor decomposition.SIAM Journal on Mathematics of Data Science, 5(4):1130–1159, 2023

  58. [58]

    Andreas Ziehe, Pavel Laskov, Guido Nolte, and Klaus-Robert M¨ uller. A fast algorithm for joint diago- nalization with non-orthogonal transformations and its application to blind source separation.Journal of Machine Learning Research, 5(Jul):777–800, 2004. Appendix A. Proofs in Section 5 LemmaA.1.Fix a tensorT (f) ∈⊗ℓ i=1 Sfi(Rmi)⊗Rr whose last slicesS 1,...