Structure-Aware Tensorial Model Reduction
Pith reviewed 2026-07-01 09:00 UTC · model grok-4.3
The pith
A tensorial method encodes PDE solution snapshots with Tucker factorization to build nonlinearly parameter-dependent reduced bases online.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The central claim is that the multi-linear Tucker factorization of solution snapshots permits rapid online construction of a parameter-dependent reduced basis whose Galerkin projection remains accurate after orthonormalization with respect to a general discrete inner product and after radial basis function interpolation of the encoded states, thereby mitigating the linear restrictions of fixed bases on Kolmogorov n-width and improving performance in highly nonlinear and data-limited regimes.
What carries the argument
Multi-linear Tucker factorization of solution snapshots, extended by general orthonormalization and radial basis function interpolation of encoded states to enable online parameter-dependent reduced bases.
If this is right
- The method yields accurate solutions where monolithic fixed-basis ROMs fail due to strong nonlinearity.
- Performance remains reliable even when parameter samples are limited.
- The derived error estimates continue to hold after the orthonormalization and interpolation extensions.
- The approach applies directly to structured problems such as three-dimensional Maxwell equations.
Where Pith is reading between the lines
- The same encoding strategy could be tested on time-dependent or stochastic PDEs where parameter variation is rapid.
- Replacing radial basis functions with other interpolants might further reduce online cost without losing the error guarantees.
- The structure-aware aspect suggests the technique could combine with existing hyper-reduction methods for even larger systems.
Load-bearing premise
The Tucker factorization of the snapshots is assumed to allow accurate Galerkin projections after the added orthonormalization and interpolation steps preserve the basic representation and error estimates.
What would settle it
A numerical experiment on a highly nonlinear parameterized PDE with sparse samples where the observed reduced-model error significantly exceeds the paper's derived representation and ROM error bounds.
Figures
read the original abstract
This work investigates a two-stage method for constructing projection-based reduced-order models (ROMs) of parameterized partial differential equations (PDEs). Based on established tensorial ROM methodology, the proposed approach reduces dimensionality offline by encoding solution snapshots using a multi-linear Tucker factorization, so that a reduced basis which varies nonlinearly with PDE parameters can be rapidly constructed online and used in a Galerkin ROM. Two novel extensions of this strategy, tailored to the cases of structured PDEs and sparse parameter sampling, are presented: the construction of reduced bases orthonormalized with respect to a general discrete inner product, and the interpolation of encoded states via radial basis functions. Basic representation and ROM error estimates are presented demonstrating the validity of these modifications, and the approach is challenged on examples where monolithic-basis ROMs are known to struggle, including a realistic instance of Maxwell's equations in 3D. Results suggest that the proposed nonlinear basis ROM can effectively mitigate linear restrictions on Kolmogorov $n$-width while improving upon previous tensorial ROM technology, particularly in the highly nonlinear and data-limited regimes characteristic of practical use cases.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a two-stage projection-based reduced-order modeling approach for parameterized PDEs. Offline, solution snapshots are encoded via multi-linear Tucker factorization to reduce dimensionality; online, a parameter-dependent reduced basis is rapidly constructed and used in a Galerkin projection. Two extensions are introduced: orthonormalization of the reduced basis with respect to a general discrete inner product, and radial basis function interpolation of the encoded states to handle sparse parameter sampling. Basic representation and ROM error estimates are derived to support the modifications, and the method is demonstrated on test cases including a 3D Maxwell's equations problem where monolithic linear bases are known to perform poorly.
Significance. If the error estimates are rigorous and the numerical results confirm the claimed gains, the work would be significant for reduced-order modeling of highly nonlinear parameterized systems. By enabling a nonlinearly parameter-dependent basis while retaining the efficiency of tensorial constructions, the approach directly targets the Kolmogorov n-width barrier that limits linear ROMs, with particular relevance to data-limited practical regimes. The provision of representation and ROM error bounds plus reproducible numerical examples on structured PDEs strengthens the contribution.
minor comments (3)
- The abstract states that 'basic representation and ROM error estimates are presented' but does not indicate the precise form of the bounds or the assumptions under which they hold; a brief statement of the main estimate (e.g., the dependence on the Tucker ranks or the RBF fill distance) would improve clarity for readers.
- In the numerical section on Maxwell's equations, the comparison with prior tensorial ROMs would benefit from an explicit table reporting both offline and online computational costs alongside the observed L2 errors, so that the claimed improvement in the data-limited regime can be directly quantified.
- Notation for the discrete inner product used in the orthonormalization step should be introduced once and used consistently; currently the symbol appears to change between the theoretical and algorithmic sections.
Simulated Author's Rebuttal
We thank the referee for their positive assessment of the manuscript, accurate summary of the proposed two-stage tensorial ROM approach, and recommendation for minor revision. The significance statement correctly identifies the relevance to overcoming limitations of linear ROMs in nonlinear parameterized regimes with sparse data.
Circularity Check
No significant circularity detected
full rationale
The paper's derivation chain begins from established tensorial ROM methodology using multi-linear Tucker factorization of snapshots, then introduces two explicit algorithmic extensions (general inner-product orthonormalization and RBF interpolation of encoded states). It states basic representation and ROM error estimates that are presented as direct consequences of these modifications, without any reduction of a 'prediction' to a fitted parameter or self-citation by construction. The central claim of mitigating Kolmogorov n-width restrictions rests on these estimates plus external numerical validation on Maxwell's equations, which are independent benchmarks. No step equates a derived quantity to its own input via definition, renaming, or load-bearing self-citation; the work is therefore self-contained.
Axiom & Free-Parameter Ledger
Reference graph
Works this paper leans on
-
[1]
B. M. Afkham, A. Bhatt, B. Haasdonk, and J. S. Hesthaven. Symplectic model-reduction with a weighted inner product, 2018
2018
-
[2]
S. E. Azam and S. Mariani. Investigation of computational and accuracy issues in pod-based reduced order modeling of dynamic structural systems.Engineering structures, 54:150–167, 2013
2013
-
[3]
Barnett and C
J. Barnett and C. Farhat. Quadratic approximation manifold for mitigating the Kolmogorov barrier in nonlinear projection-based model order reduction.Journal of Computational Physics, 464:111348, 2022
2022
-
[4]
Benner, S
P. Benner, S. Gugercin, and K. Willcox. A survey of projection-based model reduction methods for parametric dynamical systems.SIAM Review, 57(4):483–531, 2015
2015
-
[5]
Benner, E
P. Benner, E. Sachs, and S. Volkwein. Model order reduction for pde constrained optimization.Trends in PDE constrained optimization, pages 303–326, 2014. 25 Structure-Aware Tensorial Model Reduction Vijaywargiya, Cyr, and Gruber
2014
-
[6]
Berman and B
J. Berman and B. Peherstorfer. Randomized sparse neural galerkin schemes for solving evolution equa- tions with deep networks. InThirty-seventh Conference on Neural Information Processing Systems, 2023
2023
-
[7]
M. T. Bettencourt, D. A. Brown, K. L. Cartwright, E. C. Cyr, C. A. Glusa, P. T. Lin, S. G. Moore, D. A. McGregor, R. P. Pawlowski, E. G. Phillips, et al. Empire-pic: a performance portable unstructured particle-in-cell code.Communications in Computational Physics, 30(4), 2021
2021
-
[8]
M. A. Cardoso, L. J. Durlofsky, and P. Sarma. Development and application of reduced-order modeling procedures for subsurface flow simulation.International journal for numerical methods in engineering, 77(9):1322–1350, 2009
2009
-
[9]
Carlberg, M
K. Carlberg, M. Barone, and H. Antil. Galerkin v. least-squares petrov–galerkin projection in nonlinear model reduction.Journal of Computational Physics, 330:693–734, 2017
2017
-
[10]
Chaturantabut and D
S. Chaturantabut and D. C. Sorensen. A state space error estimate for pod-deim nonlinear model reduction.SIAM Journal on Numerical Analysis, 50(1):46–63, 2012
2012
-
[11]
D. N. Daescu and I. M. Navon. A dual-weighted approach to order reduction in 4DVAR data assimila- tion.Monthly Weather Review, 136(3):1026–1041, 2008
2008
-
[12]
De Lathauwer, B
L. De Lathauwer, B. De Moor, and J. Vandewalle. A multilinear singular value decomposition.SIAM Journal on Matrix Analysis and Applications, 21(4):1253–1278, 2000
2000
-
[13]
A. N. Diaz, J. T. Needels, I. K. Tezaur, and P. J. Blonigan. Kernel manifolds: Nonlinear-augmentation dimensionality reduction using reproducing kernel hilbert spaces.International Journal for Numerical Methods in Engineering, 126(24):e70230, 2025
2025
-
[14]
Drmac and S
Z. Drmac and S. Gugercin. A new selection operator for the discrete empirical interpolation method— improved a priori error bound and extensions.SIAM Journal on Scientific Computing, 38(2):A631–A648, 2016
2016
-
[15]
S. D. Fisher and C. A. Micchelli. The n-width of sets of analytic functions.Duke Mathematical Journal, 47(4):789 – 801, 1980
1980
-
[16]
H. Florez. Applications of model-order reduction to thermo-poroelasticity. InARMA US Rock Mechan- ics/Geomechanics Symposium, pages ARMA–2017. ARMA, 2017
2017
-
[17]
Geelen, S
R. Geelen, S. Wright, and K. Willcox. Operator inference for non-intrusive model reduction with quadratic manifolds.Computer Methods in Applied Mechanics and Engineering, 403:115717, 2023
2023
-
[18]
Y. Geng, J. Singh, L. Ju, B. Kramer, and Z. Wang. Gradient preserving operator inference: Data-driven reduced-order models for equations with gradient structure.Computer Methods in Applied Mechanics and Engineering, 427:117033, 2024
2024
-
[19]
Ghattas and K
O. Ghattas and K. Willcox. Learning physics-based models from data: Perspectives from inverse problems and model reduction.Acta Numerica, 30:445–554, 2021
2021
-
[20]
Y. Gong, Q. Wang, and Z. Wang. Structure-preserving Galerkin POD reduced-order modeling of Hamiltonian systems.Computer Methods in Applied Mechanics and Engineering, 315:780–798, 2017
2017
-
[21]
Greif and K
C. Greif and K. Urban. Decay of the kolmogorov n-width for wave problems.Applied Mathematics Letters, 96:216–222, 2019
2019
-
[22]
Gruber, M
A. Gruber, M. Gunzburger, L. Ju, and Z. Wang. Energetically consistent model reduction for metriplec- tic systems.Computer Methods in Applied Mechanics and Engineering, 404:115709, 2023
2023
-
[23]
Gruber and I
A. Gruber and I. Tezaur. Canonical and noncanonical Hamiltonian operator inference.Computer Methods in Applied Mechanics and Engineering, 416:116334, 2023. 26 Structure-Aware Tensorial Model Reduction Vijaywargiya, Cyr, and Gruber
2023
-
[24]
Gruber and I
A. Gruber and I. Tezaur. Variationally consistent Hamiltonian model reduction.SIAM Journal on Applied Dynamical Systems, 24(1):376–414, 2025
2025
-
[25]
J. S. Hesthaven, C. Pagliantini, and G. Rozza. Reduced basis methods for time-dependent problems. Acta Numerica, 31:265–345, 2022
2022
-
[26]
O. Knill. The dirac operator of a graph, 2013
2013
-
[27]
T. G. Kolda and B. W. Bader. Tensor decompositions and applications.SIAM Rev., 51:455–500, 2009
2009
-
[28]
A. N. Kolmogorov. ¨Uber die beste ann¨ aherung von elementen einer menge an eine andere.Annals of Mathematics, 37(1):107–110, 1936
1936
-
[29]
Le Clainche, F
S. Le Clainche, F. Varas, and J. M. Vega. Accelerating oil reservoir simulations using pod on the fly. International Journal for Numerical Methods in Engineering, 110(1):79–100, 2017
2017
-
[30]
Lee and K
K. Lee and K. T. Carlberg. Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders.Journal of Computational Physics, 404:108973, 2020
2020
-
[31]
T. Lieu, C. Farhat, and M. Lesoinne. Pod-based aeroelastic analysis of a complete f-16 configuration: Rom adaptation and demonstration. In46th AIAA/ASME/ASCE/AHS/ASC structures, structural dynamics and materials conference, page 2295, 2005
2005
-
[32]
A. V. Mamonov and M. A. Olshanskii. Interpolatory tensorial reduced order models for parametric dynamical systems.Computer Methods in Applied Mechanics and Engineering, 397:115122, 2022
2022
-
[33]
A. V. Mamonov and M. A. Olshanskii. Tensorial parametric model order reduction of nonlinear dy- namical systems.SIAM Journal on Scientific Computing, 46(3):A1850–A1878, 2024
2024
-
[34]
A. V. Mamonov and M. A. Olshanskii. A priori analysis of a tensor rom for parameter dependent parabolic problems.SIAM Journal on Numerical Analysis, 63(1):239–261, 2025
2025
-
[35]
Parish, M
E. Parish, M. Yano, I. Tezaur, and T. Iliescu. Residual-based stabilized reduced-order models of the transient convection–diffusion–reaction equation obtained through discrete and continuous projection: E. parish et al.Archives of Computational Methods in Engineering, 32(3):1885–1929, 2025
1929
-
[36]
E. J. Parish and F. Rizzi. On the impact of dimensionally-consistent and physics-based inner products for pod-galerkin and least-squares model reduction of compressible flows.Journal of Computational Physics, 491:112387, 2023
2023
-
[37]
Peng and K
L. Peng and K. Mohseni. Symplectic model reduction of Hamiltonian systems.SIAM Journal on Scientific Computing, 38(1):A1–a27, 2016
2016
-
[38]
Peters, J
N. Peters, J. A. Ekaterinaris, and A. M. Wissink. Mode based reduced order model for a moving store. InAIAA Scitech 2021 Forum, page 0364, 2021
2021
-
[39]
Quarteroni, G
A. Quarteroni, G. Rozza, et al.Reduced order methods for modeling and computational reduction, volume 9. Springer, 2014
2014
-
[40]
Schwerdtner and B
P. Schwerdtner and B. Peherstorfer. Greedy construction of quadratic manifolds for nonlinear dimen- sionality reduction and nonlinear model reduction. arXiv preprint, 2024
2024
-
[41]
M. A. S´ anchez, B. Cockburn, N.-C. Nguyen, and J. Peraire. Symplectic Hamiltonian finite element meth- ods for linear elastodynamics.Computer Methods in Applied Mechanics and Engineering, 381:113843, 2021
2021
-
[42]
Tang, W.-Z
Y.-Q. Tang, W.-Z. Fang, C.-Y. Zheng, and W.-Q. Tao. Applications of pod-based reduced order model to the rapid prediction of velocity and temperature in data centers.Applied Thermal Engineering, 263:125310, 2025. 27 Structure-Aware Tensorial Model Reduction Vijaywargiya, Cyr, and Gruber
2025
-
[43]
Unger and S
B. Unger and S. Gugercin. Kolmogorov n-widths for linear dynamical systems.Advances in Computa- tional Mathematics, 45(5):2273–2286, 2019
2019
-
[44]
A. Vijaywargiya, S. A. McQuarrie, and A. Gruber. Tensor parametric hamiltonian operator inference. arXiv preprint arXiv:2502.10888, 2025. 28 Structure-Aware Tensorial Model Reduction Vijaywargiya, Cyr, and Gruber ���FOM ���RBF ���Monolithic ���MO Figure 7: Magnitude and components ofE h atτ= 2.5 on the slicez= 0.5 obtained from the FOM and ROM solutions t...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.