REVIEW 2 major objections 7 minor 27 references
FE-PINNs: finite-element-based physics-informed neural networks for surrogate modeling
T0 review · 2 major / 7 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read Stencil convolution lets physics-informed neural networks trained on finite-element meshes generalize to unseen geometries, with testing error decreasing as training geometries grow.
desk verdict A genuinely new stencil-convolution operator for FE-mesh CNNs, with a plausible generalization story that Fig. 8 weakens by only plotting selected best models. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the stencil convolution tensor $S_{klmn}$, which stores the shape-function values that map a node's field values to the stencil points around it: $S_{klmn} = N^{n,e}(\xi_{ikl}(x_{ikl}))$ if node $n$ belongs to the element containing stencil point $(k,l)$, and zero otherwise. It is built once per mesh by locating the element for each stencil point via a spatial join and inverting the isoparametric map analytically, then reused as a sparse tensor contraction during training. This operation is what lets the CNN run on irregular meshes: the field is always stored on nodes, and the stencil weights read it through piecewise polynomial shape functions, so the network sees a grid-like receptive field without requiring a grid.
What would settle it
Inspect the FE-PINN code's element lookup at stencil points: if out-of-domain stencil points are silently skipped or zero-filled, then a test mesh with many nodes near a concave boundary should show a sharp jump in prediction error at those boundary nodes, contradicting the claimed mesh-insensitive generalization.
Extended reading notes
Core claim
The central claim is that stencil convolution—defined by a stencil tensor of points around each node, with field values obtained by finite-element shape functions via the inverse isoparametric map—makes convolutional PINNs practical on arbitrary, unstructured finite-element meshes. With this operator, a CNN can be trained by minimizing the norm of the finite-element residual, so boundary conditions enter through the external force vector and need no soft-constraint penalty. The paper reports that networks trained on several geometries generalize to untrained geometries that are similar, and that increasing the number of training geometries systematically reduces testing loss while training loss stays flat. This is taken as evidence that the network learns the underlying operator rather than memorizing isolated solutions.
Load-bearing premise
The load-bearing premise is that stencil points that fall outside the finite-element domain near boundaries can be handled without corrupting the convolutional features, yet the paper never specifies what happens when the element search returns no element for such a point.
Editorial extensions
If this is right
- A FE-PINN trained on a handful of geometries can replace a full finite-element solve for new, similar geometries, giving near-instant predictions with physics-based accuracy.
- No labeled solution data is required: the physics loss is the finite-element residual, and boundary conditions enter automatically through the external force vector.
- Testing error decreases systematically as the training set grows, indicating that the network learns a generalizable operator rather than memorizing training cases.
- The same machinery is expected to extend to nonlinear and three-dimensional problems, and to variable boundary conditions, material properties, and body forces by adding input channels.
Reading between the lines
- The paper leaves unspecified how stencil points that fall outside the domain are treated; if the element lookup returns nothing, boundary-node features could be distorted, which may explain why the 0-degree wedge block resists prediction from nearby geometries.
- A testable extension would be to change element size after training; the authors note discretization invariance is plausible because inputs and outputs are functions, but it has not been demonstrated.
- Non-uniform or multi-length-scale stencil arrangements, which the paper explicitly floats as possibilities, could outperform the single uniform spacing used here.
- If the observed scaling with training-set size continues, training on hundreds of finite-element models should yield a high-fidelity operator surrogate; the authors mention this as a large-scale target but do not test it.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper introduces FE-PINNs, a physics-informed neural network framework in which the finite-element weak-form residual is used as the training loss and a custom 'stencil convolution' operator performs convolutional operations directly on unstructured FE meshes. The method is demonstrated on two families of 2D linear-elastic boundary-value problems (wedged blocks and blocks with holes), training on one, two, or three geometries and testing on unseen geometries. The authors report that testing errors decrease as the number of training geometries grows, and they position the method as a step toward general-purpose surrogate models that leverage existing FE codes.
Significance. If the central claims hold, the stencil-convolution idea is a meaningful contribution: it offers a mesh-adaptive CNN-style operator that works on arbitrary FE discretizations, avoids labeled data by using the FE residual as the physics loss, and enforces boundary conditions through the weak Galerkin form. The paper also ships code and trained networks in a public repository, which strengthens reproducibility. However, the quantitative evidence for the headline generalization claim is weakened by the exclusive use of best-of-three and best-of-combination selections without reporting any distribution, and the stencil-convolution construction is incompletely specified for stencil points outside the domain. Both issues are fixable with additional reporting and targeted experiments, so the work is worth considering after major revision.
major comments (2)
- [Sec. 2.2.2, Eqs. (14)-(17)] The stencil-convolution construction is incomplete for stencil points that lie outside the FE domain. For any non-zero stencil spacing Delta, stencil points associated with nodes near the boundary will fall outside the union of elements; the element search via the GeoPandas sjoin described in Sec. 2.3 then returns no element, and the manuscript states no fallback rule. Since the stencil point values are formed by evaluating shape functions at the containing element, an undefined or inconsistent choice here would corrupt the convolutional features at boundary nodes and could explain the difficulty reported for the 0-degree wedge block in Sec. 4. Please specify the out-of-domain handling (e.g., zero-padding, clamping to the nearest element, or discarding such stencil points) and confirm that all reported results use the same rule.
- [Sec. 3.2 and Fig. 8] The claim in the abstract and Sec. 4 that testing errors systematically decrease with the number of training geometries is based on losses from 'best performing FE-PINNs'. For the wedged-block family, the n=1, n=2, and n=3 minima are selected from 7, 21, and 35 training-set combinations, respectively, with an additional best-of-three-seeds selection per combination. The minimum over a growing pool of models can decrease even if no typical model improves, and the manuscript reports no mean, median, or spread across seeds or across combinations. Please report the distribution of testing losses (e.g., all combinations, or at least median and range) or otherwise demonstrate that the systematic decrease holds beyond the best-case selection.
minor comments (7)
- [Sec. 2.3] The word 'implemeneted' should be 'implemented', and 'ansjoin' should be 'an sjoin' (or 'a spatial join').
- [Sec. 2.4] The phrase 'the training geometery' should be 'the training geometry'.
- [Eq. (15)] The bias term is written as b_r \bar\delta_{mm}, which is not a standard scalar bias; it should presumably be simply b_r. Please correct the notation.
- [Eq. (14)] The notation \bar\delta_{kk} = \delta_{kk}/2 is unusual and appears to be a typo; if a Kronecker delta is intended, use the standard symbol and define the coordinate shift accordingly.
- [Fig. 8] The linear regression fits are drawn without reporting slopes, confidence intervals, or p-values; adding these (or replacing the fits with median trends) would make the claimed systematic decrease more quantitative.
- [Sec. 3.2.1, Fig. 4(b)] The phrase 'lowest average loss' is not defined; specify whether the average is over the test geometries and over the three seeds.
- [Sec. 4] The phrase 'in principal' should be 'in principle'.
Circularity Check
No significant circularity: the held-out test metric is the FE residual, an external physics benchmark, and no tested geometry or test loss enters training; the best-of-selection summary in Fig. 8 is a statistical caveat, not a definitional reduction.
full rationale
The paper's derivation chain is self-contained and does not reduce a prediction to its inputs by construction. The physics loss in Eq. (12), L(d̃)=||R(d̃)||, is computed from the weak-form FE residual; for testing, R is evaluated on unseen geometries, so the reported errors are external measures of PDE satisfaction, not quantities fitted during training. The stencil convolution tensor S_klmn in Eq. (17) is precomputed from the mesh and isoparametric shape functions, but the NN weights are optimized against the residual loss; no test-geometry loss or test-solution label is used to set weights. The paper contains no load-bearing self-citations, uniqueness imports, or ansatz-by-citation: the cited works are contextual (e.g., PhyGeoNet, graph Galerkin networks) and the stencil operation is defined directly from FE concepts. The principal weakness is statistical, not circular: Sec. 2.3 reports only the best of three random seeds, and Fig. 8 plots 'best performing FE-PINNs' across training scenarios, so the decreasing testing-loss trend may be partly an artifact of selecting minima over a growing set of candidate models. Although this warrants a caveat on the generalization claim, it is a model-selection/validation issue rather than a circular derivation, and per the hard rules it does not raise the circularity score beyond minor.
Assumptions & free parameters
free parameters (3)
- Stencil spacing Delta/H =
0.025
- Kernel size w =
9
- Learning rate and training epochs =
0.001, 1000
assumptions (4)
- domain assumption The FE discretization with bilinear quadrilaterals and 2x2 quadrature yields a sufficiently accurate solution for the test problems.
- domain assumption The inverse isoparametric map is analytic and correctly implemented for all meshes used.
- ad hoc to paper Stencil points outside the FE domain are handled benignly (not specified).
- standard math The FE residual R(d_tilde) = K d_tilde - Fe is a valid training loss that enforces both equilibrium and essential BCs.
invented entities (1)
-
Stencil convolution operator (stencil tensor s_ikl and stencil convolution tensor S_klmn)
independent evidence
Cite this review
Pith. "Pith review of FE-PINNs: finite-element-based physics-informed neural networks for surrogate modeling." pith.science (2026). https://pith.science/paper/HH7ABYLD
@misc{pith2026241207126,
author = {Pith},
title = {Pith review of: FE-PINNs: finite-element-based physics-informed neural networks for surrogate modeling},
year = {2026},
howpublished = {\url{https://pith.science/paper/HH7ABYLD}},
note = {Machine review of arXiv:2412.07126}
}
read the original abstract
We present a method whereby the finite element method is used to train physics-informed neural networks that are suitable for surrogate modeling. The method is based on a custom convolutional operation called stencil convolution which leverages the inverse isoparametric map of the finite element method. We demonstrate the performance of the method in several training and testing scenarios with linear boundary-value problems of varying geometries. The resulting neural networks show reasonable accuracy when tested on unseen geometries that are similar to those used for training. Furthermore, when the number of training geometries is increased the testing errors systematically decrease, demonstrating that the neural networks learn how to generalize as the training set becomes larger. Further extending the method to allow for variable boundary conditions, properties, and body forces will lead to a general-purpose surrogate modeling framework that can leverage existing finite element codes for training.
Figures
Figures from the paper (5 more)
Reference graph
Works this paper leans on
-
[1]
R. K. Tripathy, I. Bilionis, Deep UQ: Learning deep neural network surrogate models for high dimensional uncertainty quantification, Journal of Computational Physics 375 (2018) 565–588.doi:10.1016/j.jcp.2018. 08.036
-
[2]
N. Kovachki, Z. Li, B. Liu, K. Azizzadenesheli, K. Bhattacharya, A. Stuart, Neural Operator: Learning Maps Between Function Spaces With Applications to PDEs, Journal of Machine Learning Research 24 (2023) 1–97
work page 2023
-
[3]
I. Lagaris, A. Likas, D. Fotiadis, Artificial neural networks for solving ordinary and partial differential equations, IEEE Transactions on Neural Networks 9 (5) (Sept./1998) 987–1000. doi:10.1109/72.712178
-
[4]
M. Raissi, P. Perdikaris, G. Karniadakis, Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations, Journal of Computational Physics 378 (2019) 686–707. doi:10.1016/j.jcp.2018.10.045
-
[5]
J. Sirignano, K. Spiliopoulos, DGM: A deep learning algorithm for solving partial differential equations, Journal of Computational Physics 375 (2018) 1339–1364. doi:10.1016/j.jcp.2018.08.029
-
[6]
E. Haghighat, M. Raissi, A. Moure, H. Gomez, R. Juanes, A physics-informed deep learning framework for inversion and surrogate modeling in solid mechanics, Computer Methods in Applied Mechanics and Engineering 379 (2021) 113741. doi:10.1016/j.cma.2021.113741
arXiv 2021
-
[7]
C. Rao, H. Sun, Y . Liu, Physics-Informed Deep Learning for Computational Elastodynamics without Labeled Data, Journal of Engineering Mechanics 147 (8) (2021) 04021043. doi:10.1061/(ASCE)EM.1943-7889. 0001947. 16 A PREPRINT - D ECEMBER 11, 2024
-
[8]
S. Cai, Z. Mao, Z. Wang, M. Yin, G. E. Karniadakis, Physics-informed neural networks (PINNs) for fluid me- chanics: A review, Acta Mechanica Sinica 37 (12) (2021) 1727–1738. doi:10.1007/s10409-021-01148-1
Show all 27 references
-
[9]
S. Cai, Z. Wang, S. Wang, P. Perdikaris, G. E. Karniadakis, Physics-Informed Neural Networks for Heat Transfer Problems, Journal of Heat Transfer 143 (6) (2021) 060801. doi:10.1115/1.4050542
2021 doi
-
[10]
X. Meng, Z. Li, D. Zhang, G. E. Karniadakis, PPINN: Parareal physics-informed neural network for time- dependent PDEs, Computer Methods in Applied Mechanics and Engineering 370 (2020) 113250. doi:10. 1016/j.cma.2020.113250
2020
-
[11]
M. A. Nabian, H. Meidani, A deep learning solution approach for high-dimensional random differential equa- tions, Probabilistic Engineering Mechanics 57 (2019) 14–25. doi:10.1016/j.probengmech.2019.05.001
2019 doi
-
[12]
Y . Zhu, N. Zabaras, P.-S. Koutsourelakis, P. Perdikaris, Physics-constrained deep learning for high-dimensional surrogate modeling and uncertainty quantification without labeled data, Journal of Computational Physics 394 (2019) 56–81. doi:10.1016/j.jcp.2019.05.024
2019 doi
-
[13]
Karumuri, R
S. Karumuri, R. Tripathy, I. Bilionis, J. Panchal, Simulator-free solution of high-dimensional stochastic elliptic partial differential equations using deep neural networks, Journal of Computational Physics 404 (2020) 109120. doi:10.1016/j.jcp.2019.109120
2020
-
[14]
Kharazmi, Z
E. Kharazmi, Z. Zhang, G. E. Karniadakis, Variational Physics-Informed Neural Networks For Solving Partial Differential Equations (Nov. 2019). arXiv:1912.00873
2019 arXiv
-
[15]
Kharazmi, Z
E. Kharazmi, Z. Zhang, G. E. Karniadakis, Hp-VPINNs: Variational physics-informed neural networks with domain decomposition, Computer Methods in Applied Mechanics and Engineering 374 (2021) 113547. doi: 10.1016/j.cma.2020.113547
2021
-
[16]
L. Sun, H. Gao, S. Pan, J.-X. Wang, Surrogate modeling for fluid flows based on physics-constrained deep learning without simulation data, Computer Methods in Applied Mechanics and Engineering 361 (2020) 112732. doi:10.1016/j.cma.2019.112732
2020
-
[17]
Joshi, V
A. Joshi, V . Shah, S. Ghosal, B. Pokuri, S. Sarkar, B. Ganapathysubramanian, C. Hegde, Generative Models for Solving Nonlinear Partial Differential Equations, in: NeurIPS 2019, Vancouver, Canada, 2019
2019
-
[18]
H. Gao, L. Sun, J.-X. Wang, PhyGeoNet: Physics-informed geometry-adaptive convolutional neural networks for solving parameterized steady-state PDEs on irregular domain, Journal of Computational Physics 428 (2021) 110079. doi:10.1016/j.jcp.2020.110079
2021
-
[19]
Sheng, C
H. Sheng, C. Yang, PFNN: A penalty-free neural network method for solving a class of second-order boundary- value problems on complex geometries, Journal of Computational Physics 428 (2021) 110085. doi:10.1016/ j.jcp.2020.110085
2021
-
[20]
Goodfellow, Y
I. Goodfellow, Y . Bengio, A. Courville, Deep Learning, MIT Press, 2016, http://www.deeplearningbook. org
2016
-
[21]
H. Gao, M. J. Zahr, J.-X. Wang, Physics-informed graph neural Galerkin networks: A unified framework for solving PDE-governed forward and inverse problems, Computer Methods in Applied Mechanics and Engineering 390 (2022) 114502. doi:10.1016/j.cma.2021.114502
2022
-
[22]
T. J. R. Hughes, The Finite Element Method: Linear Static and Dynamic Finite Element Analysis, Dover Publi- cations, Mineola, NY , 2000
2000
-
[23]
Wriggers, Nonlinear Finite Element Methods, Springer Berlin Heidelberg, Berlin, Heidelberg, 2008
P. Wriggers, Nonlinear Finite Element Methods, Springer Berlin Heidelberg, Berlin, Heidelberg, 2008. doi: 10.1007/978-3-540-71001-1
2008 doi
-
[24]
Hua, An inverse transformation for quadrilateral isoparametric elements: Analysis and application, Finite Elements in Analysis and Design 7 (2) (1990) 159–166
C. Hua, An inverse transformation for quadrilateral isoparametric elements: Analysis and application, Finite Elements in Analysis and Design 7 (2) (1990) 159–166. doi:10.1016/0168-874X(90)90007-2
1990 doi
-
[25]
Jordahl, J
K. Jordahl, J. V . den Bossche, M. Fleischmann, J. Wasserman, J. McBride, J. Gerard, J. Tratner, M. Perry, A. G. Badaracco, C. Farmer, G. A. Hjelle, A. D. Snow, M. Cochran, S. Gillies, L. Culbertson, M. Bartos, N. Eubank, maxalbert, A. Bilogur, S. Rey, C. Ren, D. Arribas-Bel, ...
2020 doi
-
[26]
K. Y . Yuan, Y . S. Huang, H. T. Yang, T. H. H. Pian, The inverse mapping and distortion measures for 8-node hex- ahedral isoparametric elements, Computational Mechanics 14 (2) (1994) 189–199.doi:10.1007/BF00350284
1994 doi
-
[27]
M. Li, A. Wittek, K. Miller, Efficient Inverse Isoparametric Mapping Algorithm for Whole-Body Computed To- mography Registration Using Deformations Predicted by Nonlinear Finite Element Modeling, Journal of Biome- chanical Engineering 136 (8) (2014) 084503. doi:10.1115/1.4027667. 17
2014 doi
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.