Neural Green's Operators for Parametric Partial Differential Equations
Pith reviewed 2026-05-24 00:23 UTC · model grok-4.3
The pith
Neural Green's Operators learn the coefficient dependence of Green's functions while exactly preserving their linear action on source terms.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The central construction defines Neural Green's Operators by approximating the nonlinear dependence of the Green's function on PDE coefficients via neural networks, while the linear action of the Green's operator on inhomogeneity fields is preserved exactly within the finite-dimensional representation. This reduces the learning problem from the full solution operator to only the Green's function and its coefficient dependence. The explicit form permits embedding of symmetry, spectral, and conservation properties into the architecture. Benchmarks demonstrate comparable or superior accuracy to Deep Operator Networks, Variationally Mimetic Operator Networks, and Fourier Neural Operators at same
What carries the argument
Finite-dimensional Green's operator representations in which neural networks approximate only the nonlinear coefficient dependence of the Green's function.
If this is right
- Comparable or better accuracy than DeepONet, VMON, and FNO with similar parameter counts on canonical PDEs.
- Significantly better generalization when tested on out-of-distribution data.
- Single time-step training produces pointwise-accurate dynamics in autoregressive manner over arbitrarily large numbers of time steps for time-dependent parametric PDEs.
- Training exclusively on linear problem solutions allows accurate solutions for nonlinear PDEs when embedded in iterative solvers with suitable initial guess.
- Explicit Green's function representations enable construction of effective matrix preconditioners that accelerate iterative PDE solvers.
Where Pith is reading between the lines
- Separating the linear and nonlinear parts in this way may make it easier to incorporate physical constraints or hybrid numerical-neural schemes.
- The preconditioner application suggests NGOs could speed up traditional solvers even without full replacement.
- Improved OOD performance might be due to the lower complexity of learning only the Green's function map.
- Extension to more complex geometries or higher dimensions would test whether the finite-representation assumption scales.
Load-bearing premise
The nonlinear dependence of the Green's function on PDE coefficients can be approximated by neural networks in a way that keeps the exact linear action on inhomogeneity fields for the finite-dimensional representations used.
What would settle it
Run an NGO on a fixed set of coefficients and check whether solutions for linear combinations of source terms exactly match the linear combination of individual solutions, or measure accuracy collapse on coefficients outside the training distribution range.
Figures
read the original abstract
This work introduces a paradigm for constructing parametric neural operators that are derived from finite-dimensional representations of Green's operators for linear partial differential equations (PDEs). We refer to such neural operators as Neural Green's Operators (NGOs). Our construction of NGOs preserves the linear action of Green's operators on the inhomogeneity fields, while approximating the nonlinear dependence of the Green's function on the coefficients of the PDE using neural networks. This construction reduces the complexity of the problem from learning the entire solution operator and its dependence on all parameters to only learning the Green's function and its dependence on the PDE coefficients. Furthermore, we show that our explicit representation of Green's functions enables the embedding of desirable mathematical attributes in our NGO architectures, such as symmetry, spectral, and conservation properties. Through numerical benchmarks on canonical PDEs, we demonstrate that NGOs achieve comparable or superior accuracy to Deep Operator Networks, Variationally Mimetic Operator Networks, and Fourier Neural Operators with similar parameter counts, while generalizing significantly better when tested on out-of-distribution data. For parametric time-dependent PDEs, we show that NGOs that are trained on a single time step can produce pointwise-accurate dynamics in an auto-regressive manner over arbitrarily large numbers of time steps. For parametric nonlinear PDEs, we demonstrate that NGOs trained exclusively on solutions of corresponding linear problems can be embedded within iterative solvers to yield accurate solutions, provided a suitable initial guess is available. Finally, we show that we can leverage the explicit representation of Green's functions returned by NGOs to construct effective matrix preconditioners that accelerate iterative solvers for PDEs.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript introduces Neural Green's Operators (NGOs) as parametric neural operators derived from finite-dimensional representations of Green's operators for linear PDEs. The construction exactly preserves the linear action of the Green's operator on inhomogeneity fields while using neural networks to approximate the nonlinear dependence of the Green's function on PDE coefficients. This reduces the learning task and enables embedding of mathematical properties such as symmetry, spectral, and conservation attributes. Numerical benchmarks on canonical PDEs show NGOs achieving comparable or superior accuracy to DeepONet, VMON, and FNO with similar parameter counts and significantly better out-of-distribution generalization. Additional results cover auto-regressive time-stepping for time-dependent PDEs trained on single steps, embedding in iterative solvers for nonlinear PDEs, and construction of effective preconditioners from the explicit Green's function representations.
Significance. If the results hold, the work offers a principled way to incorporate classical Green's function theory into neural operator learning, separating linear action (preserved exactly) from nonlinear coefficient dependence (learned). This structure could improve generalization and enable embedding of desirable properties, with practical extensions to time-dependent problems, nonlinear solvers, and preconditioning. The approach stands out for reducing the learning problem while maintaining mathematical fidelity, potentially influencing future operator architectures for parametric PDEs.
minor comments (2)
- [Abstract] The abstract refers to 'canonical PDEs' without naming them; adding the specific equations (e.g., Poisson, heat, wave) would improve immediate readability.
- Notation for the finite-dimensional Green's operator representation and its discretization could be introduced with a brief example in the introduction or early methods section to aid readers unfamiliar with the construction.
Simulated Author's Rebuttal
We thank the referee for their accurate summary of the manuscript and for recommending acceptance. No major comments were raised in the report.
Circularity Check
No significant circularity detected
full rationale
The paper constructs NGOs from finite-dimensional Green's operator representations for linear PDEs, preserving the exact linear action on inhomogeneity fields while using NNs only to approximate nonlinear coefficient dependence. This separation follows directly from classical Green's function theory without reduction to fitted inputs or self-referential definitions. Benchmarks compare against external baselines (DeepONet, FNO, etc.) on out-of-distribution data, and extensions (auto-regressive stepping, iterative solvers) are presented with explicit caveats. No load-bearing step equates a prediction to its own inputs by construction, and no self-citation chain is invoked for uniqueness or ansatz. The derivation remains self-contained against external mathematical and numerical evidence.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption Green's operators exist and admit finite-dimensional representations for the linear PDEs under consideration
Lean theorems connected to this paper
-
IndisputableMonolith/Cost/FunctionalEquation.leanwashburn_uniqueness_aczel unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
Our construction of NGOs preserves the linear action of Green's operators on the inhomogeneity fields, while approximating the nonlinear dependence of the Green's function on the coefficients of the PDE using neural networks.
-
IndisputableMonolith/Foundation/AbsoluteFloorClosure.leanreality_from_one_distinction unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
NGOs accept weighted averages of the input functions... expansion of the Green’s function in terms of a test-basis ψn(x′) and trial-basis ϕm(x) as G[θ](x,x′)≈ϕm(x)Amn[θ]ψn(x′)
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Forward citations
Cited by 1 Pith paper
-
On the definition and importance of interpretability in scientific machine learning
Interpretability in SciML requires mechanistic understanding rather than sparsity, and prior knowledge is often essential for interpretable scientific discovery.
Reference graph
Works this paper leans on
-
[1]
The variational multiscale method—a paradigm for computational mechanics
Thomas JR Hughes, Gonzalo R Feij´ oo, Luca Mazzei, and Jean-Baptiste Quincy. The variational multiscale method—a paradigm for computational mechanics. Computer methods in applied mechanics and engineering , 166(1-2):3–24, 1998
work page 1998
-
[2]
The finite element method: linear static and dynamic finite element analysis
Thomas JR Hughes. The finite element method: linear static and dynamic finite element analysis. Courier Corporation, 2012
work page 2012
-
[3]
Computational fluid dynamics , volume
John David Anderson and John Wendt. Computational fluid dynamics , volume
-
[4]
Computational fluid- structure interaction: methods and applications
Yuri Bazilevs, Kenji Takizawa, and Tayfun E Tezduyar. Computational fluid- structure interaction: methods and applications . John Wiley & Sons, 2013
work page 2013
-
[5]
Classical and computational solid mechanics
Yuan-cheng Fung, Pin Tong, and Xiaohong Chen. Classical and computational solid mechanics. World Scientific, 2001
work page 2001
-
[6]
Lu Lu, Xuhui Meng, Shengze Cai, Zhiping Mao, Somdatta Goswami, Zhongqiang Zhang, and George Em Karniadakis. A comprehensive and fair comparison of two neural operators (with practical extensions) based on fair data. Computer Methods in Applied Mechanics and Engineering , 393:114778, 2022
work page 2022
-
[7]
Multilayer feedforward networks are universal approximators
Kurt Hornik, Maxwell Stinchcombe, and Halbert White. Multilayer feedforward networks are universal approximators. Neural networks, 2(5):359–366, 1989
work page 1989
-
[8]
Tianping Chen and Hong Chen. Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems. IEEE transactions on neural networks , 6(4):911–917, 1995
work page 1995
-
[9]
Lu Lu, Pengzhan Jin, Guofei Pang, Zhongqiang Zhang, and George Em Karni- adakis. Learning nonlinear operators via deeponet based on the universal ap- proximation theorem of operators. Nature machine intelligence , 3(3):218–229, 2021
work page 2021
-
[10]
Fourier Neural Operator for Parametric Partial Differential Equations
Zongyi Li, Nikola Kovachki, Kamyar Azizzadenesheli, Burigede Liu, Kaushik Bhattacharya, Andrew Stuart, and Anima Anandkumar. Fourier neu- ral operator for parametric partial differential equations. arXiv preprint arXiv:2010.08895, 2020. 39
work page internal anchor Pith review Pith/arXiv arXiv 2010
-
[11]
Multipole graph neu- ral operator for parametric partial differential equations
Zongyi Li, Nikola Kovachki, Kamyar Azizzadenesheli, Burigede Liu, Andrew Stuart, Kaushik Bhattacharya, and Anima Anandkumar. Multipole graph neu- ral operator for parametric partial differential equations. Advances in Neural Information Processing Systems, 33:6755–6766, 2020
work page 2020
-
[12]
Neural operator: Learning maps between function spaces with applications to pdes
Nikola Kovachki, Zongyi Li, Burigede Liu, Kamyar Azizzadenesheli, Kaushik Bhattacharya, Andrew Stuart, and Anima Anandkumar. Neural operator: Learning maps between function spaces with applications to pdes. Journal of Machine Learning Research, 24(89):1–97, 2023
work page 2023
-
[13]
Machine learning–accelerated computational fluid dynam- ics
Dmitrii Kochkov, Jamie A Smith, Ayya Alieva, Qing Wang, Michael P Brenner, and Stephan Hoyer. Machine learning–accelerated computational fluid dynam- ics. Proceedings of the National Academy of Sciences , 118(21):e2101784118, 2021
work page 2021
-
[14]
Fourier neural operator based fluid-structure interaction for predicting the vesicle dynamics
Wang Xiao, Ting Gao, Kai Liu, Jinqiao Duan, and Meng Zhao. Fourier neural operator based fluid-structure interaction for predicting the vesicle dynamics. arXiv preprint arXiv:2401.02311 , 2024
-
[15]
Salah A Faroughi, Nikhil M Pawar, C´ elio Fernandes, Maziar Raissi, Subasish Das, Nima K Kalantari, and Seyed Kourosh Mahjour. Physics-guided, physics- informed, and physics-encoded neural networks and operators in scientific com- puting: Fluid and solid mechanics. Journal of Computing and Information Science in Engineering, 24(4):040802, 2024
work page 2024
-
[16]
Fourier neural operator for accurate optical fiber modeling with low complexity
Xingchen He, Lianshan Yan, Lin Jiang, Anlin Yi, Zhengyu Pu, Youren Yu, Hongwei Chen, Wei Pan, and Bin Luo. Fourier neural operator for accurate optical fiber modeling with low complexity. Journal of Lightwave Technology , 41(8):2301–2311, 2022
work page 2022
-
[17]
Green’s functions for preconditioning
Daniel Loghin. Green’s functions for preconditioning. 1999
work page 1999
-
[18]
Mathe- matical methods for physics and engineering: a comprehensive guide
Kenneth Franklin Riley, Michael Paul Hobson, and Stephen John Bence. Mathe- matical methods for physics and engineering: a comprehensive guide. Cambridge university press, 2006
work page 2006
-
[19]
Principled inter- polation of green’s functions learned from data
Harshwardhan Praveen, Nicolas Boull´ e, and Christopher Earls. Principled inter- polation of green’s functions learned from data. Computer Methods in Applied Mechanics and Engineering, 409:115971, 2023
work page 2023
-
[20]
Yuankai Teng, Xiaoping Zhang, Zhu Wang, and Lili Ju. Learning green’s func- tions of linear reaction-diffusion equations with application to fast numerical 40 solver. In Mathematical and Scientific Machine Learning , pages 1–16. PMLR, 2022
work page 2022
-
[21]
Deep generalized green’s functions
Rixi Peng, Juncheng Dong, Jordan Malof, Willie J Padilla, and Vahid Tarokh. Deep generalized green’s functions. arXiv preprint arXiv:2306.02925 , 2023
-
[22]
Deepgreen: deep learning of green’s functions for nonlinear boundary value problems
Craig R Gin, Daniel E Shea, Steven L Brunton, and J Nathan Kutz. Deepgreen: deep learning of green’s functions for nonlinear boundary value problems. Sci- entific reports, 11(1):21614, 2021
work page 2021
-
[23]
Variationally mimetic operator networks
Dhruv Patel, Deep Ray, Michael RA Abdelmalik, Thomas JR Hughes, and Assad A Oberai. Variationally mimetic operator networks. Computer Methods in Applied Mechanics and Engineering , 419:116536, 2024
work page 2024
-
[24]
Con- volutional neural operators for robust and accurate learning of pdes
Bogdan Raonic, Roberto Molinaro, Tim De Ryck, Tobias Rohner, Francesca Bartolucci, Rima Alaifari, Siddhartha Mishra, and Emmanuel de B´ ezenac. Con- volutional neural operators for robust and accurate learning of pdes. Advances in Neural Information Processing Systems , 36, 2024
work page 2024
-
[25]
Weak imposition of dirichlet boundary conditions in fluid mechanics
Yuri Bazilevs and Thomas JR Hughes. Weak imposition of dirichlet boundary conditions in fluid mechanics. Computers & fluids , 36(1):12–26, 2005
work page 2005
-
[26]
Fourier neural operator with learned deformations for pdes on general geome- tries
Zongyi Li, Daniel Zhengyu Huang, Burigede Liu, and Anima Anandkumar. Fourier neural operator with learned deformations for pdes on general geome- tries. Journal of Machine Learning Research , 24(388):1–26, 2023
work page 2023
-
[27]
Joost Simon Boudewijn van Zwieten, Gerrit Johannes van Zwieten, and Wijnand Hoitinga. Nutils, November 2023
work page 2023
-
[28]
Generating synthetic data for neural opera- tors
Erisa Hasani and Rachel A Ward. Generating synthetic data for neural opera- tors. arXiv preprint arXiv:2401.02398 , 2024. A Derivation of Green’s operators A.1 Steady diffusion To derive the Green’s operator for the steady diffusion equation 4.4 as given by equation 4.2, we follow the approach of Section 2. We start with testing the governing equation aga...
-
[29]
This normalisation was done to ensure that the inputs η, θ, f are of a similar magnitude to what they are in the training data. For the VarMiON and NGO, the normalisation doesn’t affect the model accuracy since these models are linear in f and η. However, DeepONets and FNOs, which do not have this linearity, are expected to perform best when the inputs ar...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.