REVIEW 34 cited by
An Expert's Guide to Training Physics-informed Neural Networks
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
An Expert's Guide to Training Physics-informed Neural Networks
read the original abstract
Physics-informed neural networks (PINNs) have been popularized as a deep learning framework that can seamlessly synthesize observational data and partial differential equation (PDE) constraints. Their practical effectiveness however can be hampered by training pathologies, but also oftentimes by poor choices made by users who lack deep learning expertise. In this paper we present a series of best practices that can significantly improve the training efficiency and overall accuracy of PINNs. We also put forth a series of challenging benchmark problems that highlight some of the most prominent difficulties in training PINNs, and present comprehensive and fully reproducible ablation studies that demonstrate how different architecture choices and training strategies affect the test accuracy of the resulting models. We show that the methods and guiding principles put forth in this study lead to state-of-the-art results and provide strong baselines that future studies should use for comparison purposes. To this end, we also release a highly optimized library in JAX that can be used to reproduce all results reported in this paper, enable future research studies, as well as facilitate easy adaptation to new use-case scenarios.
Forward citations
Cited by 34 Pith papers
-
Learning Where to Simulate: Generative Active Sampling for Online PDE Surrogate Training
OGAS uses a parallel diffusion model to bias PDE configuration sampling toward high surrogate difficulty, reducing 99th-percentile errors and error variance versus uniform sampling across tested 2D PDEs.
-
Decision-Aware Evaluation of Physics-Informed Surrogates
Introduces pinn-gym benchmark demonstrating that low curve error in physics-informed surrogates frequently fails to yield useful design selections across per-material, pooled, and cross-material settings.
-
Per-Loss Adapters for Gradient Conflict in Physics-Informed Neural Networks
PINN gradient conflicts occur in distinct regimes (persistent directional, magnitude imbalance, or low/transient) that each favor different fixes, with per-loss adapters plus reweighting improving results on forward a...
-
Hard-constrained Physics-informed Neural Networks for Interface Problems
Hard-constrained PINN formulations via windowing and buffer approaches enforce interface conditions by design and outperform soft-constrained baselines on 1D and 2D elliptic interface problems.
-
Hard-constrained Physics-informed Neural Networks for Interface Problems
Windowing and buffer hard-constrained PINNs enforce interface physics by design, yielding higher interface fidelity than soft-constrained baselines on elliptic benchmarks.
-
Gaussian Process Regression of Steering Vectors With Physics-Aware Deep Composite Kernels for Augmented Listening
Gaussian process regression with physics-aware deep composite kernels models steering vectors continuously over frequency and positions, attaining oracle performance in speech enhancement and binaural rendering with u...
-
Physics-informed Conditional Normalizing Flows for Angles-only Cislunar Orbit Determination
Conditional normalizing flows model the posterior over initial states from short-arc angles-only measurements in cislunar NRHOs and supply warm starts for nonlinear least-squares refinement.
-
Verified residual-specific explicit derivative kernels for physics-informed learning and discretized PDE adjoints
Develops and numerically verifies residual-specific explicit derivative kernels that achieve floating-point agreement with AD while delivering 2-4x speedups and lower memory use in PINN training and CFD adjoint workflows.
-
A welding penetration prediction model for laser welding process based on self-supervised learning using physics-informed neural networks
SimPhysNet achieves 96.06% accuracy classifying laser welding penetration states using self-supervised contrastive learning with a physics-informed neural network and prototypical networks on only 200 labeled images.
-
Reconstructing Galactic Gravitational Potentials from Stellar Kinematics with Physics-Informed Neural Networks
A PINN approach learns galactic gravitational potentials from acceleration data, achieving sub-percent errors on simulations while outperforming analytic models and retaining interpretability via structured priors.
-
Uncovering Turbulent Dynamics in Stenotic Flows from 4D-flow MRI Measurements via Resolvent Analysis and Data Assimilation
A hybrid MRI-PINN-resolvent framework extracts mean fields from stenotic flow measurements and identifies stationary eigenmodes in the recirculation bubble plus broadband pseudo-resonance in the shear layer.
-
The Coercivity Gap in Neural PDE Solvers: Parameter Escape and Functional Convergence
Neural ansatzes for elliptic PDEs may fail to be coercive in parameter space due to non-closedness and condensation, but state functions converge strongly to the exact solution with derived rates for Gaussian wave-pac...
-
The Coercivity Gap in Neural PDE Solvers: Parameter Escape and Functional Convergence
Elliptic energy loses coercivity on neural ansatzes due to manifold non-closedness and condensation, but state functions remain bounded and converge strongly, with rates proved for Gaussian wave-packet approximations.
-
Riemannian Diffusion Models on General Manifolds via Physics-Informed Neural Networks
Approximates manifold heat kernels via PINNs solving the heat equation to enable diffusion models on arbitrary manifolds including S2, SO(3), and SPD(n).
-
Hermite-NGP: Gradient-Augmented Hash Encoding for Learning PDEs
Hermite-NGP stores derivatives in multi-resolution hash encodings and uses curriculum training to enable analytic differential operators, reporting up to 20x lower error and 2-10x faster convergence than prior neural ...
-
Error whitening: Why Gauss-Newton outperforms Newton
Gauss-Newton descent whitens errors by projecting Newton directions or gradients onto the tangent space, replacing JJ^T with the identity and removing parameterization distortions that affect Newton descent.
-
Adaptive anisotropic composite quadratures for residual minimisation in neural PDE approximations
An adaptive anisotropic composite quadrature strategy combined with refresh-based training narrows the gap between training and reference losses in neural residual minimization for PDEs while using quadrature points m...
-
When PINNs Go Wrong: Pseudo-Time Stepping Against Spurious Solutions
PINNs fail on spurious solutions admitted by the residual loss; adaptive pseudo-time stepping with Jacobian-based step selection improves accuracy and robustness on PDE benchmarks.
-
Transferable Physics-Informed Representations via Closed-Form Head Adaptation
Pi-PINN learns transferable physics-informed representations and solves known or unseen PDEs via closed-form pseudoinverse head adaptation, achieving 100-1000x faster predictions and 10-100x lower error than standard ...
-
Material-Agnostic Zero-Shot Thermal Inference for Metal Additive Manufacturing via a Parametric PINN Framework
A decoupled parametric PINN with conditional modulation and Rosenthal-derived output scaling achieves zero-shot thermal inference across arbitrary metal alloys in laser powder bed fusion.
-
Physics-Informed Neural Networks for Solving Derivative-Constrained PDEs
DC-PINNs embed derivative constraints into PINN optimization using a minimum principle and adaptive balancing, reducing violations and improving fidelity on heat, finance, and fluid benchmarks.
-
PD-SOVNet: A Physics-Driven Second-Order Vibration Operator Network for Estimating Wheel Polygonal Roughness from Axle-Box Vibrations
PD-SOVNet combines shared second-order vibration kernels, MIMO coupling, adaptive physical correction, and Mamba temporal modeling to regress 1st-40th order wheel roughness spectra from axle-box vibrations with compet...
-
Solving and learning advective multiscale Darcian dynamics with the Neural Basis Method
The Neural Basis Method uses a predefined neural basis space and operator residual metric to deliver accurate single solves and fast parametric learning for multiscale Darcian dynamics.
-
Deep Learning Alternatives of the Kolmogorov Superposition Theorem
ActNet is a new KST-based neural network that outperforms KANs and competes with MLPs in PINN benchmarks for PDE simulation tasks.
-
Physics-Regularized Machine Learning for Proprioceptive Vehicle Localization Using Onboard Sensors
End-to-end training of a transformer measurement model through a differentiable EKF yields lower 60 s onboard-sensor dead-reckoning error and better low-µ generalization than pure ML or classical baselines.
-
Random Neural Network Expressivity for Non-Linear Partial Differential Equations
Random neural networks achieve a dimension-free approximation rate of 1/2 for sufficiently regular time-dependent Sobolev functions and can efficiently approximate solutions to Porous Medium Equations and Compressible...
-
Physics-Informed Neural Networks for Radial Consolidation of Combined Electroosmotic, Vacuum and Surcharge Preloading Considering Smear Effects
A modified gated PINN with hard-constraint boundary encoding achieves MAE of 0.27-0.43 kPa against FEM references for time-dependent electro-osmotic radial consolidation cases.
-
AdamFLIP: Adaptive Momentum Feedback Linearization Optimization for Hard Constrained PINN Training
AdamFLIP treats PDE constraint residuals in PINNs as a controlled dynamical system, computes Lagrange multipliers via feedback linearization to drive residuals to zero, and applies Adam-style adaptation to the resulti...
-
A Deep Learning Approach to Describing the Plasma Sheath
A physics-informed neural network acts as an efficient surrogate solver for fluid models of the plasma sheath across parameter regimes.
-
Neural network surrogates with uncertainty quantification for inverse problems in partial differential equations
DeepGaLA is a neural-network surrogate for differential equation solvers that provides uncertainty-aware predictions to enable scalable Bayesian inference for inverse PDE problems.
-
A Deep Learning Approach to Describing the Plasma Sheath
PINNs trained on fluid sheath equations produce parametric surrogate models that predict plasma sheath profiles across ion species, temperature ratios, and collisionalities, validated against Runge-Kutta solvers.
-
Deep-Learning based surrogate models for plasma exhaust simulations -- SOLPS-NN
SOLPS-NN is a fully connected neural network surrogate trained on SOLPS-ITER simulations that predicts spatial plasma profiles and indicates access to detachment with experimental trends.
-
Physics-Informed Neural Networks: A Didactic Derivation of the Complete Training Cycle
The paper supplies explicit hand-derived gradient formulas and a full training cycle for PINNs on a simple ODE, achieving 4.29e-4 relative L2 error against the analytic solution using only the physics loss.
-
Beyond Data-Driven: How Physics-Informed Neural Networks are Reshaping Multi-Physics Design and Discovery
A review assessing PINN advances for forward modeling, inverse design, and equation discovery across multi-physics domains.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.