REVIEW 7 cited by
PDE Generalization of In-Context Operator Networks: A Study on 1D Scalar Nonlinear Conservation Laws
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Can we build a single large model for a wide range of PDE-related scientific learning tasks? Can this model generalize to new PDEs, even of new forms, without any fine-tuning? In-context operator learning and the corresponding model In-Context Operator Networks (ICON) represent an initial exploration of these questions. The capability of ICON regarding the first question has been demonstrated previously. In this paper, we present a detailed methodology for solving PDE problems with ICON, and show how a single ICON model can make forward and reverse predictions for different equations with different strides, provided with appropriately designed data prompts. We show the positive evidence to the second question, i.e., ICON can generalize well to some PDEs with new forms without any fine-tuning. This is exemplified through a study on 1D scalar nonlinear conservation laws, a family of PDEs with temporal evolution. We also show how to broaden the range of problems that an ICON model can address, by transforming functions and equations to ICON's capability scope. We believe that the progress in this paper is a significant step towards the goal of training a foundation model for PDE-related tasks under the in-context operator learning framework.
Forward citations
Cited by 7 Pith papers
-
Generalized Neural Operator for Parametric and Boundary-Value Problems
A Generalized Neural Operator that conditions on PDE parameters and boundary conditions achieves state-of-the-art normalized MSE on parametric boundary-value problems while matching numerical solver inference speed.
-
Probabilistic operator learning: generative modeling and uncertainty quantification for foundation models of differential equations
ICON is shown to compute the posterior predictive mean of differential equation solutions, and a generative extension, GenICON, provides samples from this distribution for uncertainty quantification.
-
Error analysis for learning the time-stepping operator of evolutionary PDEs
For reaction-diffusion, forced parabolic, and viscous conservation law PDEs, neural networks can learn the numerical one-step time map with generalization error that is polynomial in mesh size, not exponential.
-
DISCO: learning to DISCover an evolution Operator for multi-physics-agnostic prediction
A hypernetwork reads a short trajectory and outputs the parameters of a small neural ODE-like PDE solver, achieving state-of-the-art next-frame prediction on PDEBench with significantly fewer training epochs.
-
A Multimodal PDE Foundation Model for Prediction and Scientific Text Descriptions
A multimodal transformer predicts ODE/PDE solutions and generates correct scientific text descriptions from numerical and symbolic inputs, with low error on in-distribution and out-of-distribution tests.
-
BCAT: A Block Causal Transformer for PDE Foundation Models for Fluid Dynamics
BCAT, a block causal transformer for next-frame prediction, achieves state-of-the-art accuracy on 2D fluid dynamics PDE benchmarks, beating larger foundation models with fewer parameters.
-
Neural Interpretable PDEs: Harmonizing Fourier Insights with Attention for Scalable and Interpretable Physics Discovery
NIPS is a neural operator that uses linear attention and Fourier kernels to simultaneously predict PDE solutions and recover hidden material properties from limited data.
Discussion (0). Continue with ORCID to comment.