REVIEW 8 cited by
Unisolver: PDE-Conditional Transformers Towards Universal Neural PDE Solvers
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Unisolver: PDE-Conditional Transformers Towards Universal Neural PDE Solvers
read the original abstract
Deep models have recently emerged as promising tools to solve partial differential equations (PDEs), known as neural PDE solvers. While neural solvers trained from either simulation data or physics-informed loss can solve PDEs reasonably well, they are mainly restricted to a few instances of PDEs, e.g. a certain equation with a limited set of coefficients. This limits their generalization to diverse PDEs, preventing them from being practical surrogate models of numerical solvers. In this paper, we present Unisolver, a novel Transformer model trained on diverse data and conditioned on diverse PDEs, aiming towards a universal neural PDE solver capable of solving a wide scope of PDEs. Instead of purely scaling up data and parameters, Unisolver stems from the theoretical analysis of the PDE-solving process. Inspired by the mathematical structure of PDEs that a PDE solution is fundamentally governed by a series of PDE components such as equation symbols and boundary conditions, we define a complete set of PDE components and flexibly embed them as domain-wise and point-wise deep conditions for Transformer PDE solvers. Integrating physical insights with recent Transformer advances, Unisolver achieves consistent state-of-the-art on three challenging large-scale benchmarks, showing impressive performance and generalizability. Code is available at https://github.com/thuml/Unisolver.
Forward citations
Cited by 8 Pith papers
-
CATO: Charted Attention for Neural PDE Operators
CATO learns a continuous latent chart for efficient axial attention on PDE meshes and adds derivative-aware supervision to improve accuracy and reduce oversmoothing on general geometries.
-
MVNN: A Measure-Valued Neural Network for Learning McKean-Vlasov Dynamics from Particle Data
MVNN learns measure-dependent drift terms in McKean-Vlasov equations from particle data using an embedding network, with proofs of well-posedness, propagation of chaos, and universal approximation under low-dimensiona...
-
Latent Generative Solvers for Generalizable Long-Term Physics Simulation
LGS pretrained on 2.5M trajectories across 16 systems matches deterministic baselines at one step and halves 20-step error while using far less compute and adapting to held-out higher-resolution flows.
-
Neural operator discovery from heterogeneous trajectories
Trajectory grouping plus a low-dimensional latent bottleneck lets a neural operator discover each system's hidden governing factors and extrapolate to unseen systems.
-
LSR-Net: Long-Short-Range Operator Learning for Pattern Dynamics on Manifolds
LSR-Net learns long-short-range operators for pattern dynamics on manifolds via Fourier multipliers and Gaussian gridding, showing lower RMSE than SFNO on Allen-Cahn and similar systems.
-
SuperWing: a comprehensive transonic wing dataset for data-driven aerodynamic design
SuperWing supplies 4,239 diverse wing shapes and 28,856 flow-field solutions that let Transformer models predict surface aerodynamics to 2.5 drag-count error and generalize zero-shot to DLR-F6 and NASA CRM wings.
-
Spectral-inspired Operator Learning with Limited Data and Unknown Physics
SINO learns PDE operators from limited data using spectral features from frequency indices, a Pi-block for nonlinearities, and a low-pass filter, achieving 1-2 orders of magnitude better accuracy than prior methods on...
-
Replay-Based Continual Learning for Physics-Informed Neural Operators
A replay-based continual learning strategy for physics-informed neural operators mitigates catastrophic forgetting on prior physical problems while enabling efficient adaptation to new data using only physical constraints.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.