REVIEW 4 cited by
GNOT: A General Neural Operator Transformer for Operator Learning
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Learning partial differential equations' (PDEs) solution operators is an essential problem in machine learning. However, there are several challenges for learning operators in practical applications like the irregular mesh, multiple input functions, and complexity of the PDEs' solution. To address these challenges, we propose a general neural operator transformer (GNOT), a scalable and effective transformer-based framework for learning operators. By designing a novel heterogeneous normalized attention layer, our model is highly flexible to handle multiple input functions and irregular meshes. Besides, we introduce a geometric gating mechanism which could be viewed as a soft domain decomposition to solve the multi-scale problems. The large model capacity of the transformer architecture grants our model the possibility to scale to large datasets and practical problems. We conduct extensive experiments on multiple challenging datasets from different domains and achieve a remarkable improvement compared with alternative methods. Our code and data are publicly available at \url{https://github.com/thu-ml/GNOT}.
Forward citations
Cited by 4 Pith papers
-
Hybrid Lagrangian-Eulerian Model for Lagrangian Fluid Simulation
A hybrid Lagrangian-Eulerian graph neural simulator with adaptive downsampling and cross-attention achieves state-of-the-art accuracy and rollout stability on particle-based fluid benchmarks.
-
No Free Lunch in Flow Surrogates under Time-Varying Boundary Conditions: A Two-Regime Study
No single flow-surrogate architecture transfers from a boundary-driven Stokes film to a self-sustained Kármán wake; time treatment decides the winner and pointwise RMSE ranks the wrong models.
-
LaDEEP: A Deep Learning-based Surrogate Model for Large Deformation of Elastic-Plastic Solids
A two-stage Transformer surrogate trained on finite element data predicts stretch-bending final shapes with about 0.17 mm mean absolute distance and over 10,000 times speedup versus FEM.
-
BSA: Ball Sparse Attention for Large-scale Geometries
BSA combines Native Sparse Attention with ball-tree neighborhoods to give transformers a global view of 3D point sets at lower compute cost.
Discussion (0). Sign in to comment.