Integrating Neural Operators with Diffusion Models Improves Spectral Representation in Turbulence Modeling
Reviewed by Pithpith:SYHLGX3Iopen to challenge →
read the original abstract
We integrate neural operators with diffusion models to address the spectral limitations of neural operators in surrogate modeling of turbulent flows. While neural operators offer computational efficiency, they exhibit deficiencies in capturing high-frequency flow dynamics, resulting in overly smooth approximations. To overcome this, we condition diffusion models on neural operators to enhance the resolution of turbulent structures. Our approach is validated for different neural operators on diverse datasets, including a high Reynolds number jet flow simulation and experimental Schlieren velocimetry. The proposed method significantly improves the alignment of predicted energy spectra with true distributions compared to neural operators alone. This enables the diffusion models to stabilize longer forecasts through diffusion-corrected autoregressive rollouts, as we demonstrate in this work. Additionally, proper orthogonal decomposition analysis demonstrates enhanced spectral fidelity in space-time. This work establishes a new paradigm for combining generative models with neural operators to advance surrogate modeling of turbulent systems, and it can be used in other scientific applications that involve microstructure and high-frequency content. See our project page: vivekoommen.github.io/NO_DM
This paper has not been read by Pith yet.
Forward citations
Cited by 8 Pith papers
-
Spectrally Regularized Latent Flow Matching for Turbulence Generation
Spectrally regularized compression in latent flow matching raises retained deep-dissipation spectral power from 20% to 79% in generated turbulence on a 256^2 DNS dataset at Re_f ≈ 2250.
-
Correcting Neural Operator Spectral Bias via Diffusion Posterior Sampling with Sparse Observations
FreqNO-DPS corrects neural operator spectral bias in 3D elastic wavefield prediction by frequency-dependent guidance in diffusion posterior sampling conditioned on sparse observations, achieving near-zero bias at 2-5%...
-
Latent Generative Solvers for Generalizable Long-Term Physics Simulation
LGS pretrained on 2.5M trajectories across 16 systems matches deterministic baselines at one step and halves 20-step error while using far less compute and adapting to held-out higher-resolution flows.
-
Wavelet Flow Matching for Multi-Scale Physics Emulation
Wavelet Flow Matching emulates multi-scale PDE-governed systems by transporting velocities directly in a hierarchical wavelet representation via U-Net, yielding improved long-horizon stability and spectral accuracy on...
-
MENO: MeanFlow-Enhanced Neural Operators for Dynamical Systems
MENO enhances neural operators with MeanFlow to restore multi-scale accuracy in dynamical system predictions while keeping inference costs low, achieving up to 2x better power spectrum accuracy and 12x faster inferenc...
-
Flow marching for a generative PDE foundation model
Flow Marching jointly samples noise and physical time to learn a velocity field for generative PDE modeling, paired with a latent autoencoder and efficient transformer for large-scale pretraining on 2.5M trajectories.
-
Multiscale Fourier Neural Operator for Inverse Wave Scattering in Highly Oscillatory Media
MscaleFNO learns mappings from oscillatory media to wavefields for Helmholtz inverse problems and pairs it with diffusion regularization for partial-aperture 2D reconstructions.
-
Predictivity and Utility of Neural Surrogates of Multiscale PDEs
Neural surrogates systematically under-resolve high-frequency content in multiscale PDEs due to spectral bias and irreversible coarse-graining losses, with success confined to low-dimensional manifolds and weather pre...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.