REVIEW 7 cited by
Score-based Diffusion Models in Function Space
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Diffusion models have recently emerged as a powerful framework for generative modeling. They consist of a forward process that perturbs input data with Gaussian white noise and a reverse process that learns a score function to generate samples by denoising. Despite their tremendous success, they are mostly formulated on finite-dimensional spaces, e.g., Euclidean, limiting their applications to many domains where the data has a functional form, such as in scientific computing and 3D geometric data analysis. This work introduces a mathematically rigorous framework called Denoising Diffusion Operators (DDOs) for training diffusion models in function space. In DDOs, the forward process perturbs input functions gradually using a Gaussian process. The generative process is formulated by a function-valued annealed Langevin dynamic. Our approach requires an appropriate notion of the score for the perturbed data distribution, which we obtain by generalizing denoising score matching to function spaces that can be infinite-dimensional. We show that the corresponding discretized algorithm generates accurate samples at a fixed cost independent of the data resolution. We theoretically and numerically verify the applicability of our approach on a set of function-valued problems, including generating solutions to the Navier-Stokes equation viewed as the push-forward distribution of forcings from a Gaussian Random Field (GRF), as well as volcano InSAR and MNIST-SDF.
Forward citations
Cited by 7 Pith papers
-
Flow Straight and Fast in Hilbert Space: Functional Rectified Flow
Functional rectified flow is defined and proved to preserve marginals in separable Hilbert spaces, with functional flow matching and probability-flow ODEs as special cases.
-
Scale-Consistent Learning for Partial Differential Equations
Scale-consistency training, which enforces agreement between global and rescaled sub-domain predictions, enables neural PDE solvers to extrapolate to unseen scale parameters such as Reynolds number or wavenumber.
-
PolyMicros: Bootstrapping a Foundation Model for Polycrystalline Material Structure
PolyMicros bootstraps a generative foundation model for polycrystalline microstructures from five experimental volumes and applies it zero-shot to microscopy super-resolution and 2D-to-3D dimensionality expansion.
-
Probabilistic operator learning: generative modeling and uncertainty quantification for foundation models of differential equations
ICON is shown to compute the posterior predictive mean of differential equation solutions, and a generative extension, GenICON, provides samples from this distribution for uncertainty quantification.
-
Scale-Adaptive Generative Flows for Multiscale Scientific Data
For generative flows on multiscale scientific fields, the noise spectrum should be at least as rough as the data's, and a scale-adaptive schedule can tame the terminal-time stiffness of rougher noise.
-
Cognitive Structure Generation: From Educational Priors to Policy Optimization
A neural-operator diffusion model gives more stable Hessian-diagonal estimates, improving score-based causal ordering and enabling LLM-guided causal reasoning.
-
Generative Unordered Flow for Set-Structured Data Generation
The paper proposes to represent unordered point sets as Gaussian mixtures, learn flow matching over these function representations, and decode generated functions back to point sets via Langevin warm-up and gradient ascent.
Discussion (0). Continue with ORCID to comment.