RECORD
Neural Ordinary Differential Equations on Manifolds
Machine Learning · Submitted 11 Jun 2020
abstract compiled · 2026-09-23 · no language-model review
The authors' main claim As a result we define a general methodology for building normalizing flows on manifolds.
The compiled record
The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
Open the compiled record
The abstract, sentence by sentence
Normalizing flows are a powerful technique for obtaining reparameterizable samples from complex multimodal distributions. Unfortunately current approaches fall short when the underlying space has a non trivial topology, and are only available for the most basic geometries. Recently normalizing flows in Euclidean space based on Neural ODEs show great promise, yet suffer the same limitations. Using ideas from differential geometry and geometric control theory, we describe how neural ODEs can be extended to smooth manifolds. We show how vector fields provide a general framework for parameterizing a flexible class of invertible mapping on these spaces and we illustrate how gradient based learning can be performed. As a result we define a general methodology for building normalizing flows on manifolds.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | Normalizing flows are a powerful technique for obtaining reparameterizable samples from complex multimodal distributions. | background 1.00 | 0.06 | 0.03 | asserted 1.00 |
| s1 | Unfortunately current approaches fall short when the underlying space has a non trivial topology, and are only available for the most basic geometries. | gap 0.89 | 0.06 | 0.03 | asserted 1.00 |
| s2 | Recently normalizing flows in Euclidean space based on Neural ODEs show great promise, yet suffer the same limitations. | background 0.68 | 0.07 | 0.03 | asserted 0.96 |
| s3 | Using ideas from differential geometry and geometric control theory, we describe how neural ODEs can be extended to smooth manifolds. | contribution 0.89 | 0.85 | 0.16 | asserted 0.97 |
| s4 | We show how vector fields provide a general framework for parameterizing a flexible class of invertible mapping on these spaces and we illustrate how gradient based learning can be performed. | method 0.66 | 0.92 | 0.20 | asserted 1.00 |
| s5 | As a result we define a general methodology for building normalizing flows on manifolds. | contribution 0.94 | 0.91 | 0.78 | asserted 1.00 |
What was examined, and what was not
- arXiv listing abstract v1
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
The paper
Original abstract
Normalizing flows are a powerful technique for obtaining reparameterizable samples from complex multimodal distributions. Unfortunately current approaches fall short when the underlying space has a non trivial topology, and are only available for the most basic geometries. Recently normalizing flows in Euclidean space based on Neural ODEs show great promise, yet suffer the same limitations. Using ideas from differential geometry and geometric control theory, we describe how neural ODEs can be extended to smooth manifolds. We show how vector fields provide a general framework for parameterizing a flexible class of invertible mapping on these spaces and we illustrate how gradient based learning can be performed. As a result we define a general methodology for building normalizing flows on manifolds.
Human review
References
How the literature uses it
25 arXiv papers cite this in 35 sentences
Papers citing it · 16 sentences without a confident label
Contests it 1 paper
-
Mathieu et al. [ref] , Lou et al. [ref] and Falorsi et al. [ref] propose continuous normalizing flows for general Riemannian manifold, without considering any property of $$ space, which leads to unsatisfactory performance for probabilistic rotation modeling.
Delving into Discrete Normalizing Flows on SO(3) Manifold for Probabilistic Rotation Modeling · Introduction · contest 0.83
Compares with it 1 paper
-
We note in passing that some authors [ref] have reported competitive or even superior performance in a similar setting by replacing the projection method with continuous normalizing flows for Riemannian manifolds.
A Review of Change of Variable Formulas for Generative Modeling · Data on Embedded Manifolds · 0.85
Cites it as support 1 paper
-
This exponential amplification carries over to learned vector fields, where projection or retraction steps are needed to keep iterates close to the constraint set [ref] , so feasibility degrades with both network expressivity (which controls $L$) and integration horizon.
Learning Unbiased Permutations via Flow Matching · Related Work · 0.98
Cites it as background 14 papers
-
A manifold CNF, $Φ:$, is an orientation preserving diffeomorphism from the manifold to itself [ref] .
Moser Flow: Divergence-based Generative Modeling on Manifolds · Preliminaries · 0.91
-
In a parallel line of works, [ref] developed CNFs over Riemannian manifolds.
Matching Normalizing Flows and Probability Paths on Manifolds · Introduction · 0.98
-
Works that provide an answer to this question can be roughly divided between those that leverage known local geometric information of the manifold [ref] and those that learn its topological structure [ref] .
Density estimation on smooth manifolds with normalizing flows · Introduction · 0.94
Discussion
Know something about this paper? Leave a comment, or highlight any passage above to comment on it.