RECORD
A Common Framework for Natural Gradient and Taylor based Optimisation using Manifold Theory
Machine Learning · Submitted 26 Mar 2018
abstract compiled · 2026-09-23 · no language-model review
The authors' main claim Such a framework will be shown to also provide mathematical justification to combine higher order methods with the method of NG.
The compiled record
The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
Open the compiled record
The abstract, sentence by sentence
This technical report constructs a theoretical framework to relate standard Taylor approximation based optimisation methods with Natural Gradient (NG), a method which is Fisher efficient with probabilistic models. Such a framework will be shown to also provide mathematical justification to combine higher order methods with the method of NG.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | This technical report constructs a theoretical framework to relate standard Taylor approximation based optimisation methods with Natural Gradient (NG), a method which is Fisher efficient with probabilistic models. | contribution 1.00 | 0.89 | 0.23 | asserted 0.99 |
| s1 | Such a framework will be shown to also provide mathematical justification to combine higher order methods with the method of NG. | result 0.45 | 0.59 | 0.40 | asserted 0.94 |
What was examined, and what was not
- arXiv listing abstract v3
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
The paper
Original abstract
This technical report constructs a theoretical framework to relate standard Taylor approximation based optimisation methods with Natural Gradient (NG), a method which is Fisher efficient with probabilistic models. Such a framework will be shown to also provide mathematical justification to combine higher order methods with the method of NG.
Human review
How the literature uses it
1 arXiv paper cite this in 2 sentences
What it cites · 2 sentences without a confident label
Cites as support 1 paper
-
When $X$ possesses such a structure, performing first order optimisation within a trust region defined by $I_θ$ can be shown to produce the update $Δθ =I_θ^-1 ∇F(θ )$ at each iteration [ref] .
Optimization Methods for Large-Scale Machine Learning · Relating Gradient Descent with Natural Gradient · 0.96
Discussion
Know something about this paper? Leave a comment, or highlight any passage above to comment on it.