RECORD
Neural Generative Models for Global Optimization with Gradients
Neural and Evolutionary Computing · Submitted 22 May 2018
abstract compiled · 2026-09-23 · no language-model review
The authors' main claim In our experiments we show the practical superiority of our algorithm versus classical Evolutionary Search and gradient-based solutions on a benchmark set of multimodal functions, and demonstrate how it can be used to accelerate Bayesian Optimization with Gaussian Processes.
The compiled record
The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
Open the compiled record
The abstract, sentence by sentence
The aim of global optimization is to find the global optimum of arbitrary classes of functions, possibly highly multimodal ones. In this paper we focus on the subproblem of global optimization for differentiable functions and we propose an Evolutionary Search-inspired solution where we model point search distributions via Generative Neural Networks. This approach enables us to model diverse and complex search distributions based on which we can efficiently explore complicated objective landscapes. In our experiments we show the practical superiority of our algorithm versus classical Evolutionary Search and gradient-based solutions on a benchmark set of multimodal functions, and demonstrate how it can be used to accelerate Bayesian Optimization with Gaussian Processes.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | The aim of global optimization is to find the global optimum of arbitrary classes of functions, possibly highly multimodal ones. | background 1.00 | 0.04 | 0.02 | asserted 0.93 |
| s1 | In this paper we focus on the subproblem of global optimization for differentiable functions and we propose an Evolutionary Search-inspired solution where we model point search distributions via Generative Neural Networks. | contribution 0.75 | 0.82 | 0.07 | asserted 0.99 |
| s2 | This approach enables us to model diverse and complex search distributions based on which we can efficiently explore complicated objective landscapes. | method 0.55 | 0.49 | 0.08 | asserted 0.87 |
| s3 | In our experiments we show the practical superiority of our algorithm versus classical Evolutionary Search and gradient-based solutions on a benchmark set of multimodal functions, and demonstrate how it can be used to accelerate Bayesian Optimization with Gaussian Processes. | result 0.98 | 0.96 | 0.80 | asserted 1.00 |
What was examined, and what was not
- arXiv listing abstract v3
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
The paper
Original abstract
The aim of global optimization is to find the global optimum of arbitrary classes of functions, possibly highly multimodal ones. In this paper we focus on the subproblem of global optimization for differentiable functions and we propose an Evolutionary Search-inspired solution where we model point search distributions via Generative Neural Networks. This approach enables us to model diverse and complex search distributions based on which we can efficiently explore complicated objective landscapes. In our experiments we show the practical superiority of our algorithm versus classical Evolutionary Search and gradient-based solutions on a benchmark set of multimodal functions, and demonstrate how it can be used to accelerate Bayesian Optimization with Gaussian Processes.
Human review
How the literature uses it
1 arXiv paper cite this in 1 sentence
What it cites · 3 sentences without a confident label
Uses the method or tool of 1 paper
-
This stochastic estimate of the gradient is then fed to a stochastic gradient descent algorithm like Adam [ref] .
Adam: A Method for Stochastic Optimization · Core algorithm · 0.99
Cites as background 2 papers
-
In this work, we focus on one popular acquisition function: the Expected Improvement (EI, [ref] ), although there exists many others ( [ref] , [ref] ) which could be equivalently used in this work.
Gaussian Process Optimization in the Bandit Setting: No Regret and Experimental Design · Zero order algorithms · 0.83
-
We refer the interested reader to [ref] for thorough details on the procedure followed by CMA-ES.
The CMA Evolution Strategy: A Tutorial · Zero order algorithms · 0.96
Discussion
Know something about this paper? Leave a comment, or highlight any passage above to comment on it.