Pith. sign in

REVIEW 3 major objections 4 minor 55 references

Benchmarking a wide range of optimisers for solving the Fermi-Hubbard model using the variational quantum eigensolver

T0 review · 3 major / 4 minor · reviewed 2026-08-12 · deepseek-v4-flash

Pith's one-line read Across 372 Fermi-Hubbard VQE instances, Momentum and Adam with finite-difference gradients reach the lowest ground-state energies, while SPSA, CMAES, and BayesMGD win when cost-function calls are scarce.

desk verdict Broad, useful VQE optimizer benchmark, but unequal evaluation effort across optimizers weakens the headline ranking. read the letter →

arxiv 2411.13742 v2 pith:JOMEX4FO submitted 2024-11-20 quant-ph cs.LGcs.NE

classification quant-phcs.LGcs.NE
keywords variationalquantumeigensolverFermi-HubbardmodelHamiltonianansatzoptimiserbenchmarkingfinitedifferencegradientsimultaneousperturbationnaturalhyperparametersweeping
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper tries to establish which classical optimisers a practitioner should choose when running the variational quantum eigensolver on the Fermi-Hubbard model with the Hamiltonian variational ansatz. It benchmarks 30 optimisers on 372 instances that vary grid size, Coulomb interaction, filling, ansatz depth, and number of measurement shots. Its central finding is that no single optimiser wins on both metrics: Momentum and Adam with finite-difference gradients give the best final accuracy, whereas SPSA, CMAES, and BayesMGD reach a target accuracy in the fewest cost-function calls. The paper also shows that the finite-difference step size strongly controls gradient quality and that simultaneous-perturbation gradients trade final precision for speed. The practical payoff would be concrete guidance for near-term quantum hardware, where the number of circuit evaluations is the scarce resource.

What carries the argument

The central object is the benchmark itself: a fixed set of 372 VQE instances built from the Hamiltonian variational ansatz for the Fermi-Hubbard model, each evaluated with two shot counts (1,000 and 10,000), with exact ground energies computed classically as the reference. The two gradient subroutines are the load-bearing comparison: finite differences, which costs two cost-function evaluations per parameter and is run at step size 0.4 (the average of the best step sizes found by sweeping four instances), and simultaneous perturbation, which costs two evaluations total and is run at step size 0.15. The paper also uses the diagonal approximation of the quantum Fisher information matrix as the machinery for the quantum natural gradient comparison, restricted to one-dimensional systems because the HV ansatz's fixed FSWAP gates prevent a global parameter shift of shared-angle gates.

What would settle it

Run the same 372-instance benchmark with finite-difference step sizes of, say, 0.1 and 0.8 while keeping all hyperparameter sweeps fixed; if the top optimisers in the final-energy ranking shift away from Momentum and Adam, the central ranking is an artefact of the 0.4 step size chosen from four instances.

Watch

Extended reading notes

Core claim

The paper claims that for VQE on the Fermi-Hubbard model with the Hamiltonian variational ansatz under shot-noise-limited cost functions, optimisation performance separates cleanly into two regimes. On final energy accuracy, Momentum and Adam using a finite-difference gradient with step size 0.4 outperform the other optimisers across the 372 instances, with the advantage clearest at 10,000 shots and half filling. On efficiency, SPSA, CMAES, and BayesMGD need the fewest cost-function calls to reach a given tolerance, and CMAES offers the best balance between call count and final energy. The paper further claims that finite-difference gradients give more precise final energies but many more calls than simultaneous-perturbation gradients, and that the quantum natural gradient's per-iteration advantage over vanilla gradient descent is generally erased when counting the extra calls needed to estimate the Fisher information.

Load-bearing premise

The finite-difference step size 0.4, averaged from the best step sizes found on only four sweeping instances, is assumed to work well across all 372 instances; if the optimal step size varies by instance, the ranking of gradient-based optimisers could change.

Editorial extensions

If this is right

  • A practitioner prioritising final ground-state energy should pick Momentum or Adam with a finite-difference gradient at a carefully chosen step size rather than a black-box optimiser.
  • A practitioner with a strict budget on circuit evaluations should pick SPSA, CMAES, or BayesMGD, with CMAES as the best compromise between call count and final energy.
  • Using simultaneous perturbation as a gradient subroutine cuts the number of calls but leaves the run further from the ground state than finite differences; switching from simultaneous perturbation to finite differences partway through a run is a plausible way to combine both advantages.
  • The step size for finite-difference gradients must be treated as a serious hyperparameter: an arbitrary small value such as 0.01 can make all gradient-based optimisers perform poorly.
  • For 1D Fermi-Hubbard systems, the quantum natural gradient and imaginary time evolution can improve per-iteration convergence, but their overhead in cost-function calls means they do not beat vanilla gradient descent when total calls are counted.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Beyond the paper's stated scope, the same two-regime pattern likely appears for other lattice Hamiltonians such as the transverse-field Ising model, because the Hamiltonian variational ansatz keeps parameter counts low and the noise structure is similar; this is a testable transfer, not a paper claim.
  • The step-size averaging over four instances suggests a cheaper protocol: run a small hyperparameter sweep on one or two representative instances before a hardware campaign, then fix the step size for the rest; the paper does not propose this as a protocol.
  • A testable extension is an adaptive schedule that begins with simultaneous-perturbation gradients to descend quickly and switches to finite differences near the end; the paper mentions this as a future idea, and the data here suggest it should beat either subroutine used alone.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 4 minor

Summary. The paper reports a large numerical benchmark of 30 optimisers applied to 372 instances of VQE for the Fermi-Hubbard model using the Hamiltonian variational ansatz. The authors record both exact and shot-noise cost functions, rank optimisers by final energy and by number of cost-function calls to reach fixed tolerances, analyse finite-difference versus simultaneous-perturbation gradients, and study the quantum natural gradient and imaginary-time evolution for 1D systems. The main claims are that Momentum and Adam with finite-difference gradients give the best final accuracy, that SPSA, CMAES, and BayesMGD are best in the low-call regime, and that the finite-difference step size has a strong effect on performance. Hyperparameters are selected by sweeping on four instances, and the full dataset is made available on Zenodo.

Significance. If the reported ranking is robust, the paper would be a useful reference for VQE practitioners, bringing together a wider set of optimisers, instances, and per-call data than most prior comparisons. The careful recording of every cost-function call, the use of exact ground states as baselines, the open data, and the detailed per-optimiser hyperparameter notes are genuine strengths that make the study reproducible in principle. However, the headline ranking is currently vulnerable to a protocol issue: tuned optimisers are evaluated as the best of up to five independent noisy runs, while zero-hyperparameter scipy optimisers are evaluated once. Because the cost function is stochastic, this unequal number of attempts can inflate the apparent gap between the top optimisers and the scipy baselines. The central conclusions are defensible but need additional analysis to control for this effect.

major comments (3)
  1. [Section 2.5 and Fig. 6 caption] The headline ranking compares best-of-multiple-runs for tuned optimisers against a single run for the zero-hyperparameter scipy optimisers. Section 2.5 states that each tuned optimiser is run with at most five sets of hyperparameters (the default plus the best found on each of the four sweeping instances), and the caption of Fig. 6 says that for each optimiser the reported value is 'the best final energy (over different runs, e.g. for multiple hyperparameter settings)'. Since the cost function is stochastic with 1,000 or 10,000 shots, the minimum of five noisy runs is a biased optimistic estimator, whereas COBYLA, Powell, BFGS, L-BFGS-B, TNC, SLSQP, CG, and Newton-CG contribute only a single run per instance. The gaps in Figs. 6, 7, and 9 between the top tuned optimisers and the scipy optimisers could therefore be inflated by the evaluation protocol rather than reflecting genuine optimizer quality. I recommend adding a control that uses only the default hyperparameter set for every optimiser, and/or giving every optimiser the same number of independent restarts, and reporting both the best-of and the median performance.
  2. [Section 2.4 and Section 2.5] The global finite-difference step size of 0.4 is the average of the best step sizes found on only four instances (0.417, 0.251, 0.324, and 0.550), and the per-optimiser hyperparameters are selected on those same four instances. These sweeping instances are all small (at most 3 × 2 grids and five layers) and do not include the 14-18 qubit or 8-10 layer cases in Benchmarks 3 and 4. Since Fig. 18 shows that optimiser performance varies systematically with U, filling, and number of layers, the representativeness of the four sweeping instances is an unverified assumption that is load-bearing for the claim that '0.4 seemed to be a good choice'. I ask the authors to quantify the sensitivity of the rankings to this choice, for example by re-running the gradient-based optimisers with step sizes near the ends of the observed range (e.g. 0.25 and 0.55) and reporting whether the leading optimisers remain the same.
  3. [Section 3.2.2 and Fig. 9] For the number-of-calls metric it is not stated whether the reported 'calls to reach tolerance' is taken from the best run over the multiple hyperparameter sets or from each run individually. If Fig. 9 uses the best run for each tuned optimiser and the single run for scipy optimisers, the same best-of-multiple-runs bias applies to the low-call ranking as to the final-energy ranking. The authors should state explicitly how the call counts are aggregated and should report both the best-run and the median-run call counts, so that readers can separate genuine optimizer quality from the number of attempts allowed.
minor comments (4)
  1. [Table 1] In the row for '3 × 2', the expression '2m⌈ n−1 2 ⌋' mixes a ceiling bracket with a floor symbol; it should read '2m⌈(n−1)/2⌉'.
  2. [Section 3.2, first paragraph] The phrase 'some plots of individual runs are shown n Fig. 5' should read 'shown in Fig. 5'.
  3. [Table 15 caption] The caption says 'Coordinate descent hyperparameters', but the table lists Nelder-Mead hyperparameters; the caption should be corrected.
  4. [Appendix C.4] The word 'Bernouilli' in the SPSA pseudocode description should be spelled 'Bernoulli'.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the paper reports directly measured benchmark outcomes, with self-citations only supplying the ansatz and algorithm choices, not the ranking.

full rationale

This is an empirical benchmarking study rather than a derivation, and I find no circular step that makes any reported result equivalent to its inputs by construction. The central claims, such as "Momentum or Adam with finite differences are good optimiser choices when considering overall final accuracy" (Section 4), are summaries of measured final energies over 372 instances, with data hosted on Zenodo. The hyperparameter and gradient sweeping described in Section 2.5 is genuine fitting: the finite-difference step size 0.4 is selected by averaging optimal step sizes on four sweeping instances, and the optimiser rankings are then obtained by running all optimisers on the full instance set. This is parameter selection, not a fitted quantity being renamed as a prediction. Self-citations to the authors' prior work appear, e.g. taking the Hamiltonian variational ansatz and initial parameters "as in [6]" and using BayesMGD from [3], but these citations supply the problem setting and candidate algorithms, not the performance ranking; the rankings are produced by the numerical runs themselves. The paper also openly acknowledges the arbitrariness in hyperparameter choice, stating "There is also much arbitrariness in what one considers a hyperparameter, and one could always promote more variables to hyperparameters and perform more in depth sweeping." The skeptical concern that tuned optimisers receive up to five hyperparameter runs while scipy optimisers receive one is a legitimate evaluation-fairness caveat, and the paper discloses this by taking "the best final energy (over different runs, e.g. for multiple hyperparameter settings)" in Fig. 6; however, this is a possible bias in the benchmark protocol, not a circular dependency in which a claimed prediction reduces to its own input. No equation in the paper defines a target quantity in terms of the fitted hyperparameters, no uniqueness theorem is imported from the authors, and no known result is merely renamed. The derivation chain is therefore self-contained with respect to circularity.

Assumptions & free parameters 3 free parameters · 3 assumptions · 0 invented entities

The central claim is an empirical ranking, so the main burden is on the choice of hyperparameters (especially the finite-difference step size) and the transfer of hyperparameters from 4 to 372 instances. No new physical entities are introduced.

free parameters (3)
  • Finite-difference step size = 0.4
    Chosen as the average of the best finite-difference step sizes found on four sweeping instances (Section 2.4). Used for all gradient-based optimizers in the main study.
  • Simultaneous perturbation step size = 0.15
    Set following [6] rather than swept; used for simultaneous perturbation gradients.
  • Per-optimizer hyperparameter sets = varies
    Best hyperparameters selected via Optuna on 4 instances; up to 5 sets per optimizer run on all instances.
assumptions (3)
  • domain assumption HV ansatz is expressive enough to approximate the ground states of the tested instances
    Tested empirically in Sec. 3.1 on exact cost functions, but not proven for all instances.
  • domain assumption Shot-noise-only cost function (without physical gate noise) is a valid proxy for near-term hardware
    Stated explicitly in Sec. 2.3: 'In this work we do not consider models incorporating physical noise in the circuit.'
  • ad hoc to paper The four instances chosen for hyperparameter sweeping are representative of all 372 instances
    The paper selects 4 instances with a note on spread, and transfers hyperparameters to all instances (Sec. 2.5).

how reviews work

0 comments
Cite this review

Pith. "Pith review of Benchmarking a wide range of optimisers for solving the Fermi-Hubbard model using the variational quantum eigensolver." pith.science (2026). https://pith.science/paper/JOMEX4FO

@misc{pith2026241113742,
  author       = {Pith},
  title        = {Pith review of: Benchmarking a wide range of optimisers for solving the Fermi-Hubbard model using the variational quantum eigensolver},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/JOMEX4FO}},
  note         = {Machine review of arXiv:2411.13742}
}
read the original abstract

We numerically benchmark 30 optimisers on 372 instances of the variational quantum eigensolver for solving the Fermi-Hubbard system with the Hamiltonian variational ansatz. We rank the optimisers with respect to metrics such as final energy achieved and function calls needed to get within a certain tolerance level, and find that the best performing optimisers are variants of gradient descent such as Momentum and ADAM (using finite difference), SPSA, CMAES, and BayesMGD. We also perform gradient analysis and observe that the step size for finite difference has a very significant impact. We also consider using simultaneous perturbation (inspired by SPSA) as a gradient subroutine: here finite difference can lead to a more precise estimate of the ground state but uses more calls, whereas simultaneous perturbation can converge quicker but may be less precise in the later stages. Finally, we also study the quantum natural gradient algorithm: we implement this method for 1-dimensional Fermi-Hubbard systems, and find that whilst it can reach a lower energy with fewer iterations, this improvement is typically lost when taking total function calls into account. Our method involves performing careful hyperparameter sweeping on 4 instances. We present a variety of analysis and figures, detailed optimiser notes, and discuss future directions.

Figures

Figures reproduced from arXiv: 2411.13742 by the authors.

Figure 1
Figure 1. Boxplots of optimisers tested over all 372 VQE for Fermi-Hubbard instances, ordered in terms [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 9
Figure 9. • The simultaneous perturbation gradient subroutine can be beneficial when seeking to minimise number of calls, whereas using finite difference is more effective for final accuracy. • We discuss the importance of hyperparameter selection, including choosing an appropriate step size for gradient subroutines (we found that for our purposes 0.4 seemed to be a good choice for finite differences). • Any improvements offe… view at source ↗
Figure 2
Figure 2. Plot of finite difference step size with absolute error (norm of difference) with the exact [PITH_FULL_IMAGE:figures/full_fig_p008_2.png] view at source ↗
Figures from the paper (28 more)
Figure 3
Figure 3. Figure 3: Gradient sweeping: boxplots of best step size found for 100 random points on four instances [PITH_FULL_IMAGE:figures/full_fig_p009_3.png]
Figure 4
Figure 4. Figure 4: We ran BFGS, L-BFGS-B, Nelder-Mead, Powell and SLSQP (from [PITH_FULL_IMAGE:figures/full_fig_p012_4.png]
Figure 5
Figure 5. Figure 5: Plots of individual runs, displaying the exact energy throughout a run (although the [PITH_FULL_IMAGE:figures/full_fig_p012_5.png]
Figure 6
Figure 6. Figure 6: This plot summarises data collected over all optimisers and all instances (372 in total). For [PITH_FULL_IMAGE:figures/full_fig_p013_6.png]
Figure 7
Figure 7. Figure 7: This plot is as in Fig. 6, but only displaying the best optimisers, removing the 2 [PITH_FULL_IMAGE:figures/full_fig_p013_7.png]
Figure 8
Figure 8. Figure 8: These barplots display the number of times each optimiser outperformed all the others, for [PITH_FULL_IMAGE:figures/full_fig_p014_8.png]
Figure 9
Figure 9. Figure 9: Comparison of number of calls required to reach a certain error with the ground state energy. [PITH_FULL_IMAGE:figures/full_fig_p015_9.png]
Figure 10
Figure 10. Figure 10: For each instance, we consider on average how many calls it took each optimiser to get [PITH_FULL_IMAGE:figures/full_fig_p016_10.png]
Figure 11
Figure 11. Figure 11: Comparison of gradient-based optimisers, and of finite difference (FD) and simultaneous [PITH_FULL_IMAGE:figures/full_fig_p016_11.png]
Figure 12
Figure 12. Figure 12: Comparison of vanilla gradient descent (GD), natural gradient descent (NAT) and [PITH_FULL_IMAGE:figures/full_fig_p017_12.png]
Figure 13
Figure 13. Figure 13: Comparison of vanilla gradient descent (GD), natural gradient descent (NAT) and [PITH_FULL_IMAGE:figures/full_fig_p018_13.png]
Figure 14
Figure 14. Figure 14: Comparison of vanilla gradient descent (GD), natural gradient descent (NAT) and [PITH_FULL_IMAGE:figures/full_fig_p019_14.png]
Figure 15
Figure 15. Figure 15: This plot summarises data collected over all optimisers and all instances (372 in total). For [PITH_FULL_IMAGE:figures/full_fig_p024_15.png]
Figure 16
Figure 16. Figure 16: Comparison of the final energy difference achieved by optimisers and the best optimiser [PITH_FULL_IMAGE:figures/full_fig_p025_16.png]
Figure 17
Figure 17. Figure 17: Here we display a heatmap for some of the better performing optimisers. We see strong [PITH_FULL_IMAGE:figures/full_fig_p025_17.png]
Figure 18
Figure 18. Figure 18: Here we average each optimisers normalised (i.e. divided by the grid size [PITH_FULL_IMAGE:figures/full_fig_p026_18.png]
Figure 19
Figure 19. Figure 19: Hill climber hyperparameters. C.2 Coordinate Descent - Overview: The algorithm proceeds by minimising each parameter in turn, and is discussed in detail in [6]. For each parameter (i.e. keeping all others fixed), a trigonometric interpolating polynomial is constructed…
Figure 20
Figure 20. Figure 20: Coordinate descent hyperparameters. C.3 BayesMGD - Overview: Bayes Model Gradient Descent (BayesMGD) was introduced in [3] as an extension to Model Gradient Descent [18]. - Implementation: in house. - Evaluations per iteration: η 2 (ν + 1)(ν + 2) - Black box: Yes, but…
Figure 21
Figure 21. Figure 21: BayesMGD hyperparameters. C.4 SPSA - Overview: The simultaneous perturbation stochastic approximation (SPSA) algorithm follows a standard gradient descent structure, but uses a noisy approximation to the gradient using only two evaluations. In particular, for each par…
Figure 22
Figure 22. Figure 22: SPSA hyperparameters. C.5 Gradient Descent - Overview: Basic (or vanilla) gradient descent simply takes a step in the direction of negative gradient (i.e. downhill) at each iteration. A priori, the algorithm assumes access to some gradient function ∇ f , and takes as …
Figure 23
Figure 23. Figure 23: Gradient descent hyperparameters. C.6 Momentum - Overview: One can extend vanilla gradient descent by including a velocity type term. vt+1 = γvt + η∇ f(θt) (50) θt+1 = θt − vt (51) A variant of this is known as nesterov, in which we instead evaluate the gradient at th…
Figure 24
Figure 24. Figure 24: Momentum hyperparameters. C.7 AdaDelta - Overview: AdaDelta [52] is an extension to Momentum (more specifically, to another method known as AdaGrad [53]). Some of the motivations for this optimiser include removing the need to manually set a learning rate, using previ…
Figure 25
Figure 25. Figure 25: AdaDelta hyperparameters. C.8 Adam - Overview: Adaptive Moment Estimation (Adam) [54] has become a popular method in machine learning, storing exponentially decaying averages of the first and second moments of the gradient, and then uses a similar update step to that …
Figure 26
Figure 26. Figure 26: Adam hyperparameters. C.9 λ + µ - Overview: In a basic evolutionary strategy, at each iteration (generation), µ ‘parents’ are selected to produce λ ‘offspring’. Two functions must be specified: how to combine two solutions to produce a child solution (crossover, matin…
Figure 27
Figure 27. Figure 27: λ + µ hyperparameters. C.10 Particle Swarm Optimisation - Overview: Particle Swarm Optimisation (PSO) is an evolutionary algorithm consisting of a set of candidate solutions (particles) exploring the search space. At each iteration, the location and velocity of each p…
Figure 28
Figure 28. Figure 28: PSO hyperparameters. C.11 CMAES - Overview: The Covariance Matrix Adaption Evolution Strategy (CMAES) is a black-box nu￾merical optimiser. At each generation, new candidate solutions are sampled from a multivari￾ate normal distribution subject to a covariance matrix (…
Figure 29
Figure 29. Figure 29: CMAES hyperparameters. C.12 Nelder-Mead - Implementation: scipy [34]. - Evaluations per iteration: ν + 1 (in the worst case). - Black box: Yes. - gradient-based: No. - References: [34, 43, 44]. - Pseudocode: [10]. - Hyperparameters: 41 [PITH_FULL_IMAGE:figures/full_f…
Figure 30
Figure 30. Figure 30: Nelder-Mead hyperparameters. C.13 Other optimisers COBYLA - Implementation: scipy [34]. - Black box: Yes. - gradient-based: No. - References: [45]. BFGS - Implementation: scipy [34]. - Black box: Yes. - gradient-based: Yes. - References: [8, 34]. L-BFGS-B - Implementa…

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

55 extracted references · 19 canonical work pages

  1. [1]

    Noisy intermediate-scale quantum algorithms

    Kishor Bharti et al. “Noisy intermediate-scale quantum algorithms”. In: Reviews of Modern Physics 94.1 (2022), p. 015004. DOI: 10.1103/RevModPhys.94.015004

  2. [2]

    Variational quantum algorithms

    Marco Cerezo et al. “Variational quantum algorithms”. In: Nature Reviews Physics3.9 (2021), pp. 625–

  3. [3]

    Observing ground-state properties of the Fermi-Hubbard model using a scalable algorithm on a quantum computer

    Stasja Stanisic et al. “Observing ground-state properties of the Fermi-Hubbard model using a scalable algorithm on a quantum computer”. In: Nature Communications 13.1 (2022), p. 5743. DOI: 10.1038/s41467-022-33335-4

  4. [4]

    Quantum Threat Timeline Report 2022

    Michelle Mosca and Marco Piani. Quantum Threat Timeline Report 2022 . Tech. rep. Available at: https://globalriskinstitute.org/publication/2022-quantum-threat-timeline-report/ . EvolutionQ Inc, Global Risk Institute, 2022

  5. [5]

    Progress towards practical quantum variational algorithms

    Dave Wecker, Matthew B Hastings, and Matthias Troyer. “Progress towards practical quantum variational algorithms”. In: Physical Review A 92.4 (2015), p. 042303. DOI: 10.1103/PhysRevA.92. 042303

  6. [6]

    Strategies for solving the Fermi-Hubbard model on near-term quantum com- puters

    Chris Cade et al. “Strategies for solving the Fermi-Hubbard model on near-term quantum com- puters”. In: Physical Review B 102.23 (2020), p. 235122. DOI: 10.1103/PhysRevB.102.235122

  7. [7]

    Efficient quantum measurement of Pauli operators in the presence of finite sampling error

    Ophelia Crawford et al. “Efficient quantum measurement of Pauli operators in the presence of finite sampling error”. In: Quantum 5 (2021), p. 385. DOI: 10.22331/q-2021-01-20-385

  8. [8]

    Algorithms for optimization

    Mykel J Kochenderfer and Tim A Wheeler. Algorithms for optimization. MIT Press, 2019. 21

Show all 55 references
  1. [9]

    Essentials of Metaheuristics

    Sean Luke. Essentials of Metaheuristics. second. Available for free at http://cs.gmu.edu/$\sim$sean/book/metaheuristics/. Lulu, 2013

  2. [10]

    Numerical optimization

    Jorge Nocedal and Stephen J Wright. Numerical optimization. Springer, 1999. DOI: 10.1007/978- 0-387-40065-5

  3. [11]

    An overview of gradient descent optimization algorithms

    Sebastian Ruder. “An overview of gradient descent optimization algorithms”. In: arXiv preprint arXiv:1609.04747 (2016). DOI: 10.48550/arXiv.1609.04747

  4. [12]

    Sequential minimal optimization for quantum- classical hybrid algorithms

    Ken M Nakanishi, Keisuke Fujii, and Synge Todo. “Sequential minimal optimization for quantum- classical hybrid algorithms”. In: Physical Review Research 2.4 (2020), p. 043158. DOI: 10 . 1103 / PhysRevResearch.2.043158

  5. [13]

    A Jacobi diagonalization and Anderson acceleration algorithm for vari- ational quantum algorithm parameter optimization

    Robert M Parrish et al. “A Jacobi diagonalization and Anderson acceleration algorithm for vari- ational quantum algorithm parameter optimization”. In: arXiv preprint arXiv:1904.03206 (2019). DOI: 10.48550/arXiv.1904.03206

  6. [14]

    Convergence of a block coordinate descent method for nondifferentiable minimiza- tion

    Paul Tseng. “Convergence of a block coordinate descent method for nondifferentiable minimiza- tion”. In: Journal of optimization theory and applications 109 (2001), pp. 475–494. DOI: 10.1023/A: 1017501703105

  7. [15]

    Structure optimization for pa- rameterized quantum circuits

    Mateusz Ostaszewski, Edward Grant, and Marcello Benedetti. “Structure optimization for pa- rameterized quantum circuits”. In: Quantum 5 (2021), p. 391. DOI: 10.22331/q-2021-01-28-391

  8. [16]

    Quantum analytic descent

    Bálint Koczor and Simon C Benjamin. “Quantum analytic descent”. In: Physical Review Research 4.2 (2022), p. 023017. DOI: 10.1103/PhysRevResearch.4.023017

  9. [17]

    Quantum natural gradient

    James Stokes et al. “Quantum natural gradient”. In: Quantum 4 (2020), p. 269. DOI: 10.22331/q- 2020-05-25-269

  10. [18]

    Using models to improve optimizers for variational quantum algorithms

    Kevin J Sung et al. “Using models to improve optimizers for variational quantum algorithms”. In: Quantum Science and Technology 5.4 (2020), p. 044008. DOI: 10.1088/2058-9565/abb6d9

  11. [19]

    Benchmarking a wide range of optimisers for solving the Fermi-Hubbard model using the variational quantum eigensolver

    Benjamin D.M. Jones, Lana Mineh, and Ashley Montanaro. Dataset for “Benchmarking a wide range of optimisers for solving the Fermi-Hubbard model using the variational quantum eigensolver” . Hosted at Zenodo, URL: https://doi.org/10.5281/zenodo.13960673. 2024

  12. [20]

    The variational quantum eigensolver: a review of methods and best practices

    Jules Tilly et al. “The variational quantum eigensolver: a review of methods and best practices”. In: Physics Reports 986 (2022), pp. 1–128. DOI: 10.1016/j.physrep.2022.08.003

  13. [21]

    VQE method: a short survey and recent developments

    Dmitry A Fedorov et al. “VQE method: a short survey and recent developments”. In: Materials Theory 6.1 (2022), pp. 1–21. DOI: 10.1186/s41313-021-00032-6

  14. [22]

    Variational ansatz-based quantum simulation of imaginary time evolution

    Sam McArdle et al. “Variational ansatz-based quantum simulation of imaginary time evolution”. In: npj Quantum Information 5.1 (2019), p. 75. DOI: 10.1038/s41534-019-0187-2

  15. [23]

    Classical optimizers for noisy intermediate-scale quantum devices

    Wim Lavrijsen et al. “Classical optimizers for noisy intermediate-scale quantum devices”. In: 2020 IEEE international conference on quantum computing and engineering (QCE). IEEE. 2020, pp. 267–277. DOI: 10.1109/QCE49297.2020.00041

  16. [24]

    https://scikit-quant.readthedocs.io/en/latest/

    Scikit-Quant. https://scikit-quant.readthedocs.io/en/latest/

  17. [25]

    Performance comparison of optimization methods on variational quantum algorithms

    Xavier Bonet-Monroig et al. “Performance comparison of optimization methods on variational quantum algorithms”. In: Physical Review A 107.3 (2023), p. 032407. DOI: 10.1103/PhysRevA.107. 032407

  18. [26]

    Optimizing quantum heuristics with meta-learning

    Max Wilson et al. “Optimizing quantum heuristics with meta-learning”. In: Quantum Machine Intelligence 3 (2021), pp. 1–14. DOI: 10.1007/s42484-020-00022-w

  19. [27]

    Robust and efficient algorithms for high-dimensional black-box quantum optimization

    Zhaoqi Leng et al. “Robust and efficient algorithms for high-dimensional black-box quantum optimization”. In: arXiv preprint arXiv:1910.03591 (2019). DOI: 10.48550/arXiv.1910.03591

  20. [28]

    Performance of hybrid quantum-classical variational heuristics for combi- natorial optimization

    Giacomo Nannicini. “Performance of hybrid quantum-classical variational heuristics for combi- natorial optimization”. In: Physical Review E 99.1 (2019), p. 013304. DOI: 10.1103/PhysRevE.99. 013304

  21. [29]

    Practical optimization for hybrid quantum- classical algorithms

    Gian Giacomo Guerreschi and Mikhail Smelyanskiy. “Practical optimization for hybrid quantum- classical algorithms”. In: arXiv preprint arXiv:1701.01450 (2017). DOI: 10 . 48550 / arXiv . 1701 . 01450

  22. [30]

    Strategies for quantum computing molecular energies using the unitary coupled cluster ansatz

    Jonathan Romero et al. “Strategies for quantum computing molecular energies using the unitary coupled cluster ansatz”. In: Quantum Science and Technology 4.1 (2018), p. 014008. DOI: 10.1088/ 2058-9565/aad3e4. 22

  23. [31]

    Avoiding local minima in varia- tional quantum eigensolvers with the natural gradient optimizer

    David Wierichs, Christian Gogolin, and Michael Kastoryano. “Avoiding local minima in varia- tional quantum eigensolvers with the natural gradient optimizer”. In:Physical Review Research 2.4 (2020), p. 043246. DOI: 10.1103/PhysRevResearch.2.043246

  24. [32]

    Learning to learn with quantum neural networks via classical neural networks

    Guillaume Verdon et al. “Learning to learn with quantum neural networks via classical neural networks”. In: arXiv preprint arXiv:1907.05415 (2019). DOI: 10.48550/arXiv.1907.05415

  25. [33]

    Classical Benchmarks for Variational Quantum Eigensolver Simula- tions of the Hubbard Model

    Antonios M Alvertis et al. “Classical Benchmarks for Variational Quantum Eigensolver Simula- tions of the Hubbard Model”. In: arXiv preprint arXiv:2408.00836 (2024)

  26. [34]

    SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python

    Pauli Virtanen et al. “SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python”. In: Nature Methods 17 (2020), pp. 261–272. DOI: 10.1038/s41592-019-0686-2

  27. [35]

    General parameter-shift rules for quantum gradients

    David Wierichs et al. “General parameter-shift rules for quantum gradients”. In: Quantum 6 (2022), p. 677. DOI: 10.22331/q-2022-03-30-677

  28. [36]

    Estimating the gradient and higher- order derivatives on quantum hardware

    Andrea Mari, Thomas R Bromley, and Nathan Killoran. “Estimating the gradient and higher- order derivatives on quantum hardware”. In: Physical Review A 103.1 (2021), p. 012405. DOI: 10. 1103/PhysRevA.103.012405

  29. [37]

    Optuna: A Next-generation Hyperparameter Optimization Framework

    Takuya Akiba et al. “Optuna: A Next-generation Hyperparameter Optimization Framework”. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2019. DOI: 10.1145/3292500.3330701

  30. [38]

    An overview of the simultaneous perturbation method for efficient optimization

    James C Spall. “An overview of the simultaneous perturbation method for efficient optimization”. In: Johns Hopkins apl technical digest 19.4 (1998), pp. 482–492

  31. [39]

    Implementation of the simultaneous perturbation algorithm for stochastic optimiza- tion

    J.C. Spall. “Implementation of the simultaneous perturbation algorithm for stochastic optimiza- tion”. In: IEEE Transactions on Aerospace and Electronic Systems 34.3 (1998), pp. 817–823. DOI: 10. 1109/7.705889

  32. [40]

    DEAP: Evolutionary Algorithms Made Easy

    Félix-Antoine Fortin et al. “DEAP: Evolutionary Algorithms Made Easy”. In: Journal of Machine Learning Research 13 (2012), pp. 2171–2175

  33. [41]

    Completely derandomized self-adaptation in evolu- tion strategies

    Nikolaus Hansen and Andreas Ostermeier. “Completely derandomized self-adaptation in evolu- tion strategies”. In:Evolutionary computation 9.2 (2001), pp. 159–195.DOI: 10.1162/106365601750190398

  34. [42]

    The CMA evolution strategy: A tutorial

    Nikolaus Hansen. “The CMA evolution strategy: A tutorial”. In: arXiv preprint arXiv:1604.00772 (2016). DOI: 10.48550/arXiv.1604.00772

  35. [43]

    Implementing the Nelder-Mead simplex algorithm with adaptive parameters

    Fuchang Gao and Lixing Han. “Implementing the Nelder-Mead simplex algorithm with adaptive parameters”. In: Computational Optimization and Applications 51.1 (2012), pp. 259–277. DOI: 10 . 1007/s10589-010-9329-3

  36. [44]

    A simplex method for function minimization

    John A Nelder and Roger Mead. “A simplex method for function minimization”. In: The computer journal 7.4 (1965), pp. 308–313. DOI: 10.1093/comjnl/7.4.308

  37. [45]

    A direct search optimization method that models the objective and constraint func- tions by linear interpolation

    Michael JD Powell. A direct search optimization method that models the objective and constraint func- tions by linear interpolation. Springer, 1994. DOI: 10.1007/978-94-015-8330-5_4

  38. [46]

    A view of algorithms for optimization without derivatives

    Michael JD Powell. “A view of algorithms for optimization without derivatives”. In: Mathematics Today-Bulletin of the Institute of Mathematics and its Applications 43.5 (2007), pp. 170–174

  39. [47]

    On the natural gradient for variational quantum eigensolver

    Naoki Yamamoto. “On the natural gradient for variational quantum eigensolver”. In: arXiv preprint arXiv:1909.05074 (2019). DOI: 10.48550/arXiv.1909.05074

  40. [48]

    Natural gradient works efficiently in learning

    Shun-Ichi Amari. “Natural gradient works efficiently in learning”. In: Neural computation 10.2 (1998), pp. 251–276. DOI: 10.1162/089976698300017746

  41. [49]

    New insights and perspectives on the natural gradient method

    James Martens. “New insights and perspectives on the natural gradient method”. In: The Journal of Machine Learning Research 21.1 (2020), pp. 5776–5851. DOI: 10.48550/arXiv.1412.1193

  42. [50]

    Low-depth gradient measurements can improve conver- gence in variational hybrid quantum-classical algorithms

    Aram W Harrow and John C Napp. “Low-depth gradient measurements can improve conver- gence in variational hybrid quantum-classical algorithms”. In:Physical Review Letters126.14 (2021), p. 140502. DOI: 10.1103/PhysRevLett.126.140502

  43. [51]

    On the momentum term in gradient descent learning algorithms

    Ning Qian. “On the momentum term in gradient descent learning algorithms”. In: Neural networks 12.1 (1999), pp. 145–151. DOI: 10.1016/S0893-6080(98)00116-6

  44. [52]

    Adadelta: an adaptive learning rate method

    Matthew D Zeiler. “Adadelta: an adaptive learning rate method”. In: arXiv preprint arXiv:1212.5701 (2012). DOI: 10.48550/arXiv.1212.5701

  45. [53]

    Adaptive subgradient methods for online learning and stochastic optimization

    John Duchi, Elad Hazan, and Yoram Singer. “Adaptive subgradient methods for online learning and stochastic optimization”. In: Journal of machine learning research 12.7 (2011). 23

  46. [54]

    Adam: A method for stochastic optimization

    Diederik P Kingma and Jimmy Ba. “Adam: A method for stochastic optimization”. In: arXiv preprint arXiv:1412.6980 (2014). DOI: 10.48550/arXiv.1412.6980. A Additional figures In Fig. 15 we present boxplots as in Fig. 6, but overlaid with all data points. We also compare the fina...

  47. [644]

    DOI: 10.1038/s42254-021-00348-9

Pith tools

Reviewed August 12, 2026 · model on record in the stance chip above.