REVIEW 4 major objections 4 minor 24 references
Barzilai-Borwein Diagonal Quasi-Newton Method for Nonconvex Multiobjective Optimization Problems
T0 review · 4 major / 4 minor · reviewed 2026-08-04 · deepseek-v4-flash
Pith's one-line read A shared BB diagonal matrix can approximate all objective Hessians at once in multiobjective optimization, giving global convergence without convexity.
desk verdict Cheap and promising BB-diagonal quasi-Newton for multiobjective problems, but the global convergence proof assumes a uniform spectral bound the algorithm does not enforce. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the modified Barzilai-Borwein diagonal matrix, a single scalar α_k multiplied by the identity, chosen so that the resulting B_k approximates the Hessians of all objectives at once. The safeguard interval [ω_k, ω_k^{-1}] with ω_k = min{c0, c1||∇f(x_k)||^{c2}} keeps the parameter in a practical range, while the fallback step reuses previous information when the curvature quotient is negative. This one-scalar approximation does the work that traditionally required m separate full Hessian approximations, and its positivity is what the convergence theory leans on.
What would settle it
Record the generated α_k values when running Algorithm 1 on a nonconvex test problem. If on any run α_k drops below some fixed positive a while the iterate x_k is not yet Pareto-critical, then Assumption 3 would fail for that sequence, meaning the experiment would expose a running case outside the theorem's conditions.
Extended reading notes
Core claim
The central claim is that one modified Barzilai-Borwein diagonal matrix B_k = α_k I, updated from function and gradient information, suffices to compute effective quasi-Newton directions for all objectives simultaneously. The direction is d_k = -B_k^{-1} Σ_i λ_i ∇f_i(x_k), with weights from the dual subproblem. The paper proves, as Theorem 5, that under bounded level sets, Lipschitz gradients, and a uniform positive-definiteness assumption on the B_k, the sequence satisfies lim ||d_k^SD|| = 0 and every accumulation point is Pareto-critical. Theorem 6 adds R-linear convergence to a Pareto optimal point when each objective is strongly convex with Lipschitz gradients. The innovation is the safe
Load-bearing premise
The theory assumes the shared BB scalar stays uniformly bounded away from zero (aI ⪯ B_k ⪯ bI for all k), while the safeguard in Step 6 lets α_k shrink to zero as gradients vanish, and Step 15 uses s_{k-1} and γ_{k-1} without initializing them at k=0.
Editorial extensions
If this is right
- If BB-DQN works as claimed, large-scale multiobjective problems with thousands of variables become tractable for quasi-Newton methods at near-steepest-descent cost per iteration, since only one scalar needs to be stored and inverted.
- The global convergence result extends quasi-Newton methodology to nonconvex multiobjective settings, where maintaining separate curvature approximations was previously prohibitive.
- R-linear convergence under strong convexity means the method does not merely converge but does so at a predictable geometric rate, which matters for practical stopping criteria.
- Numerical experiments on the JOS1 and TOI4 families show iteration counts that stay nearly constant as dimension grows, and CPU time reductions of tens to more than fifty times on the largest instances compared with M-BFGSMO.
- The same algorithmic template could be applied to multiobjective minimax or bilevel problems where shared curvature models are desirable.
Reading between the lines
- The proof depends on the safeguard keeping α_k uniformly bounded below, but the safeguard itself shrinks to zero as gradients vanish; if in practice α_k drifts below any fixed positive threshold before reaching a Pareto-critical region, the theoretical guarantee would not cover the observed run.
- A natural extension, not explored in the paper, is to use a small number of scalar BB parameters (one per cluster of objectives) rather than a single scalar, which could capture more curvature variation while keeping the cost low.
- The algorithm's reliance on a single scalar means it cannot capture direction-dependent curvature, so on strongly anisotropic problems it may behave closer to a preconditioned gradient method than to a full quasi-Newton method; this is a testable hypothesis about where the method might underperform.
- The fallback step in Step 15 references s_{k-1} and γ_{k-1} without initialization at k=0; a robust implementation would need to handle the first iteration separately, and convergence proofs should include that case explicitly.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes BB-DQN, a quasi-Newton method for unconstrained nonconvex multiobjective optimization problems (MOPs). The key idea is to use a single shared modified Barzilai-Borwein diagonal matrix, effectively a scalar α_k I, to approximate the Hessians of all objective functions simultaneously, thereby avoiding the cost of maintaining separate approximations. The algorithm computes a descent direction via a dual subproblem, uses a multiobjective Wolfe line search, and adaptively selects α_k with a safeguard. The paper claims global convergence to Pareto critical points without convexity (Theorem 5) and R-linear convergence under strong convexity (Theorem 6), and reports numerical comparisons with M-BFGSMO showing superior performance on several test problems, especially large-scale ones.
Significance. If the theoretical claims are correct, the paper makes a useful practical contribution: a shared diagonal/scalar BB update substantially reduces per-iteration cost compared to methods that maintain separate Hessian approximations, and the numerical experiments indeed show striking speedups on large-scale problems such as JOS1e and TOI4f. The convergence framework is standard (Wolfe line search + sufficient decrease), and the paper provides explicit rates. However, the central convergence proof depends on a uniform spectral bound on B_k that the algorithm's safeguard does not guarantee, and the algorithm box is not fully specified (no explicit B_{k+1} update, undefined quantities at k=0). These issues are load-bearing but appear fixable within the manuscript's scope.
major comments (4)
- [Algorithm 1, Steps 2, 9-16] The algorithm never explicitly sets B_{k+1}=α_k I. Step 2 uses B(x) from (6)-(7), but B is never updated, so d_k is undefined for k≥1. The proof of Proposition 4 implicitly uses d_k = α_k^{-1} d_k^SD (see the identity -σ1 t_k D(x_k,d_k) = -σ1 t_k α_k^{-1} D(x_k,d_k^SD)), which requires B_k=α_k I. Please state this update explicitly and define the direction accordingly.
- [Assumption 3 and Proposition 4] Assumption 3 asserts uniform bounds aI ⪯ B_k ⪯ bI, but the algorithm does not enforce them. The safeguard permits α_k ∈ [ω_k, ω_k^{-1}] with ω_k = min{c0, c1||∇f(x_k)||^{c2}}, and c2>0 implies ω_k→0 as the gradient tends to 0, which is exactly what happens near a Pareto critical point. The choice 'α_k ∈ [ω_k, ω_k^{-1}]' does not guarantee any fixed a,b>0. Proposition 4's bound ω = σ1(1-σ2)a/(2bL) requires both a≤α_k and α_k≤b; without a uniform bound the decrease inequality (12) collapses, and Theorem 5's proof no longer follows. The paper's claim that B_k 'remains positive definite' only establishes α_k>0, not uniform boundedness. This is the main technical gap.
- [Algorithm 1, Step 15] The 'else' branch is undefined at k=0: it references s_{-1} and γ_{-1}, which are never initialized. Moreover, the displayed formula computes α_k from s_{k-1},γ_{k-1}, but the definitions of η_k,m_k,γ_k that follow appear to be for the current iteration and are not used in the assignment. This makes the algorithm not well-defined and not reproducible as written. Please repair the update rule and specify the initialization.
- [Theorem 6 and Remark 3] Remark 3 states that Assumption 4 implies Assumption 3, but this is not justified. Strong convexity bounds the objective Hessians ∇²f_i(x), not the algorithm-generated B_k (or α_k). Even under strong convexity, the safeguard permits α_k→0 or α_k→∞ as gradients vanish, so the uniform bound needed for Proposition 4 is not guaranteed. The R-linear convergence proof therefore inherits the same gap.
minor comments (4)
- [Section 4, Proposition 2] The proof is omitted with the note 'similar to [14, Proposition 2]'. For a standalone paper, please provide a proof or a precise statement of the referenced result, since the Wolfe conditions for vector-valued objectives are not entirely trivial.
- [Section 5] The numerical section contains missing values: the termination criterion is given as 'set as , where is...' and the Wolfe parameters as 'chosen as 0.and .'. These need to be filled in. Also, the captions of Figures 7, 10, and 11 repeatedly say 'BK problem' for problems that are not BK1.
- [Notation] The manuscript inconsistently uses [m] and ⟨m⟩ for the index set, and sometimes writes ∇F_i instead of ∇f_i. Please unify notation. Also, in Step 6 the quantity ||∇f(x_k)|| is not defined for vector-valued f; specify which norm or gradient aggregate is meant.
- [Title and labels] The paper title in the full text reads 'Modified Quasi-Newton Method for Nonconvex Multiobjective Optimization Problems with Barzilai-Borwein diagonal matrix', while the arXiv title is 'Barzilai-Borwein Diagonal Quasi-Newton Method...'. In the numerical figures, 'M-BBQNMO' is used in some captions and 'BB-DQN' in others; please standardize the name.
Circularity Check
No significant circularity; the convergence proof is conditional on stated assumptions, and the flagged issues are proof gaps, not circular reductions.
full rationale
After walking the derivation chain, I find no step where a claimed result is equivalent to its inputs by construction. Proposition 4 and Theorems 5-6 are conditional proofs: they assume Lipschitz gradients, bounded level sets, and the uniform bound aI⪯B(x)⪯bI, and derive the decrease bound and rates from those assumptions. The most suspicious ingredient is Assumption 3, because Algorithm 1's safeguard omega_k = min{c0, c1||∇f(x_k)||^{c2}} need not deliver uniform bounds and Step 15 is uninitialized at k=0; however, the paper never claims to derive Assumption 3 from the algorithm. It explicitly claims only that the approximation matrix remains positive definite, which is weaker than the assumed uniform bound. An unenforced or unwarranted assumption is a correctness/completeness gap, not circularity. Self-citations [15,16] are used as motivation and to describe prior methods, not as the load-bearing justification of the convergence theorems; those theorems are proved from standard Wolfe/Lipschitz inequalities. Proposition 2's proof is omitted ('the proof is similar to which in [14, Proposition 2], thus we omit it here') and Proposition 3 relies on a missing reference ('follows directly from the proof given in [27, proposition 2.2]'); I flag these as completeness defects, but they do not make the derivation circular. The numerical section compares against an external algorithm on standard test problems, so no fitted parameter is renamed as a prediction.
Assumptions & free parameters
free parameters (5)
- c0
- c1
- c2
- σ1, σ2
- B0 =
I
assumptions (6)
- domain assumption Assumption 1: level set L={x: f(x)≤f(x0)} is bounded and f is continuous
- domain assumption Assumption 2: each ∇f_i is Lipschitz continuous on an open set containing L
- ad hoc to paper Assumption 3: there exist a,b>0 with aI ⪯ B_k ⪯ bI for all k
- domain assumption Assumption 4: each f_i is strongly convex and smooth with common 0<U≤1≤L
- domain assumption Proposition 2: existence of t_k satisfying the modified Wolfe conditions (proof omitted, citing [14])
- standard math KKT/dual representation of the direction subproblem and Proposition 3, whose proof references [27]
Cite this review
Pith. "Pith review of Barzilai-Borwein Diagonal Quasi-Newton Method for Nonconvex Multiobjective Optimization Problems." pith.science (2026). https://pith.science/paper/5ZDQJKXI
@misc{pith2026251218348,
author = {Pith},
title = {Pith review of: Barzilai-Borwein Diagonal Quasi-Newton Method for Nonconvex Multiobjective Optimization Problems},
year = {2026},
howpublished = {\url{https://pith.science/paper/5ZDQJKXI}},
note = {Machine review of arXiv:2512.18348}
}
read the original abstract
This paper addresses the challenge of developing efficient algorithms for large-scale nonconvex multiobjective optimization problems (MOPs). While quasi-Newton methods are effective, their traditional application to MOPs is computationally expensive as they require maintaining and inverting separate Hessian approximations for each objective function. To overcome this limitation, we propose a novel Barzilai-Borwein diagonal-type Quasi-Newton method (BB-DQN). Our key innovation is the use of a single, shared, and modified BB-type matrix, updated iteratively using function and gradient information, to approximate the Hessians of all objectives simultaneously. We theoretically demonstrate that this approximation matrix remains positive definite throughout the iterative process. Furthermore, we establish the global convergence of the BB-DQN method without convexity assumptions and prove its R-linear convergence under mild conditions. Numerical experiments on a diverse set of test problems confirm that BB-DQN outperforms existing methods like M-BFGSMO, achieving superior performance in terms of computational time, iteration count, and reliability, especially for large-scale instances.
Reference graph
Works this paper leans on
-
[1]
Structural and multidisciplinary optimization 26(6), 369–395 (2004)
Marler, R.T., Arora, J.S.: Survey of multi-objective optimization me thods for engineering. Structural and multidisciplinary optimization 26(6), 369–395 (2004)
2004
-
[2]
Reviews in chemical engineering 16(1), 1–54 (2000)
Bhaskar, V., Gupta, S.K., Ray, A.K.: Applications of multiobjective o ptimization in chemical engineering. Reviews in chemical engineering 16(1), 1–54 (2000)
2000
-
[3]
In : Invited Keynote Paper, GL2-2, The Third China-Japan-Korea Joint Sympo sium on Opti- mization of Structural and Mechanical Systems, Kanazawa, Japa n, vol
De Weck, O.L.: Multiobjective optimization: History and promise. In : Invited Keynote Paper, GL2-2, The Third China-Japan-Korea Joint Sympo sium on Opti- mization of Structural and Mechanical Systems, Kanazawa, Japa n, vol. 2, p. 34 (2004)
2004
-
[4]
Annals of Operations Research 154(1), 29–50 (2007) 17
Chinchuluun, A., Pardalos, P.M.: A survey of recent developments in multiobjec- tive optimization. Annals of Operations Research 154(1), 29–50 (2007) 17
2007
-
[5]
In: 2021 IEEE 4th In ternational Conference on Big Data and Artificial Intelligence (BDAI), pp
Qu, Q., Ma, Z., Clausen, A., Jørgensen, B.N.: A comprehensive revie w of machine learning in multi-objective optimization. In: 2021 IEEE 4th In ternational Conference on Big Data and Artificial Intelligence (BDAI), pp. 7–14 (2021). IEEE
2021
-
[6]
Annals of Operations Research 339(3), 1119–1148 (2024)
Liu, S., Vicente, L.N.: The stochastic multi-gradient algorithm for m ulti-objective optimization and its application to supervised machine learning. Annals of Operations Research 339(3), 1119–1148 (2024)
2024
-
[7]
Mathematical methods of operations research 51(3), 479–494 (2000)
Fliege, J., Svaiter, B.F.: Steepest descent methods for multicrite ria optimization. Mathematical methods of operations research 51(3), 479–494 (2000)
2000
-
[8]
Numerical Algorithms, 1–27 (2025)
Chen, W., Tang, L., Yang, X.: Improvements to steepest descen t method for multi-objective optimization. Numerical Algorithms, 1–27 (2025)
2025
Show all 24 references
-
[9]
Numerical Algorithms 72(3), 539–604 (2016)
Morovati, V., Pourkarimi, L., Basirzadeh, H.: Barzilai and borwein’s method for multiobjective optimization problems. Numerical Algorithms 72(3), 539–604 (2016)
2016
-
[10]
SIAM Journal on Optimization 28(3), 2690–2720 (2018)
Lucambio P´ erez, L., Prudente, L.: Nonlinear conjugate gradie nt methods for vector optimization. SIAM Journal on Optimization 28(3), 2690–2720 (2018)
2018
-
[11]
SIAM Journal on Optimization 20(2), 602–626 (2009)
Fliege, J., Drummond, L.G., Svaiter, B.F.: Newton’s method for mult iobjective optimization. SIAM Journal on Optimization 20(2), 602–626 (2009)
2009
-
[12]
Operations Research Letters 39(5), 397–399 (2011)
Qu, S., Goh, M., Chan, F.T.: Quasi-newton methods for solving mult iobjective optimization. Operations Research Letters 39(5), 397–399 (2011)
2011
-
[13]
Journal of Computational and Applied Mathematics 255, 765–777 (2014)
Povalej, ˇZ.: Quasi-newton’s method for multiobjective optimization. Journal of Computational and Applied Mathematics 255, 765–777 (2014)
2014
-
[14]
Optimization 64(11), 2289–2306 (2015)
Ansary, M.A., Panda, G.: A modified quasi-newton method for vec tor optimiza- tion problem. Optimization 64(11), 2289–2306 (2015)
2015
-
[15]
European Journal of Operational Rese arch 311(1), 196–209 (2023)
Chen, J., Tang, L., Yang, X.: A barzilai-borwein descent method f or multiobjec- tive optimization problems. European Journal of Operational Rese arch 311(1), 196–209 (2023)
2023
-
[16]
Journal of the Operations Research Society of China, 1 –24 (2025)
Yang, Y.-X., Deng, X., Tang, L.-P.: Global convergence of a modifi ed bfgs-type method based on function information for nonconvex multiobjectiv e optimization problems. Journal of the Operations Research Society of China, 1 –24 (2025)
2025
-
[17]
Journal of Global Optimization 41(4), 559–577 (2008)
Sch¨ utze, O., Laumanns, M., Coello Coello, C.A., Dellnitz, M., Talbi, E.- G.: Con- vergence of stochastic search algorithms to finite size pareto set approximations. Journal of Global Optimization 41(4), 559–577 (2008)
2008
-
[18]
In: International Confer ence on Parallel Problem Solving from Nature, pp
Preuss, M., Naujoks, B., Rudolph, G.: Pareto set and emoa beha vior for sim- ple multimodal multiobjective functions. In: International Confer ence on Parallel Problem Solving from Nature, pp. 513–522 (2006). Springer 18
2006
-
[19]
IEEE Transactions on E volutionary Computation 10(5), 477–506 (2006)
Huband, S., Hingston, P., Barone, L., While, L.: A review of multiobj ective test problems and a scalable test problem toolkit. IEEE Transactions on E volutionary Computation 10(5), 477–506 (2006)
2006
-
[20]
Structural and multidisciplinar y optimization 29(2), 149–158 (2005)
Kim, I.Y., De Weck, O.L.: Adaptive weighted-sum method for bi-obj ective opti- mization: Pareto front generation. Structural and multidisciplinar y optimization 29(2), 149–158 (2005)
2005
-
[21]
In: Proceed ings of the Genetic and Evolutionary Computation Conference, pp
Jin, Y., Olhofer, M., Sendhoff, B.: Dynamic weighted aggregation f or evolutionary multi-objective optimization: Why does it work and how. In: Proceed ings of the Genetic and Evolutionary Computation Conference, pp. 1042–104 9 (2001)
2001
-
[22]
arXiv preprint arXiv:2507.20183 (2025)
Yin, Y.: Multiobjective accelerated gradient-like flow with asympt otic vanishing normalized gradient. arXiv preprint arXiv:2507.20183 (2025)
2025
-
[23]
arXiv preprint arXiv:2502.02010 (2025)
Anh, N.D., Thang, T.N.: A steepest gradient method with nonmono tone adaptive step-sizes for the nonconvex minimax and multi-objective optimizat ion problems. arXiv preprint arXiv:2502.02010 (2025)
2025 arXiv
-
[24]
Ghosh, D., Kishor, N., Zhao, X.: A newton method for uncertain m ultiobjective optimization problems with finite uncertainty set. J. Nonlinear Var. A nal. 9(1), 81–110 (2025) 19
2025
Reviewed August 4, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.