A smoothing moving balls approximation method for a class of conic-constrained difference-of-convex optimization problems
Pith reviewed 2026-05-22 14:40 UTC · model grok-4.3
The pith
A smoothing approximation to the support function lets the moving balls method handle difference-of-convex problems over nonlinear conic constraints.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Under the assumption that the support function of a compact base of the polar cone admits a majorizing smoothing approximation, the adapted moving balls approximation method with evolving smooth approximations produces a sequence that reaches an (ε₁, ε₂, ε₁√ε₂)-Karush-Kuhn-Tucker point in a number of iterations whose dependence on ε₁ and ε₂ is established; in the convex case the sequence converges to a solution and attains a local convergence rate under a standard Hölderian growth condition.
What carries the argument
The moving balls approximation step applied after replacing the support function by a smooth majorizing approximation, which reduces every subproblem to a single inequality constraint solved by one-dimensional root finding.
If this is right
- Every subproblem involves only one inequality constraint and is solved by a one-dimensional root-finding procedure.
- The procedure reaches an (ε₁, ε₂, ε₁√ε₂)-KKT point in a number of iterations whose dependence on the accuracies is established explicitly.
- When the problem is convex the generated sequence converges to a solution.
- Under a standard Hölderian growth condition the sequence attains a local convergence rate in the convex case.
Where Pith is reading between the lines
- The same smoothing condition holds for the negative semidefinite cone, so the method applies directly to semidefinite-constrained DC problems without extra assumptions.
- The reduction to one-dimensional root finding may make the approach practical for large-scale problems where standard conic solvers become expensive.
- The iteration complexity result could serve as a benchmark for comparing other first-order methods on the same class of problems.
Load-bearing premise
The support function of a compact base of the polar cone admits a majorizing smoothing approximation that can be used to rewrite the conic constraint as a single inequality.
What would settle it
Apply the algorithm to a difference-of-convex problem over the negative orthant and observe whether the iterates fail to satisfy the (ε₁, ε₂, ε₁√ε₂)-KKT accuracy after the number of steps given by the stated complexity bound.
read the original abstract
In this paper, we consider the problem of minimizing a difference-of-convex objective over a nonlinear conic constraint, where the cone is closed, convex, pointed and has a nonempty interior. We assume that the support function of a compact base of the polar cone exhibits a majorizing smoothing approximation, a condition that is satisfied by widely studied cones such as ${\mathbb R}^m_-$ and ${\cal S}^m_-$. Leveraging this condition, we reformulate the conic constraint equivalently as a single constraint involving the aforementioned support function, and adapt the moving balls approximation (MBA) method for its solution. In essence, in each iteration of our algorithm, we approximate the support function by a smooth approximation function and apply one MBA step. The subproblems that arise in our algorithm always involve only one single inequality constraint, and can thus be solved efficiently via one-dimensional root-finding procedures. We design explicit rules to evolve the smooth approximation functions from iteration to iteration and establish the corresponding iteration complexity for obtaining an $(\epsilon_1, \epsilon_2, \epsilon_1 \sqrt{\epsilon_2})$-Karush-Kuhn-Tucker point. In addition, in the convex setting, we establish convergence of the sequence generated, and study its local convergence rate under a standard H\"olderian growth condition. Finally, we perform numerical experiments to illustrate the performance of our algorithm.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper considers minimizing a difference-of-convex objective subject to a nonlinear conic constraint (closed, convex, pointed cone with nonempty interior). Under the assumption that the support function of a compact base of the polar cone admits a majorizing smoothing approximation (satisfied for R^m_- and S^m_-), the conic constraint is equivalently reformulated as a single inequality involving this support function. The moving balls approximation (MBA) method is adapted by replacing the support function with a smooth majorizing approximation at each iteration; the resulting subproblems have a single inequality constraint and are solved by one-dimensional root-finding. Explicit rules are given for evolving the smoothing functions across iterations. The authors establish iteration complexity to reach an (ε1, ε2, ε1√ε2)-KKT point, prove convergence of the generated sequence in the convex case, and derive a local convergence rate under a standard Hölderian growth condition. Numerical experiments illustrate performance.
Significance. If the stated complexity and convergence results hold, the work supplies a practical and theoretically grounded algorithm for a nontrivial class of nonconvex conic DC problems. The reduction of each subproblem to a single one-dimensional root-finding task, the explicit smoothing-update rules, and the explicit iteration complexity bound are concrete strengths. The assumption on the support function is standard for the cited cones and enables the single-constraint reformulation without introducing additional variables. The convex-case local-rate analysis under Hölderian growth further strengthens the contribution.
major comments (1)
- [§4] §4 (Complexity Analysis), Theorem 4.3: the iteration complexity bound for an (ε1, ε2, ε1√ε2)-KKT point is derived from the majorizing smoothing property and the chosen evolution rules for the smoothing parameter; the proof sketch in the text does not explicitly bound the accumulation of smoothing errors across iterations, which is load-bearing for the claimed complexity.
minor comments (3)
- [§2] The definition of the (ε1, ε2, ε1√ε2)-KKT point is introduced in §2 but the precise stationarity measure (involving the smoothed support function) is only clarified later; a single consolidated definition in §2 would improve readability.
- [Numerical Experiments] Figure 1 (numerical results): the y-axis scaling for the residual plots is not labeled consistently across subfigures; adding explicit axis labels and a legend for the different smoothing schedules would aid interpretation.
- [§5] The Hölderian growth condition is invoked for the local rate in the convex case; a brief remark on how this condition relates to standard constraint qualifications for the original conic problem would be useful.
Simulated Author's Rebuttal
We thank the referee for the careful reading of the manuscript and the constructive comment. We address the major comment below and will revise the manuscript accordingly to strengthen the presentation.
read point-by-point responses
-
Referee: [§4] §4 (Complexity Analysis), Theorem 4.3: the iteration complexity bound for an (ε1, ε2, ε1√ε2)-KKT point is derived from the majorizing smoothing property and the chosen evolution rules for the smoothing parameter; the proof sketch in the text does not explicitly bound the accumulation of smoothing errors across iterations, which is load-bearing for the claimed complexity.
Authors: We appreciate the referee's observation regarding the explicit bounding of accumulated smoothing errors in the proof of Theorem 4.3. The evolution rules for the smoothing parameter (detailed in Section 3.2) are chosen precisely so that the per-iteration smoothing error ε_k satisfies ∑ ε_k < ∞ and, more importantly, the partial sums remain controlled by O(ε) when the algorithm is run for the number of iterations needed to reach the target tolerances. This ensures the total contribution of smoothing errors to the KKT residual is absorbed into the stated complexity without altering the leading term. Nevertheless, we agree that making this accumulation bound fully explicit will improve clarity. In the revised version we will insert a dedicated lemma (or an expanded paragraph within the proof of Theorem 4.3) that derives the precise bound on the cumulative smoothing error and shows how it is dominated by the other terms in the complexity estimate. revision: yes
Circularity Check
No significant circularity in derivation chain
full rationale
The paper states an explicit assumption that the support function of a compact base of the polar cone admits a majorizing smoothing approximation (satisfied for R^m_- and S^m_-), uses it to reformulate the conic constraint as a single inequality, and adapts the standard moving balls approximation (MBA) method with explicit smoothing evolution rules. Iteration complexity for an (ε1, ε2, ε1√ε2)-KKT point, convex-case convergence, and local rate under Hölderian growth are derived from these rules and the assumption. All steps are self-contained with independent content; no reduction to fitted inputs, self-definitional relations, or load-bearing self-citations appears in the construction.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption The support function of a compact base of the polar cone exhibits a majorizing smoothing approximation
Lean theorems connected to this paper
-
IndisputableMonolith/Cost/FunctionalEquation.leanwashburn_uniqueness_aczel unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
We assume that the support function of a compact base of the polar cone exhibits a majorizing smoothing approximation... adapt the moving balls approximation (MBA) method... iteration complexity for obtaining an (ε1, ε2, ε1 √ε2)-Karush-Kuhn-Tucker point.
-
IndisputableMonolith/Foundation/AlphaCoordinateFixation.leancostAlphaLog_high_calibrated_iff unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
hμ(y) := μ log(∑ exp(λi(y)/μ)) + 10^{-5}μ (for λmax on Sm)
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Reference graph
Works this paper leans on
-
[1]
M. F. Anjos, and J. B Lasserre.Handbook on Semidefinite, Conic and Polynomial Optimization. Springer Science and Business Media (2011). 30J. XU, T. K. PONG,ANDN.-S. SZE
work page 2011
-
[2]
S. Arahata, T. Okuno, and A. Takeda. Complexity analysis of interior-point methods for second-order stationary points of nonlinear semidefinite optimization problems.Comput. Optim. Appl.86, pp. 555–598 (2023)
work page 2023
-
[3]
H. Attouch, J. Bolte, P. Redont and A. Soubeyran. Proximal alternating minimization and projection methods for nonconvex problems: An approach based on the Kurdyka- Lojasiewicz inequality.Math. Oper. Res.35, pp. 438–457 (2010)
work page 2010
-
[4]
H. Attouch, J. Bolte and B. F. Svaiter. Convergence of descent methods for semi-algebraic and tame problems: Proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods.Math. Program.137, pp. 91–129 (2013)
work page 2013
- [5]
-
[6]
A. Auslender, R. Shefi, and M. Teboulle. A moving balls approximation method for a class of smooth constrained minimization problems.SIAM J. Optim.20, pp. 3232–3259 (2010)
work page 2010
-
[7]
A. Beck and M. Teboulle. Smoothing and first order methods: A unified framework.SIAM J. Optim.22, pp. 557–580 (2012)
work page 2012
-
[8]
A. B¨ ohm and S. J. Wright. Variable smoothing for weakly convex composite functions.J. Optim. Theory and Appl.188, pp. 628–649 (2021)
work page 2021
- [9]
- [10]
-
[11]
J. Bolte, and E. Pauwels. Majorization-minimization procedures and convergence of SQP methods for semi-algebraic and tame programs.Math. Oper. Res.41, pp. 442–465 (2016)
work page 2016
-
[12]
J. F. Bonnans and A. Shapiro.Perturbation Analysis of Optimization Problems. Springer Science and Business Media (2013)
work page 2013
-
[13]
D. Boob, Q. Deng and G. Lan. Level constrained first order methods for function constrained optimization.Math. Program.209, pp. 1–61 (2025)
work page 2025
-
[14]
D. Boob, Q. Deng and G. Lan. Stochastic first-order methods for convex and nonconvex functional constrained optimization.Math. Program.197, pp. 215–279 (2023)
work page 2023
-
[15]
J. Borwein, and A. Lewis.Convex analysis and nonlinear optimization: Theory and examples (2nd ed.). Springer (2006)
work page 2006
-
[16]
S. Boyd, C. Crusius and A. Hansson. Control applications of nonlinear convex programming.J. Process Control8, pp. 313–324 (1998)
work page 1998
- [17]
-
[18]
R. Correa and H. Ramirez C. A global algorithm for nonlinear semidefinite programming,SIAM J. Optim.15, pp. 303–318 (2004)
work page 2004
-
[19]
F. Facchinei, V. Kungurtsev, L. Lampariello and G. Scutari. Ghost penalties in nonconvex constrained optimization: Diminishing stepsizes and iteration complexity.Math. Oper. Res. 46, pp. 595-–627 (2021)
work page 2021
-
[20]
D. Fern´ andez and M. Solodov. Stabilized sequential quadratic programming for optimization and a stabilized Newton-type method for variational problems.Math. Program.125, pp. 47–73 (2010)
work page 2010
-
[21]
E. H. Fukuda and B. F. Louren¸ co. Exact augmented Lagrangian functions for nonlinear semidefinite programming.Comput. Optim. Appl.71, pp. 457–482 (2018)
work page 2018
- [22]
- [23]
-
[24]
A. N. Iusem. On the convergence properties of the projected gradient method for convex optimization.Comput. Appl. Math.22, pp. 37–52 (2003)
work page 2003
-
[25]
F. Jarre. An interior method for nonconvex semidefinite programs.Optim. Eng.1, pp. 347–372 (2000)
work page 2000
-
[26]
H. Kato and M. Fukushima. An SQP-type algorithm for nonlinear second-order cone programs, Optim. Lett.1, pp. 129–144 (2007)
work page 2007
-
[27]
M. Koˇ cvara and M. Stingl. Solving nonconvex SDP problems of structural optimization with stability control.Optim. Methods Software19, pp. 595–609 (2004)
work page 2004
- [28]
- [29]
-
[30]
Z. Lu, S. Mei and Y. Xiao. Variance-reduced first-order methods for deterministically constrained stochastic nonconvex optimization with strong convergence guarantees.SIAM J. Optim. 36, pp. 1-31 (2026)
work page 2026
- [31]
-
[32]
M. S. Lobo, L. Vandenberghe, S. Boyd and H. Lebret.. Applications of second-order cone programming.Linear Algebra Appl.284, pp. 193–228 (1998)
work page 1998
- [33]
-
[34]
Y. Nesterov and A. Nemirovskii.Interior-point Polynomial Algorithms in Convex Programming. Society for industrial and applied mathematics (1994)
work page 1994
-
[35]
M. J. Powell. A method for nonlinear constraints in minimization problems.Optimizationpp. 283–298 (1969)
work page 1969
-
[36]
R. T. Rockafellar. Augmented Lagrangians and applications of the proximal point algorithm in convex programming.Math. Oper. Res.1, pp. 97–116 (1976)
work page 1976
-
[37]
R. T. Rockafellar and R. J. B. Wets.Variational Analysis. Springer Science and Business Media (2009)
work page 2009
-
[38]
R. Shefi and M. Teboulle. A dual method for minimizing a nonsmooth objective over one smooth inequality constraint.Math. Program.159, pp. 137–164 (2016)
work page 2016
-
[39]
M. V. Solodov. Global convergence of an SQP method without boundedness assumptions on any of the iterative sequences.Math. Program.118, pp. 1–12 (2009)
work page 2009
-
[40]
D. Sun, J. Sun and L. Zhang. The rate of convergence of the augmented Lagrangian method for nonlinear semidefinite programming.Math. Program.114, pp. 349–391 (2008)
work page 2008
-
[41]
H. Wolkowicz, R. Saigal and L. Vandenberghe.Handbook of Semidefinite Programming: Theory, Algorithms, and Applications. Springer Science and Business Media (2012)
work page 2012
- [42]
-
[43]
Y. Xu. Iteration complexity of inexact augmented Lagrangian methods for constrained convex programming.Math. Program.185, pp. 199–244 (2021)
work page 2021
-
[44]
H. Yamashita and H. Yabe. A survey of numerical methods for nonlinear semidefinite program- ming.J. Oper. Res. Soc. Japan.58, pp. 24–60 (2015)
work page 2015
-
[45]
P. Yu, T. K. Pong and Z. Lu. Convergence rate analysis of a sequential convex programming method with line search for a class of constrained difference-of-convex optimization problems. SIAM J. Optim.31, pp. 2024–2054 (2021)
work page 2024
-
[46]
Z˘ alinescu.Convex Analysis in General Vector Spaces
C. Z˘ alinescu.Convex Analysis in General Vector Spaces. World Scientific (2002)
work page 2002
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.