Optimization Workshop Notes for Mathematical Programming with Equilibrium Constraints Algorithms: Penalty Interior-Point, Implicit-Programming, and Piecewise SQP
Pith reviewed 2026-05-10 08:55 UTC · model grok-4.3
The pith
Workshop notes on equilibrium-constrained optimization algorithms stress that convergence theorems depend on assumptions distinguishing solid methods from promising ideas.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
These notes claim that the penalty interior-point algorithm and its variant handle the complementarity by penalizing violations and controlling decay rates, the implicit-programming method uses the implicit function theorem to treat the equilibrium as defining a function, and piecewise SQP selects local smooth pieces of the equilibrium to apply standard SQP steps, with each having associated subproblems and convergence under assumptions like monotonicity or linear independence constraint qualifications.
What carries the argument
The central mechanism is the formulation of specialized subproblems for computing search directions that incorporate the lower-level equilibrium conditions, along with analysis showing under which assumptions these lead to provable convergence to stationary points.
If this is right
- Applying the penalty interior-point algorithm requires updating the penalty parameter so that complementarity residuals decrease appropriately for the convergence theorem to apply.
- The implicit-programming approach reduces the equilibrium-constrained problem to a standard optimization problem only when the lower-level solution is unique and differentiable.
- Piecewise SQP can achieve superlinear convergence locally once the correct smooth piece is identified at the solution.
- Globalization in these methods often relies on merit functions that balance objective decrease with feasibility of the equilibrium constraints.
Where Pith is reading between the lines
- These detailed explanations of assumptions could help practitioners avoid implementing algorithms in regimes where they are not guaranteed to work.
- Similar emphasis on distinguishing algorithmic ideas from theorems might improve the presentation of methods for other classes of non-smooth or hierarchical optimization problems.
- Future work could involve testing these algorithms numerically using the subproblem formulations described to verify the practical impact of the assumptions.
Load-bearing premise
The algorithms, their subproblems, globalization mechanisms, and stated convergence results are faithfully reproduced from the prior literature in these notes.
What would settle it
Finding an equilibrium-constrained example where one of the described algorithms fails to converge as predicted by the theorem under the listed assumptions would show that the notes misrepresent the convergence conditions.
read the original abstract
In this workshop, we discuss several algorithms for mathematical programs with equilibrium constraints (MPECs). The unifying theme is that MPECs are optimization problems whose feasible set contains a lower-level equilibrium system, often written through complementarity or variational-inequality conditions. This destroys the smooth manifold or convex structure that standard nonlinear programming methods rely on. We focus on four algorithmic viewpoints: (i) the classical penalty interior-point algorithm (PIPA); (ii) a monotone-linear complementarity problem (LCP) variant of PIPA that explicitly controls complementarity decay; (iii) an implicit-programming descent method for variational inequality (VI)-constrained MPECs; (iv) piecewise SQP (PSQP), which applies SQP on locally selected smooth pieces. For each method we explain the model, the search direction subproblem, the globalization mechanism, and the meaning of the convergence result. Particular emphasis is placed on what the assumptions are really doing and on the distinction between an attractive algorithmic idea and a fully valid convergence theorem.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript consists of workshop notes summarizing four algorithmic frameworks for mathematical programs with equilibrium constraints (MPECs): the classical penalty interior-point algorithm (PIPA), a monotone LCP variant of PIPA, an implicit-programming descent method for VI-constrained MPECs, and piecewise SQP (PSQP). For each approach the notes describe the model, search-direction subproblem, globalization strategy, and the precise role of assumptions in the associated convergence results, with explicit attention to the distinction between an attractive algorithmic idea and a fully valid theorem.
Significance. If the summaries faithfully reproduce the assumptions and convergence statements from the cited literature, the notes offer a useful pedagogical resource that clarifies the technical conditions required for convergence in MPEC algorithms. The emphasis on the meaning of assumptions and the separation of heuristic appeal from rigorous guarantees is a constructive contribution for readers seeking to understand the limitations of these methods.
minor comments (2)
- [Abstract] The abstract lists the four viewpoints but does not explicitly note that the material is expository and contains no new theorems or derivations; adding one sentence to this effect would help set reader expectations.
- [LCP variant of PIPA] In the description of the LCP variant of PIPA, the notation for the complementarity decay control parameter should be cross-checked against the original reference to ensure consistency in the statement of the subproblem.
Simulated Author's Rebuttal
We thank the referee for the careful reading and for recommending acceptance. The provided summary accurately describes the scope and emphasis of the workshop notes.
Circularity Check
No significant circularity in explanatory workshop notes
full rationale
The document is a set of workshop notes that summarize and explain four existing algorithmic frameworks (PIPA, LCP variant, implicit-programming descent, PSQP) drawn from prior literature. It articulates models, subproblems, globalization, and the role of assumptions in convergence results without introducing new theorems, derivations, fitted parameters, or predictions. No load-bearing steps reduce by construction to self-defined inputs or self-citations; the content is purely expository and distinguishes heuristic appeal from theorem validity. This is self-contained against external benchmarks.
Axiom & Free-Parameter Ledger
Forward citations
Cited by 3 Pith papers
-
First-Order Optimality Conditions for Mathematical Programming with Equilibrium Constraints
A geometric characterization of the tangent cone to feasible points in MPECs yields stationarity concepts and constraint qualifications that avoid the strong nondegeneracy and smoothness assumptions required by classi...
-
Introduction to Exact Penalization for Mathematical Programming with Equilibrium Constraints
Exact penalization for MPECs is enabled under broader conditions by fractional-order penalties derived from Lojasiewicz error bounds on KKT residual mappings.
-
Introduction to Mathematical Programming with Equilibrium Constraints (MPECs) and Bilevel Optimization
An MPEC is an optimization problem whose feasible set is partly defined by another optimization, variational inequality, complementarity system, or equilibrium model.
Reference graph
Works this paper leans on
-
[1]
S. Leyffer. The penalty interior-point method fails to converge.Optimization Methods and Software, 20(4-5):559–568, 2005. doi: 10.1080/10556780500140078
-
[2]
F. Facchinei, V. Kungurtsev, L. Lampariello, and G. Scutari. Ghost penalties in nonconvex constrained optimization: Diminishing stepsizes and iteration complexity.Mathematics of Operations Research, 46(2):595–627, 2021. doi: 10.1287/moor.2020.1079
-
[3]
D. Kuhn and R. Löwen. Piecewise affine bijections of Rn, and the equation Sx+-Tx-=y.Linear Algebra and its Applications, 96:109–129, 1987. doi: 10.1016/0024-3795(87)90339-9
-
[4]
R.W. Cottle, J.S. Pang, and R.E. Stone.The Linear Complementarity Problem. Academic Press, Boston, 1st edition, 1992
work page 1992
-
[5]
M. Kojima, N. Megiddo, T. Noma, and A. Yoshise. A unified approach to interior point algorithms for linear complementarity problems: A summary.Operations Research Letters, 10 (5):247–254, 1991. doi: 10.1016/0167-6377(91)90010-M
-
[6]
Z. Liu, L. S. Wang, J. Yu, J. Zhang, E. Martel, and S. Li. Bidirectional endothelial feedback drives turing-vascular patterning and drug-resistance niches: a hybrid PDE-agent-based study. Bioengineering, 12(10):1097, 2025. doi: 10.3390/bioengineering12101097. 22
-
[7]
J. Larson, M. Menickelly, and B. Zhou. Manifold sampling for optimizing nonsmooth nonconvex compositions.SIAM Journal on Optimization, 31(4):2638–2664, 2021. doi: 10.1137/20M1378089
-
[8]
Q. Hu, B. Wang, and M. Xu. Convergence properties of gradient-based methods for minimax problems with nonlinear constraints.Journal of Optimization Theory and Applications, 209(1): 13, 2026. doi: 10.1007/s10957-026-02964-w
- [9]
-
[10]
S. Wright and D. Ralph. A superlinear infeasible-interior-point algorithm for monotone complementarity problems.Mathematics of Operations Research, 21(4):815–838, 1996. URL https://www.jstor.org/stable/3690189
-
[11]
Y. Zhang. On the convergence of a class of infeasible interior-point methods for the horizontal linear complementarity problem.SIAM Journal on Optimization, 4(1):208–227, 1994. doi: 10.1137/0804012
-
[12]
and Rheinboldt W.G.Iterative Solution of Nonlinear Equations in Several Variables
Ortega J.M. and Rheinboldt W.G.Iterative Solution of Nonlinear Equations in Several Variables. Academic Press, New York, 1970. URL https://www.scirp.org/reference/ referencespapers?referenceid=1205027
work page 1970
-
[13]
J. V. Burke. A sequential quadratic programming method for potentially infeasible mathematical programs.Journal of Mathematical Analysis and Applications, 139(2):319–351, 1989. doi: 10.1016/0022-247X(89)90111-X
-
[14]
A. Aghasi and S. Ghadimi. Fully zeroth-order bilevel programming via gaussian smoothing.Jour- nal of Optimization Theory and Applications, 205(2):31, 2025. doi: 10.1007/s10957-025-02647-y
-
[15]
J. V. Burke. A robust trust region method for constrained nonlinear programming problems. SIAM Journal on Optimization, 2(2):325–347, 1992. doi: 10.1137/0802016
-
[16]
L. S. Wang and J. Yu. Analysis framework for stochastic predator–prey model with demographic noise.Results in Applied Mathematics, 27:100621, 2025. doi: 10.1016/j.rinam.2025.100621
-
[17]
L. Lampariello. On detecting degenerate stationarity.Journal of Optimization Theory and Applications, 206(3):69, 2025. ISSN 0022-3239, 1573-2878. doi: 10.1007/s10957-025-02747-9
-
[18]
M. A. Londe, C. E. Andrade, and L. S. Pessoa. A multi-stage approach for Root Sequence Index allocation.European Journal of Operational Research, 327(1):95–114, 2025. doi: 10.1016/ j.ejor.2025.05.015
work page 2025
-
[19]
X. Hu, N. Xiao, X. Liu, and K.-C. Toh. An improved unconstrained approach for bilevel optimization.SIAM Journal on Optimization, 33(4):2801–2829, 2023. doi: 10.1137/22M1513034
-
[20]
D. Boob, Q. Deng, and G. Lan. Level constrained first order methods for function constrained op- timization.Mathematical Programming, 209(1-2):1–61, 2025. doi: 10.1007/s10107-024-02057-4
-
[21]
W. Yao and X. Yang. Relative Lipschitz-like property of parametric systems via pro- jectional coderivatives.SIAM Journal on Optimization, 33(3):2021–2040, 2023. doi: 10.1137/22M151296X. 23
-
[22]
J.-P. Dussault, M. Frappier, and J. C. Gilbert. Polyhedral newton-min algorithms for complementarity problems.Mathematical Programming, 215(1-2):269–324, 2026. doi: 10.1007/s10107-025-02219-y
-
[23]
G. Caselli, M. Iori, and I. Ljubic. Bilevel optimization with sustainability perspective: A survey on applications.European Journal of Operational Research, 332(2):357–375, 2026. doi: 10.1016/j.ejor.2025.08.051
-
[24]
J. V. Burke and S-P. Han. A robust sequential quadratic programming method.Mathematical Programming, 43(1-3):277–303, 1989. doi: 10.1007/BF01582294
-
[25]
T. Wang, R. D. C. Monteiro, and J.-S. Pang. An interior point potential reduction method for constrained equations.Mathematical Programming, 74(2):159–195, 1996. doi: 10.1007/ BF02592210
work page 1996
-
[26]
H. El Hajj, S. Elhedhli, and F. Gzara. Efficient resource sharing for strategic disas- ter preparedness.European Journal of Operational Research, 329(3):836–847, 2026. doi: 10.1016/j.ejor.2025.08.025
-
[27]
J.-S. Pang, S.-P. Han, and N. Rangaraj. Minimization of locally lipschitzian functions.SIAM Journal on Optimization, 1(1):57–82, 1991. doi: 10.1137/0801006
-
[28]
Z. Lu and S. Mei. First-order penalty methods for bilevel optimization.SIAM Journal on Optimization, 34(2):1937–1969, 2024. doi: 10.1137/23M1566753
-
[29]
L. Chen, D. Sun, and W. Zhang. Two typical implementable semismooth* Newton methods for generalized equations are G-semismooth newton methods.Mathematics of Operations Research, page moor.2024.0617, 2025. doi: 10.1287/moor.2024.0617
-
[30]
A. S. Lewis and C. Wylie. Active-set Newton methods and partial smoothness.Mathematics of Operations Research, 46(2):712–725, 2021. doi: 10.1287/moor.2020.1075
-
[31]
L. S. Wang and J. Yu. Algebraic–spectral thresholds and discrete–continuous stability transfer in Leslie–Gower systems.Electronic Research Archive, 34(1):251–290, 2026. doi: 10.3934/era. 2026013
work page doi:10.3934/era 2026
-
[32]
T. Lagos, J. Choi, B. Segundo, J. Gan, L. Ntaimo, and O. A. Prokopyev. Bilevel optimization approach for fuel treatment planning.European Journal of Operational Research, 320(1): 205–218, 2025. doi: 10.1016/j.ejor.2024.07.014
-
[33]
S. Cui, U. V. Shanbhag, and F. Yousefian. Complexity guarantees for an implicit smoothing- enabled method for stochastic MPECs.Mathematical Programming, 198(2):1153–1225, 2023. doi: 10.1007/s10107-022-01893-6
-
[34]
E. Casas and M. Mateos. Convergence analysis of the semismooth newton method for sparse control problems governed by semilinear elliptic equations.SIAM Journal on Control and Optimization, 62(6):3076–3090, 2024. doi: 10.1137/23M1585945
-
[35]
J. Outrata and J. Zowe. A numerical approach to optimization problems with variational inequality constraints.Mathematical Programming, 68(1-3):105–130, 1995. doi: 10.1007/ BF01585759. 24
work page 1995
-
[36]
G. P. McCormick.Nonlinear programming: Theory, algorithms, and applications. Wiley, New York, 1983. ISBN 978-0-471-09309-1
work page 1983
-
[37]
J. F. Bonnans. Local analysis of Newton-type methods for variational inequalities and nonlinear programming.Applied Mathematics & Optimization, 29(2):161–186, 1994. doi: 10.1007/ BF01204181
work page 1994
-
[38]
J.-S. Pang. Convergence of splitting and Newton methods for complementarity problems: An application of some sensitivity results.Mathematical Programming, 58(1-3):149–160, 1993. doi: 10.1007/BF01581264
-
[39]
Y. Liang, L. S. Wang, J. Yu, and Z. Liu. Global well-posedness and stability of nonlocal damage-structured lineage model with feedback and dedifferentiation.Mathematics, 13(22): 3583, 2025. doi: 10.3390/math13223583
-
[40]
Y. Malitsky. Projected reflected gradient methods for monotone variational inequalities.SIAM Journal on Optimization, 25(1):502–520, 2015. doi: 10.1137/14097238X
-
[41]
J.Kyparisis. OnuniquenessofKuhn-Tuckermultipliersinnonlinearprogramming.Mathematical Programming, 32(2):242–246, 1985. doi: 10.1007/BF01586095
-
[42]
S. M. Robinson. Perturbed Kuhn-Tucker points and rates of convergence for a class of nonlinear-programming algorithms.Mathematical Programming, 7(1):1–16, 1974. doi: 10.1007/ BF01585500
work page 1974
-
[43]
L. S. Wang. Lecture note for bounded controls in continuous-time and control of several variables.arXiv preprint arXiv:2604.05882, 2026
work page internal anchor Pith review Pith/arXiv arXiv 2026
-
[44]
B. Curtis Eaves. Where Solving for Stationary Points by LCPs is Mixing Newton Iterates. InHomotopy Methods and Global Convergence, pages 63–77. Springer US, Boston, MA, 1983. ISBN 978-1-4613-3574-0 978-1-4613-3572-6. doi: 10.1007/978-1-4613-3572-6_5
-
[45]
L. S. Wang, J. Yu, S. Li, and Z. Liu. Analysis and mean-field limit of a hybrid PDE-ABM modeling angiogenesis-regulated resistance evolution.Mathematics, 13(17):2898, 2025. doi: 10.3390/math13172898
-
[46]
S. Han and J.-S. Pang. Continuous selections of solutions to parametric variational inequalities. SIAM Journal on Optimization, 34(1):870–892, 2024. doi: 10.1137/22M1514982
-
[47]
J.-S. Pang and S. A. Gabriel. NE/SQP: A robust algorithm for the nonlinear complementarity problem.Mathematical Programming, 60(1-3):295–337, 1993. doi: 10.1007/BF01580617
-
[48]
J. F. Bonnans. Local study of newton type algorithms for constrained problems. InOptimization, volume 1405, pages 13–24. Springer Berlin Heidelberg, 1989. ISBN 978-3-540-51970-6. doi: 10.1007/BFb0083583. Series Title: Lecture Notes in Mathematics
-
[49]
Rolling prediction model of closing price based on eemd data noise reduction and hgs-delm
Yuansheng Gao, Lei Li, and Jiguang Yu. Rolling prediction model of closing price based on eemd data noise reduction and hgs-delm. In2022 International Conference on Data Analytics, Computing and Artificial Intelligence (ICDACAI), pages 255–260. IEEE, 2022
work page 2022
-
[50]
Zixin Wang, Danqing Wang, and Jiguang Yu. Multi-strategy hybrid improved intelligent algorithm for solving uav-mtsp.Information Technology and Control, 54(2):413–438, 2025. 25
work page 2025
-
[51]
C. Christof, J. C. De Los Reyes, and C. Meyer. A nonsmooth trust-region method for locally lipschitz functions with application to optimization problems constrained by variational inequalities.SIAM Journal on Optimization, 30(3):2163–2196, 2020. doi: 10.1137/18M1164925
-
[52]
S. P. Han. A globally convergent method for nonlinear programming.Journal of Optimization Theory and Applications, 22(3):297–309, 1977. doi: 10.1007/BF00932858
-
[53]
Y. Lou, S. Sun, and J. Nocedal. Design guidelines for noise-tolerant optimization with applications in robust design.SIAM Journal on Scientific Computing, 47(3):A1335–A1357,
-
[54]
doi: 10.1137/24M1632279
-
[55]
J. V. Burke, F. E. Curtis, H. Wang, and J. Wang. Inexact sequential quadratic optimization with penalty parameter updates within the QP solver.SIAM Journal on Optimization, 30(3): 1822–1849, 2020. doi: 10.1137/18M1176488
-
[56]
L. S. Wang, J. Yu, and Z. Liu. A damage-structured PDE model of stem cell hierarchies: The dual role of dedifferentiation in tissue homeostasis and aging.PLOS One, 21(2):e0335163, 2026. doi: 10.1371/journal.pone.0335163
-
[57]
A survey on bilevel optimization under uncertainty
Y.Beck, I.Ljubic, andM.Schmidt. Asurveyonbileveloptimizationunderuncertainty.European Journal of Operational Research, 311(2):401–426, 2023. doi: 10.1016/j.ejor.2023.01.008
-
[58]
P.-F. Dai. A fixed point iterative method for tensor complementarity problems.Journal of Scientific Computing, 84(3):49, 2020. doi: 10.1007/s10915-020-01299-6
-
[59]
M. S. Gowda and J.-S. Pang. Stability analysis of variational inequalities and nonlinear complementarity problems, via the mixed linear complementarity problem and degree theory. Mathematics of Operations Research, 19(4):831–879, 1994. doi: 10.1287/moor.19.4.831
-
[60]
S. Shin, M. Anitescu, and V. M. Zavala. Exponential decay of sensitivity in graph-structured nonlinear programs.SIAM Journal on Optimization, 32(2):1156–1183, 2022. doi: 10.1137/ 21M1391079
work page 2022
- [61]
-
[62]
doi: 10.1137/20M1370173
-
[63]
J. Yu, L. S. Wang, Z. Liu, and J. Liu. Pattern suppression and recovery under one-way versus two-way chemotactic coupling in hybrid partial differential equation–ordinary differential equation models.Transport Phenomena, 2026. ISSN 3052-878X. doi: 10.1515/tp-2026-0023
-
[64]
H. Jiang and D. Ralph. Extension of quasi-newton methods to mathematical programs with complementarity constraints.Computational Optimization and Applications, 25(1-3):123–150,
-
[65]
doi: 10.1023/A:1022945316191
-
[66]
S. Dempe. A necessary and a sufficient optimality condition for bilevel programming problems. Optimization, 25(4):341–354, 1992. doi: 10.1080/02331939208843831
-
[67]
P. Hansen, B. Jaumard, and G. Savard. New branch-and-bound rules for linear bilevel programming.SIAM Journal on Scientific and Statistical Computing, 13(5):1194–1217, 1992. doi: 10.1137/0913069. 26
-
[68]
J. Wang and C. G. Petra. A sequential quadratic programming algorithm for nonsmooth problems with upper-C2 objective.SIAM Journal on Optimization, 33(3):2379–2405, 2023. doi: 10.1137/22M1490995
-
[69]
A. Rawat and V. Singh. Augmented Lagrangian neural network for solving mathematical programs with equilibrium constraints.Journal of Optimization Theory and Applications, 209 (1):15, 2026. doi: 10.1007/s10957-026-02963-x
-
[70]
B. S. Mordukhovich and M. E. Sarabi. Generalized newton algorithms for tilt-stable minimizers in nonsmooth optimization.SIAM Journal on Optimization, 31(2):1184–1214, 2021. doi: 10.1137/20M1329937
-
[71]
A. Mohammadi, B. S. Mordukhovich, and M. E. Sarabi. Variational analysis of composite models with applications to continuous optimization.Mathematics of Operations Research, 47 (1):397–426, 2022. doi: 10.1287/moor.2020.1074
-
[72]
P. Duy Khanh, B. Mordukhovich, and V. T. Phat. A generalized newton method for subgradient systems.Mathematics of Operations Research, 48(4):1811–1845, 2023. doi: 10.1287/moor.2022. 1320
-
[73]
A. F. Izmailov and M. V. Solodov. Perturbed augmented lagrangian method framework with applications to proximal and smoothed variants.Journal of Optimization Theory and Applications, 193(1-3):491–522, 2022. doi: 10.1007/s10957-021-01914-y. 27
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.