Fej\'er* monotonicity in optimization algorithms
Pith reviewed 2026-05-23 18:44 UTC · model grok-4.3
The pith
Fejér* monotonicity extends Fejér monotonicity to deliver weak and strong convergence for optimization algorithm sequences in Hilbert spaces.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Fejér* monotonicity, introduced in a 2024 SIAM J. Optim. reference, is analyzed as a tool for optimization algorithms in Hilbert spaces; the paper proves that sequences obeying this extended monotonicity possess weak and strong convergence properties and are distinguishable from weaker quasi-Fejér-type monotonicity.
What carries the argument
Fejér* monotonicity, an extension of Fejér monotonicity that adds conditions enabling convergence conclusions for algorithm-generated sequences.
If this is right
- Any optimization algorithm whose iterates obey Fejér* monotonicity converges weakly to a solution set in Hilbert space.
- Under extra conditions such as Opial's property or demiclosedness, the same sequences converge strongly.
- Fejér* monotonicity supplies a stricter yet still usable criterion than quasi-Fejér monotonicity for proving convergence of iterative methods.
- The property can be verified directly on many standard algorithms to obtain convergence without resorting to weaker auxiliary notions.
Where Pith is reading between the lines
- The same monotonicity notion might be checked on proximal-point or forward-backward schemes to recover known convergence results in a unified way.
- Extensions to Banach spaces or Riemannian manifolds could be tested by replacing the inner-product geometry with an appropriate distance function.
- Minimal sufficient conditions on the algorithm parameters that guarantee Fejér* monotonicity remain open for further derivation.
Load-bearing premise
The definition and basic properties of Fejér* monotonicity from the 2024 SIAM J. Optim. paper are taken as given and hold for the sequences produced by the algorithms examined here.
What would settle it
An explicit optimization algorithm whose generated sequence satisfies the Fejér* monotonicity definition yet fails to converge weakly (or strongly when additional hypotheses hold) inside a Hilbert space would disprove the claimed convergence properties.
read the original abstract
Fej\'er monotonicity is a well-established property often observed in sequences generated by optimization algorithms. In this paper, we study an extension of this property, called Fej\'er* monotonicity, which was initially proposed in [SIAM J. Optim., 34(3), 2535-2556 (2024)]. We discuss and explore its behavior within Hilbert spaces as a tool for optimization algorithms. Additionally, we investigate weak and strong convergence properties of this novel concept. Through illustrative examples and insightful results, we contrast Fej\'er* with weaker notions of quasi-Fej\'er-type monotonicity.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper studies Fejér* monotonicity—an extension of classical Fejér monotonicity introduced in a 2024 SIAM J. Optim. paper—as a tool for analyzing sequences generated by optimization algorithms in Hilbert spaces. It establishes weak and strong convergence results under this property and contrasts it with weaker quasi-Fejér-type notions via illustrative examples.
Significance. If the stated convergence theorems hold, the work supplies a refined monotonicity notion that can certify convergence for algorithms where standard Fejér monotonicity fails, while remaining stronger than quasi-Fejér variants. This is a natural theoretical follow-up that could be cited in future convergence analyses of proximal, projection, or splitting methods.
minor comments (4)
- §2, Definition 2.1: the notation for the auxiliary sequence {y_k} is introduced without an explicit link to the algorithm iteration; a one-sentence reminder of how y_k is constructed from the original sequence would improve readability.
- Theorem 3.3: the strong-convergence claim is stated for the case when the limit point lies in the interior of the constraint set; it would be useful to add a short remark on whether the result extends to the boundary case or requires an additional qualification.
- Example 4.2: the numerical illustration reports only the final error; adding a short table or plot of the decay of ||x_{k+1}-x_k|| would make the contrast with quasi-Fejér behavior more concrete.
- Reference list: the 2024 SIAM J. Optim. paper is cited as “in press”; if a volume/issue number is now available it should be inserted for precision.
Simulated Author's Rebuttal
We thank the referee for the careful reading and positive assessment of our manuscript on Fejér* monotonicity. The recommendation for minor revision is noted. No specific major comments were provided in the report, so we have no points to address point-by-point at this stage.
Circularity Check
No circularity; builds directly on external prior definition
full rationale
The manuscript takes the definition and basic properties of Fejér* monotonicity from the cited external 2024 SIAM J. Optim. paper as its starting point and applies standard arguments for convergence of Fejér-type sequences in Hilbert spaces. No step reduces a claimed result or prediction to the inputs by construction, no fitted parameters are relabeled as predictions, and no uniqueness theorem or ansatz is smuggled via self-citation. The central claims follow from the given definition plus routine analysis, making the derivation self-contained against the external benchmark.
Axiom & Free-Parameter Ledger
Lean theorems connected to this paper
-
IndisputableMonolith/Foundation/AbsoluteFloorClosure.leanreality_from_one_distinction unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
Definition 2.1 (Fejér* monotonicity) … for any point x ∈ M, there exists N(x) ∈ N such that, for all k ≥ N(x), ∥xk+1 − x∥ ≤ ∥xk − x∥.
-
IndisputableMonolith/Cost/FunctionalEquation.leanwashburn_uniqueness_aczel unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
Proposition 3.1 … (xk)k∈N is bounded; … the scalar sequence (∥xk − x∥)k∈N converges.
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Forward citations
Cited by 1 Pith paper
-
Basis pursuit by inconsistent alternating projections
New inconsistent alternating projection scheme for basis pursuit with linear convergence proofs and competitive benchmarks.
Reference graph
Works this paper leans on
-
[1]
Canadian Journal of Mathematics6, 382–392 (1954)
Agmon, S.: The Relaxation Method for Linear Inequalities. Canadian Journal of Mathematics6, 382–392 (1954). DOI 10.4153/CJM-1954-037-2
-
[2]
Mathematical Programming81(1), 23–35 (1998)
Alber, Ya.I., Iusem, A.N., Solodov, M.V.: On the projected subgradient method for nonsmooth convex op- timization in a Hilbert space. Mathematical Programming81(1), 23–35 (1998). DOI 10.1007/BF01584842
-
[3]
Fixed Point Theory and Algorithms for Sciences and Engineering2022(1), 30 (2022)
Araújo, G.H.M., Arefidamghani, R., Behling, R., Bello-Cruz, Y., Iusem, A., Santos, L.R.: Circumcentering approximate reflections for solving the convex feasibility problem. Fixed Point Theory and Algorithms for Sciences and Engineering2022(1), 30 (2022). DOI 10.1186/s13663-021-00711-6
-
[4]
Computational Optimization and Applications 79(2), 507–530 (2021)
Arefidamghani, R., Behling, R., Bello-Cruz, Y., Iusem, A.N., Santos, L.R.: The circumcentered-reflection method achieves better rates than alternating projections. Computational Optimization and Applications 79(2), 507–530 (2021). DOI 10.1007/s10589-021-00275-6
-
[5]
Journal of Applied and Numerical Optimization 5(3), 299–320 (2023)
Arefidamghani, R., Behling, R., Iusem, A.N., Santos, L.R.: A circumcentered-reflection method for finding common fixed points of firmly nonexpansive operators. Journal of Applied and Numerical Optimization 5(3), 299–320 (2023). DOI 10.23952/jano.5.2023.3.02
-
[6]
SIAM Review 38(3), 367–426 (1996)
Bauschke, H.H., Borwein, J.M.: On Projection Algorithms for Solving Convex Feasibility Problems. SIAM Review 38(3), 367–426 (1996). DOI 10.1137/S0036144593251710 10 Roger Behling et al
-
[7]
Bauschke, H.H., Combettes, P.L.: Convex Analysis and Monotone Operator Theory in Hilbert Spaces, 2 edn. CMS Books in Mathematics. Springer International Publishing, Cham, Switzerland (2017). DOI 10.1007/978-3-319-48311-5
-
[8]
Opti- mization Letters 17(3), 531–544 (2023)
Bauschke, H.H., Krishan Lal, M., Wang, X.: Directional asymptotics of Fejér monotone sequences. Opti- mization Letters 17(3), 531–544 (2023). DOI 10.1007/s11590-022-01896-4
-
[9]
SIAM Journal on Optimization 34(3), 2535–2556 (2024)
Behling, R., Bello-Cruz, Y., Iusem, A., Liu, D., Santos, L.R.: A Finitely Convergent Circumcenter Method for the Convex Feasibility Problem. SIAM Journal on Optimization 34(3), 2535–2556 (2024). DOI 10.1137/23M1595412
-
[10]
Computational Optimization and Applications87(1), 83–116 (2024)
Behling, R., Bello-Cruz, Y., Iusem, A., Liu, D., Santos, L.R.: A successive centralized circumcenter re- flection method for the convex feasibility problem. Computational Optimization and Applications87(1), 83–116 (2024). DOI 10.1007/s10589-023-00516-w
-
[11]
Mathematical Programming205, 337–371 (2024)
Behling, R., Bello-Cruz, Y., Iusem, A.N., Santos, L.R.: On the centralization of the circumcentered- reflection method. Mathematical Programming205, 337–371 (2024). DOI 10.1007/s10107-023-01978-w
-
[12]
Optimization Letters 17, 1069–1081 (2023)
Behling, R., Bello-Cruz, Y., Lara-Urdaneta, H., Oviedo, H., Santos, L.R.: Circumcentric directions of cones. Optimization Letters 17, 1069–1081 (2023). DOI 10.1007/s11590-022-01923-4
-
[13]
Numerical Algorithms 78(3), 759–776 (2018)
Behling, R., Bello-Cruz, Y., Santos, L.R.: Circumcentering the Douglas–Rachford method. Numerical Algorithms 78(3), 759–776 (2018). DOI 10.1007/s11075-017-0399-5
-
[14]
Operations Research Letters46(2), 159–162 (2018)
Behling, R., Bello-Cruz, Y., Santos, L.R.: On the linear convergence of the circumcentered-reflection method. Operations Research Letters46(2), 159–162 (2018). DOI 10.1016/j.orl.2017.11.018
-
[15]
Computa- tional Optimization and Applications76(3), 675–699 (2020)
Behling, R., Bello-Cruz, Y., Santos, L.R.: The block-wise circumcentered–reflection method. Computa- tional Optimization and Applications76(3), 675–699 (2020). DOI 10.1007/s10589-019-00155-0
-
[16]
Numerical Algorithms86, 1475–1494 (2021)
Behling, R., Bello-Cruz, Y., Santos, L.R.: On the Circumcentered-Reflection Method for the Convex Feasibility Problem. Numerical Algorithms86, 1475–1494 (2021). DOI 10.1007/s11075-020-00941-6
-
[17]
La Ricerca Scientifica 9(II), 326–333 (1938)
Cimmino, G.: Calcolo approssimato per le soluzioni dei sistemi di equazioni lineari. La Ricerca Scientifica 9(II), 326–333 (1938)
work page 1938
-
[18]
Combettes, P.L.: Quasi-Fejérian Analysis of Some Optimization Algorithms. In: D. Butnariu, Y. Censor, S. Reich (eds.) Studies in Computational Mathematics,Inherently Parallel Algorithms in Feasibility and Optimization and Their Applications , vol. 8, pp. 115–152. Elsevier (2001). DOI 10.1016/S1570-579X(01) 80010-0
-
[19]
Combettes, P.L.: Fejér monotonicity in convex optimization. In: C.A. Floudas, P.M. Pardalos (eds.) Encyclopedia of Optimization, pp. 1016–1024. Springer US, Boston, MA (2009). DOI 10.1007/ 978-0-387-74759-0_179
work page 2009
-
[20]
Cyber- netics 5(2), 208–220 (1969)
Ermol’ev, Yu.M.: On the method of generalized stochastic gradients and quasi-Féjer sequences. Cyber- netics 5(2), 208–220 (1969). DOI 10.1007/BF01071091
-
[21]
Mathematische Annalen85(1), 41–48 (1922)
Fejér, L.: Über die Lage der Nullstellen von Polynomen, die aus Minimumforderungen gewisser Art entspringen. Mathematische Annalen85(1), 41–48 (1922). DOI 10.1007/BF01449600
-
[22]
Prace Matematyczno-Fizyczne44, 15–25 (1937)
Fejér, L., Szegö, G.: Über die monotone Konvergenz von Potenzreihen mit mehrfach monotoner Koef- fizientenfolge. Prace Matematyczno-Fizyczne44, 15–25 (1937)
work page 1937
-
[23]
Nu- merische Mathematik 49(4), 367–378 (1986)
Iusem, A.N., De Pierro, A.R.: Convergence results for an accelerated nonlinear Cimmino algorithm. Nu- merische Mathematik 49(4), 367–378 (1986). DOI 10.1007/BF01389537
-
[24]
Matemática Aplicada e Computacional5(2), 169–184 (1986)
Iusem, A.N., Moledo, L.: A finitely convergent method of simultaneous subgradient projections for the convex feasibility problem. Matemática Aplicada e Computacional5(2), 169–184 (1986)
work page 1986
-
[25]
Math- ematics of Operations Research19(4), 790–814 (1994)
Iusem, A.N., Svaiter, B.F., Teboulle, M.: Entropy-Like Proximal Methods in Convex Programming. Math- ematics of Operations Research19(4), 790–814 (1994). DOI 10.1287/moor.19.4.790
-
[26]
Bulletin International de l’Académie Polonaise des Sciences et des Lettres
Kaczmarz, S.: Angenäherte Auflösung von Systemen linearer Gleichungen. Bulletin International de l’Académie Polonaise des Sciences et des Lettres. Classe des Sciences Mathématiques et Naturelles. Série A 35, 355–357 (1937)
work page 1937
-
[27]
Canadian Journal of Mathematics 6, 393–404 (1954)
Motzkin, T.S., Schoenberg, I.J.: The Relaxation Method for Linear Inequalities. Canadian Journal of Mathematics 6, 393–404 (1954). DOI 10.4153/CJM-1954-038-x
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.