REVIEW 5 minor 253 references
The OGD+Projection algorithm for constrained online convex optimization must incur cumulative constraint violation Ω(T^{(d-1)/(2d)}).
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · grok-4.5
2026-07-14 09:05 UTC pith:C4YBYFDQ
load-bearing objection First algorithm-specific CCV lower bound for OGD+Projection; clean packing construction that matches the known O(√T) upper bound for large d.
Lower Bound on the Cumulative Constrained Violation for the OGD+Projection algorithm for Constrained Online Convex Optimization (COCO)
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
There exists an instance of constrained online convex optimization of diameter 2D and Lipschitz constant G such that the OGD+Projection algorithm incurs cumulative constraint violation Ω(T^{(d-1)/(2d)}). The same instance keeps the usual O(√T) regret bound, so the algorithm cannot simultaneously achieve sub-√T CCV for every dimension.
What carries the argument
An ordered packing of unit vectors on the sphere S^{d-1} whose angular separation is at least ρ yet consecutive angles are at most A_d ρ, with cardinality Ω(ρ^{-(d-1)}). Scaled and rotated copies of this packing on concentric spheres of slowly shrinking radii produce nested half-space constraints that force a positive projection distance at each of Ω(T^{(d+1)/(2d)}) phase heads.
Load-bearing premise
The packing density can be made small enough that the total step-size budget inside each phase is still large enough to travel the short distance between successive points without exceeding the Lipschitz bound.
What would settle it
Exhibit either a packing whose consecutive angular gaps force the inter-point distance to exceed the available OGD budget for every packing constant, or an explicit input sequence on which OGD+Projection's realized CCV is o(T^{(d-1)/(2d)}).
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proves the first lower bound on cumulative constraint violation (CCV) for the OGD+Projection algorithm of Vaze and Sinha (2025) in constrained online convex optimization (COCO). After the learner plays x_t, convex losses f_t and constraints g_t are revealed; the goal is simultaneous static regret and CCV control relative to a fixed feasible benchmark. The authors construct an explicit adversarial instance on nested concentric spheres of radii r_m = 1 - (m-1)/(2M) with M = T^{1/d}. Using an inductive packing of unit vectors (Theorem 2) that are ρ-separated with local angular steps O(ρ) and cardinality Ω(ρ^{-(d-1)}), they place half-space constraints tangent to successive spheres and linear losses that force the algorithm along a trajectory of P = Θ(T^{(d+1)/(2d)}) phase heads. Each phase head incurs a projection distance Ω(T^{-1/d}), yielding CCV = Ω(T^{(d-1)/(2d)}) while the diameter and Lipschitz constants remain O(1). The packing constants A_d = 2^{d-1} and c_d = π^{d-1}/2^{d^{2}} are fully explicit.
Significance. The result is the first nontrivial lower bound for any algorithm in the COCO literature that matches the geometry-aware OGD+Projection method currently holding the best simultaneous regret/CCV upper bounds (O(√T) regret and O(T^{1/3}) CCV for d=2, O(√T) CCV for general d). It shows that the existing upper-bound analyses are not fundamentally loose and that dimension dependence is unavoidable for this algorithm. The construction is fully constructive, with machine-checkable inductive packing constants and an explicit forced trajectory; no free parameters are recovered after the fact. This supplies a concrete benchmark for future algorithms that might improve the CCV exponent.
minor comments (5)
- In the abstract and introduction the upper-bound citations (Balasundaram et al. 2026, Sarkar and Sinha 2026) appear as arXiv preprints; once they are published the bibliographic entries should be updated for archival permanence.
- Figure 2 caption states M=2 and D/(2M)=D/4, which is correct, but the figure itself is dense; a short sentence in the caption clarifying that only the first-layer half-space H_1^{(1)} is drawn would improve readability.
- Equation (51) uses the lower bound ∑ η_t ≥ 2(Δ-1)D/√T; a parenthetical remark that the same asymptotic holds for the exact harmonic sum would remove any residual doubt about the Ω notation.
- The constant B_d introduced after (50) is never given an explicit expression; stating B_d = A_d + 1 (or any convenient upper bound) would make the dependence on the packing constant fully transparent.
- Typographical: after (12) the symbol “˜ c_d” is written both with and without the tilde; consistent notation would help.
Circularity Check
No circularity: explicit adversarial construction yields the CCV lower bound without definitional reduction or load-bearing self-citation of the target claim.
full rationale
The paper proves Theorem 1 by constructing an explicit COCO instance (nested concentric spheres, angularly packed unit vectors from the self-contained inductive packing of Theorem 2, tangent half-spaces, and linear losses that force the OGD+Projection trajectory along the ordered points Z). Every quantitative step (projection distance D/(2M) at each of the P = Θ(T^{(d+1)/(2d)}) phase heads, existence of γ_t ∈ [0,G] covering ℓ_p after shrinking the free packing constant c̃_d, and the final summation giving Ω(T^{(d-1)/(2d)})) is derived from the geometry and the algorithm definition written out in (3). Self-citations supply only the algorithm name and prior upper bounds; they are not used to justify any step of the lower-bound argument. No quantity is defined in terms of the claimed exponent, no parameter is fitted to data and then re-predicted, and the packing constants A_d, c_d are obtained by a direct induction that does not presuppose the CCV bound. The derivation is therefore self-contained and free of circularity.
Axiom & Free-Parameter Ledger
free parameters (2)
- c̃_d (packing truncation constant)
- A_d, c_d (packing constants)
axioms (4)
- domain assumption Feasibility assumption: the intersection X* of all constraint sets is nonempty.
- domain assumption Losses and constraints are convex and G-Lipschitz; action set has diameter 2D.
- standard math Projection onto a closed convex set is non-expansive and unique; halfspace projection has closed form.
- ad hoc to paper On the unit sphere there exist ordered ρ-separated packings with local angular steps O(ρ) and cardinality Ω(ρ^{-(d-1)}).
read the original abstract
The problem of constrained online convex optimization is considered, where at each round, once a learner commits to an action $x_t \in \mathcal{X} \subset \mathbb{R}^d$, a convex loss function $f_t$ and a convex constraint function $g_t$ that drives the constraint $g_t(x)\le 0$ are revealed. The objective is to simultaneously minimize the static regret and cumulative constraint violation (CCV) compared to the benchmark that knows the loss functions and constraint functions $f_t$ and $g_t$ for all $t$ ahead of time, and chooses a static optimal action that is feasible with respect to all $g_t(x)\le 0$. Currently, the best known algorithm is OGD+Projection algorithm of [Vaze and Sinha, 2025] that has simultaneous regret of $O(\sqrt{T})$ and CCV of $O(T^{1/3})$ for $d=2$ [Balasundaram et al., 2026], and simultaneous regret of $O(\sqrt{T})$ and CCV of $O(\sqrt{T})$ for any $d$ [Sarkar and Sinha, 2026]. In this paper, we show that the CCV of the OGD+Projection algorithm is $\Omega (T^{\frac{d-1}{2d}})$. This is the first such lower bound result.
Figures
Reference graph
Works this paper leans on
-
[1]
1966 , publisher=
Convexity , author=. 1966 , publisher=
1966
-
[2]
Haricharan Balasundaram and Karthick Krishna Mahendran and Rahul Vaze , year=. Breaking the O(. 2603.20671 , archivePrefix=
-
[3]
2026 , eprint=
Improved Guarantees for Constrained Online Convex Optimization via Self-Contraction , author=. 2026 , eprint=
2026
-
[4]
2016 , eprint=
A Simple Proof of Cauchy's Surface Area Formula , author=. 2016 , eprint=
2016
-
[5]
The Thirty-eighth Annual Conference on Neural Information Processing Systems , year=
Optimal Algorithms for Online Convex Optimization with Adversarial Constraints , author=. The Thirty-eighth Annual Conference on Neural Information Processing Systems , year=
-
[6]
Rahul Vaze and Abhishek Sinha , year=. O(. 2502.05019 , archivePrefix=
-
[7]
2025 , publisher =
Vershynin, Roman , title =. 2025 , publisher =
2025
-
[8]
Geometriae Dedicata , volume=
Maximum length of steepest descent curves for quasi-convex functions , author=. Geometriae Dedicata , volume=. 1991 , publisher=
1991
-
[9]
Elad Hazan , title =. CoRR , volume =. 2019 , url =. 1909.05207 , timestamp =
Pith/arXiv arXiv 2019
-
[10]
Proceedings of Thirty Fifth Conference on Learning Theory , pages =
Realizable Learning is All You Need , author =. Proceedings of Thirty Fifth Conference on Learning Theory , pages =. 2022 , volume =
2022
-
[11]
GitHub repository , howpublished =
Abhishek Sinha , title =. GitHub repository , howpublished =. 2024 , publisher =
2024
-
[12]
Proceedings of the National Academy of Sciences , volume=
Reconciling modern machine-learning practice and the classical bias--variance trade-off , author=. Proceedings of the National Academy of Sciences , volume=. 2019 , publisher=
2019
-
[13]
Expert systems with applications , volume=
Learned lessons in credit card fraud detection from a practitioner perspective , author=. Expert systems with applications , volume=. 2014 , note =
2014
-
[14]
A low complexity algorithm with O(
Yu, Hao and Neely, Michael J , journal=. A low complexity algorithm with O(
-
[15]
On Dynamic Regret and Constraint Violations in Constrained Online Convex Optimization , year=
Vaze, Rahul , booktitle=. On Dynamic Regret and Constraint Violations in Constrained Online Convex Optimization , year=
-
[16]
IEEE Transactions on automatic control , volume=
Online convex optimization with time-varying constraints and bandit feedback , author=. IEEE Transactions on automatic control , volume=. 2018 , publisher=
2018
-
[17]
IEEE Internet of Things Journal , volume=
Bandit convex optimization for scalable and dynamic IoT management , author=. IEEE Internet of Things Journal , volume=. 2018 , publisher=
2018
-
[18]
Proceedings of the Twenty-Ninth Annual ACM-SIAM Symposium on Discrete Algorithms , pages=
Nested convex bodies are chaseable , author=. Proceedings of the Twenty-Ninth Annual ACM-SIAM Symposium on Discrete Algorithms , pages=. 2018 , organization=
2018
-
[19]
Proceedings of the Symposium on the Mathematical Theory of Automata , volume=
On convergence proofs on perceptrons , author=. Proceedings of the Symposium on the Mathematical Theory of Automata , volume=. 1962 , organization=
1962
-
[20]
Journal of optimization theory and applications , volume=
Subgradient methods for saddle-point problems , author=. Journal of optimization theory and applications , volume=. 2009 , publisher=
2009
-
[21]
IEEE Transactions on Automatic Control , year=
Regret and cumulative constraint violation analysis for distributed online constrained convex optimization , author=. IEEE Transactions on Automatic Control , year=
-
[22]
Nature , volume=
Dense reinforcement learning for safety validation of autonomous vehicles , author=. Nature , volume=. 2023 , publisher=
2023
-
[23]
Optimization for machine learning , pages=
The convex optimization approach to regret minimization , author=. Optimization for machine learning , pages=. 2012 , publisher=
2012
-
[24]
1967 , publisher=
Convex polytopes , author=. 1967 , publisher=
1967
-
[25]
Proceedings of the Thirtieth Annual ACM-SIAM Symposium on Discrete Algorithms , pages=
A nearly-linear bound for chasing nested convex bodies , author=. Proceedings of the Thirtieth Annual ACM-SIAM Symposium on Discrete Algorithms , pages=. 2019 , organization=
2019
-
[26]
Proceedings of the Fourteenth Annual ACM-SIAM Symposium on Discrete Algorithms , pages=
Chasing nested convex bodies nearly optimally , author=. Proceedings of the Fourteenth Annual ACM-SIAM Symposium on Discrete Algorithms , pages=. 2020 , organization=
2020
-
[27]
IEEE INFOCOM 2019-IEEE Conference on Computer Communications , pages=
Learning to Cache With No Regrets , author=. IEEE INFOCOM 2019-IEEE Conference on Computer Communications , pages=. 2019 , organization=
2019
-
[28]
2012 , publisher=
The Borel-Cantelli Lemma , author=. 2012 , publisher=
2012
-
[29]
Kingma and Jimmy Ba , editor =
Diederik P. Kingma and Jimmy Ba , editor =. Adam:. 3rd International Conference on Learning Representations,. 2015 , url =
2015
-
[30]
2008 , publisher=
Control techniques for complex networks , author=. 2008 , publisher=
2008
-
[31]
, author=
Adaptive subgradient methods for online learning and stochastic optimization. , author=. Journal of machine learning research , volume=
-
[32]
International Conference on Machine Learning , pages=
Regret and cumulative constraint violation analysis for online convex optimization with long term constraints , author=. International Conference on Machine Learning , pages=. 2021 , organization=
2021
-
[33]
arXiv preprint arXiv:1706.05098 , year=
An overview of multi-task learning in deep neural networks , author=. arXiv preprint arXiv:1706.05098 , year=
-
[34]
2015 , publisher=
Random processes for engineers , author=. 2015 , publisher=
2015
-
[35]
Advances in Neural Information Processing Systems , volume=
Online convex optimization with hard constraints: Towards the best of two worlds and beyond , author=. Advances in Neural Information Processing Systems , volume=
-
[36]
Advances in Neural Information Processing Systems , volume=
Adaptive smoothed online multi-task learning , author=. Advances in Neural Information Processing Systems , volume=
-
[37]
International Conference on Computational Learning Theory , pages=
Online multitask learning , author=. International Conference on Computational Learning Theory , pages=. 2006 , organization=
2006
-
[38]
Rockafellar, R. Tyrrel. Convex Analysis
-
[39]
Electronic colloquium on computational complexity (ECCC) , volume=
Adaptive algorithms for online decision problems , author=. Electronic colloquium on computational complexity (ECCC) , volume=
-
[40]
Artificial Intelligence and Statistics , pages=
Improved strongly adaptive online learning using coin betting , author=. Artificial Intelligence and Statistics , pages=. 2017 , organization=
2017
-
[41]
Theoretical Computer Science , volume=
Scale-free online learning , author=. Theoretical Computer Science , volume=. 2018 , publisher=
2018
-
[42]
International Conference on Machine Learning , pages=
A simple yet universal strategy for online convex optimization , author=. International Conference on Machine Learning , pages=. 2022 , organization=
2022
-
[43]
Machine learning , volume=
Regret bounded by gradual variation for online convex optimization , author=. Machine learning , volume=. 2014 , publisher=
2014
-
[44]
Proceedings of the AAAI Conference on Artificial Intelligence , volume=
Delay-tolerant online convex optimization: Unified analysis and adaptive-gradient algorithms , author=. Proceedings of the AAAI Conference on Artificial Intelligence , volume=
-
[45]
International Conference on Machine Learning , pages=
Adaptive regret of convex and smooth functions , author=. International Conference on Machine Learning , pages=. 2019 , organization=
2019
-
[46]
International Conference on Machine Learning , pages=
Cautious regret minimization: Online optimization with long-term budget constraints , author=. International Conference on Machine Learning , pages=. 2019 , organization=
2019
-
[47]
Proceedings of the 36th International Conference on Machine Learning , pages =
Cautious Regret Minimization: Online Optimization with Long-Term Budget Constraints , author =. Proceedings of the 36th International Conference on Machine Learning , pages =. 2019 , editor =
2019
-
[48]
2003 , publisher=
Applied probability and queues , author=. 2003 , publisher=
2003
-
[49]
The Journal of Machine Learning Research , volume=
Trading regret for efficiency: online convex optimization with long term constraints , author=. The Journal of Machine Learning Research , volume=. 2012 , publisher=
2012
-
[50]
International Conference on Machine Learning , pages=
Safety-aware algorithms for adversarial contextual bandit , author=. International Conference on Machine Learning , pages=. 2017 , organization=
2017
-
[51]
Proceedings of the 34th International Conference on Machine Learning , pages =
Safety-Aware Algorithms for Adversarial Contextual Bandit , author =. Proceedings of the 34th International Conference on Machine Learning , pages =. 2017 , editor =
2017
-
[52]
ACM SIGMETRICS Performance Evaluation Review , volume=
Simultaneously achieving sublinear regret and constraint violations for online convex optimization with time-varying constraints , author=. ACM SIGMETRICS Performance Evaluation Review , volume=. 2022 , publisher=
2022
-
[53]
arXiv preprint arXiv:2306.00149 , year=
Distributed Online Convex Optimization with Adversarial Constraints: Reduced Cumulative Constraint Violation Bounds under Slater's Condition , author=. arXiv preprint arXiv:2306.00149 , year=
-
[54]
A Low Complexity Algorithm with O (
Yu, Hao and Neely, Michael J , journal=. A Low Complexity Algorithm with O (
-
[55]
29th IEEE Conference on Decision and Control , pages=
Stability properties of constrained queueing systems and scheduling policies for maximum throughput in multihop radio networks , author=. 29th IEEE Conference on Decision and Control , pages=. 1990 , organization=
1990
-
[56]
IEEE Transactions on Communications , volume=
Achieving 100\ author=. IEEE Transactions on Communications , volume=. 1999 , publisher=
1999
-
[57]
1992 , publisher=
Integral inequalities and applications , author=. 1992 , publisher=
1992
-
[58]
arXiv preprint arXiv:1702.04783 , year=
Online convex optimization with time-varying constraints , author=. arXiv preprint arXiv:1702.04783 , year=
-
[59]
, author=
Online Learning with Sample Path Constraints. , author=. Journal of Machine Learning Research , volume=
-
[60]
Advances in Neural Information Processing Systems , volume=
Online convex optimization with stochastic constraints , author=. Advances in Neural Information Processing Systems , volume=
-
[61]
International Conference on Machine Learning , pages=
Adaptive algorithms for online convex optimization with long-term constraints , author=. International Conference on Machine Learning , pages=. 2016 , organization=
2016
-
[62]
Advances in Neural Information Processing Systems , volume=
Online convex optimization for cumulative constraints , author=. Advances in Neural Information Processing Systems , volume=
-
[63]
2022 20th International Symposium on Modeling and Optimization in Mobile, Ad hoc, and Wireless Networks (WiOpt) , pages=
On Dynamic Regret and Constraint Violations in Constrained Online Convex Optimization , author=. 2022 20th International Symposium on Modeling and Optimization in Mobile, Ad hoc, and Wireless Networks (WiOpt) , pages=. 2022 , organization=
2022
-
[64]
Advances in neural information processing systems , volume=
Adaptive online gradient descent , author=. Advances in neural information processing systems , volume=
-
[65]
Advances in Neural Information Processing Systems , volume=
Queue Up Your Regrets: Achieving the Dynamic Capacity Region of Multiplayer Bandits , author=. Advances in Neural Information Processing Systems , volume=
-
[66]
Sinha, Abhishek , booktitle=. Bandit. 2024 , organization=
2024
-
[67]
Mathematical Proceedings of the Cambridge Philosophical Society , volume=
The theory of queues with a single server , author=. Mathematical Proceedings of the Cambridge Philosophical Society , volume=. 1952 , organization=
1952
-
[68]
Proceedings of the AAAI Conference on Artificial Intelligence , volume=
Achieving Counterfactual Fairness for Causal Bandit , author=. Proceedings of the AAAI Conference on Artificial Intelligence , volume=
-
[69]
Advances in Neural Information Processing Systems , volume=
Fair algorithms for multi-agent multi-armed bandits , author=. Advances in Neural Information Processing Systems , volume=
-
[70]
Advances in neural information processing systems , volume=
Metric-free individual fairness in online learning , author=. Advances in neural information processing systems , volume=
-
[71]
Advances in neural information processing systems , volume=
Online learning with an unknown fairness metric , author=. Advances in neural information processing systems , volume=
-
[72]
1953 , publisher=
Stochastic processes , author=. 1953 , publisher=
1953
-
[73]
A sharp inequality for sub-martingales and stopping-times , author=. Ast
-
[74]
Foundations and Trends
Regret analysis of stochastic and nonstochastic multi-armed bandit problems , author=. Foundations and Trends. 2012 , publisher=
2012
-
[75]
Abhishek Sinha and Rahul Vaze , year=. Beyond. 2505.06709 , archivePrefix=
-
[76]
, booktitle=
Hsu, Wei-Kang and Xu, Jiaming and Lin, Xiaojun and Bell, Mark R. , booktitle=. Integrating Online Learning and Adaptive Control in Queueing Systems with Uncertain Payoffs , year=
-
[77]
Communications of the ACM , volume=
Discrimination in online ad delivery , author=. Communications of the ACM , volume=. 2013 , publisher=
2013
-
[78]
Proceedings of the conference on fairness, accountability, and transparency , pages=
Controlling polarization in personalization: An algorithmic framework , author=. Proceedings of the conference on fairness, accountability, and transparency , pages=
-
[79]
IEEE INFOCOM 2018-IEEE Conference on Computer Communications , pages=
An online learning approach to network application optimization with guarantee , author=. IEEE INFOCOM 2018-IEEE Conference on Computer Communications , pages=. 2018 , organization=
2018
-
[80]
IEEE Transactions on Network Science and Engineering , volume=
Combinatorial sleeping bandits with fairness constraints , author=. IEEE Transactions on Network Science and Engineering , volume=. 2019 , publisher=
2019
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.