Pith. sign in

REVIEW 2 cited by

Tikhonov regularization of monotone operator flows not only ensures strong convergence of the trajectories but also speeds up the vanishing of the residuals

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2406.00852 v4 pith:QB323KLK submitted 2024-06-02 math.OC

classification math.OC
keywords convergenceoperatorpointregularizationmonotonefixedratestikhonov
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
abstract

In the framework of real Hilbert spaces, we investigate first-order dynamical systems governed by monotone and continuous operators. We demonstrate that when the monotone operator flow is augmented with a Tikhonov regularization term, the resulting trajectory converges strongly to the element of the set of zeros with minimal norm. In addition, rates of convergence in norm for the trajectory's velocity and the operator along the trajectory can be derived in terms of the regularization function. In some particular cases, these rates of convergence can outperform the ones of the coercive operator flows and can be as fast as $O(\frac{1}{t})$ as $t \rightarrow +\infty$. In this way, we emphasize a surprising acceleration feature of the Tikhonov regularization. Additionally, we explore these properties for monotone operator flows that incorporate time rescaling and an anchor point and show that they are closely linked to second-order dynamics with a vanishing damping term. The convergence and convergence rate results we achieve for these systems complement recent findings for the Fast Optimistic Gradient Descent Ascent (OGDA) dynamics. When the monotone operator is defined as the identity minus a nonexpansive operator, the monotone equations transform into a fixed point problem. In such cases, explicitly discretizing the system with Tikhonov regularization, enhanced by an anchor point, leads to the Halpern fixed point iteration. We identify two regimes for the regularization sequence which ensure that the generated sequence of iterates converges strongly to the fixed point nearest to the anchor point. Furthermore, we establish a general theoretical framework that provides convergence rates for the vanishing of the discrete velocity and the fixed point residual. For certain regularization sequences, we derive specific convergence rates that align with those observed in continuous time.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Strong convergence and fast rates for systems with Tikhonov regularization

    math.OC 2024-11 conditional novelty 6.0 of 10

    A Tikhonov-regularized, Newton-type second-order dynamics converges strongly to the minimal-norm solution of a monotone equation with rates of order O(t^{-2+delta}) for the residual when parameters are chosen near the...

  2. Asymptotic behavior of the Arrow-Hurwicz differential system with Tikhonov regularization

    math.OC 2024-11 accept novelty 5.0 of 10

    Under two decay conditions on the Tikhonov parameter, Arrow-Hurwicz trajectories converge strongly to the least-norm saddle point with O(e^{-2ρ}+ε²) rates for velocity, primal-dual gap, and residual.

Pith tools