The reviewed record of science sign in
Pith

arxiv: 2311.14627 · v4 · pith:PIBV4OFP · submitted 2023-11-24 · math.OC

A new use of the Kurdyka-Lojasiewicz property to study asymptotic behaviours of some stochastic optimization algorithms in a non-convex differentiable framework

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:PIBV4OFPrecord.jsonopen to challenge →

classification math.OC
keywords stochasticasymptoticconditiondescentframeworkkurdyka-lojasiewicznon-convexoptimization
0
0 comments X
read the original abstract

The asymptotic analysis of a generic stochastic optimization algorithm mainly relies on the establishment of a specific descent condition. While the convexity assumption allows for technical shortcuts and generally leads to strict convergence, dealing with the non-convex framework, on the contrary, requires the use of specific results as those relying on the Kurdyka-Lojasiewicz (KL) theory. While such tools have become popular in the field of deterministic optimisation, they are much less widespread in the stochastic context and, in this case, the few works making use of them are essentially based on trajectory-by-trajectory approaches. In this paper, we propose a new methodology, also based on KL theory, for deeper asymptotic investigations on a stochastic scheme verifying a descent condition. The specificity of our work is here to be of macroscopic nature insofar as our strategy of proof is more in-expectation-based and therefore seems more natural typically with respect to the noise properties, of conditional order, encountered in the stochastic literature nowadays.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.