A variational potential gives both a lower and an upper bound on the quenched pressure of a perceptron, with matching supported numerically for logistic-type losses.
Strong replica symmetry for high-dimensional disordered log-concave Gibbs measures
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
We consider a generic class of log-concave, possibly random, (Gibbs) measures. We prove the concentration of an infinite family of order parameters called multioverlaps. Because they completely parametrise the quenched Gibbs measure of the system, this implies a simple representation of the asymptotic Gibbs measures, as well as the decoupling of the variables in a strong sense. These results may prove themselves useful in several contexts. In particular in machine learning and high-dimensional inference, log-concave measures appear in convex empirical risk minimisation, maximum a-posteriori inference or M-estimation. We believe that they may be applicable in establishing some type of "replica symmetric formulas" for the free energy, inference or generalisation error in such settings.
citation-role summary
citation-polarity summary
fields
cs.LG 1years
2026 1verdicts
CONDITIONAL 1roles
background 1polarities
support 1representative citing papers
citing papers explorer
-
Variational Bounds for Perceptron Learning from Structured Data
A variational potential gives both a lower and an upper bound on the quenched pressure of a perceptron, with matching supported numerically for logistic-type losses.