Pith. sign in

Spherical perceptron as a storage memory with limited errors

1 Pith paper cite this work. Polarity classification is still indexing.

1 Pith paper citing it
abstract

It has been known for a long time that the classical spherical perceptrons can be used as storage memories. Seminal work of Gardner, \cite{Gar88}, started an analytical study of perceptrons storage abilities. Many of the Gardner's predictions obtained through statistical mechanics tools have been rigorously justified. Among the most important ones are of course the storage capacities. The first rigorous confirmations were obtained in \cite{SchTir02,SchTir03} for the storage capacity of the so-called positive spherical perceptron. These were later reestablished in \cite{TalBook} and a bit more recently in \cite{StojnicGardGen13}. In this paper we consider a variant of the spherical perceptron that operates as a storage memory but allows for a certain fraction of errors. In Gardner's original work the statistical mechanics predictions in this directions were presented sa well. Here, through a mathematically rigorous analysis, we confirm that the Gardner's predictions in this direction are in fact provable upper bounds on the true values of the storage capacity. Moreover, we then present a mechanism that can be used to lower these bounds. Numerical results that we present indicate that the Garnder's storage capacity predictions may, in a fairly wide range of parameters, be not that far away from the true values.

citation-role summary

background 1

citation-polarity summary

fields

stat.ML 1

years

2024 1

verdicts

REJECT 1

roles

background 1

polarities

unclear 1

representative citing papers

Deep ReLU networks -- injectivity capacity upper bounds

stat.ML · 2024-12-27 · reject · novelty 6.0

For deep ReLU networks with random Gaussian weights, the paper gives upper bounds on the layer expansion needed for injectivity and finds the expansion need saturates by four layers.

citing papers explorer

Showing 1 of 1 citing paper.

  • Deep ReLU networks -- injectivity capacity upper bounds stat.ML · 2024-12-27 · reject · none · ref 70 · internal anchor

    For deep ReLU networks with random Gaussian weights, the paper gives upper bounds on the layer expansion needed for injectivity and finds the expansion need saturates by four layers.