REVIEW
Sacrificial Learning in Nonlinear Perceptrons
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Sacrificial Learning in Nonlinear Perceptrons
read the original abstract
Using the cavity method we consider the learning of noisy teacher-generated examples by a nonlinear student perceptron. For insufficient examples and weak weight decay, the activation distribution of the training examples exhibits a gap for the more difficult examples. This illustrates that the outliers are sacrificed for the overall performance. Simulation shows that the picture of the smooth energy landscape cannot describe the gapped distributions well, implying that a rough energy landscape may complicate the learning process.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.