REVIEW 2 cited by
Semi-analytical approximations to statistical moments of sigmoid and softmax mappings of normal variables
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
This note is concerned with accurate and computationally efficient approximations of moments of Gaussian random variables passed through sigmoid or softmax mappings. These approximations are semi-analytical (i.e. they involve the numerical adjustment of parametric forms) and highly accurate (they yield 5% error at most). We also highlight a few niche applications of these approximations, which arise in the context of, e.g., drift-diffusion models of decision making or non-parametric data clustering approaches. We provide these as examples of efficient alternatives to more tedious derivations that would be needed if one was to approach the underlying mathematical issues in a more formal way. We hope that this technical note will be helpful to modellers facing similar mathematical issues, although maybe stemming from different academic prospects.
Forward citations
Cited by 2 Pith papers
-
Calibrated Sampling-Free Uncertainty Estimation in Bayesian Deep Learning
CVP extends variance propagation to normalization layers and activations then adds light calibration to match Monte Carlo sampling accuracy at much lower cost on transformers and CNNs.
-
Training of Spiking Neural Networks with Expectation-Propagation
An Expectation-Propagation framework trains spiking neural networks with mini-batches, supporting discrete or continuous weights and deterministic or stochastic spiking, and returns approximate posterior uncertainties.
Discussion (0). Continue with ORCID to comment.