Pith. sign in

REVIEW 1 cited by

Maximum Entropy Auto-Encoding

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2104.07448 v1 pith:SBQXZM64 submitted 2021-04-13 cs.LG

classification cs.LG
keywords reconstructionentropymaximumnetworkoptimalauto-encoderinputmean
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

In this paper, it is shown that an auto-encoder using optimal reconstruction significantly outperforms a conventional auto-encoder. Optimal reconstruction uses the conditional mean of the input given the features, under a maximum entropy prior distribution. The optimal reconstruction network, which is called deterministic projected belied network (D-PBN), resembles a standard reconstruction network, but with special non-linearities that mist be iteratively solved. The method, which can be seen as a generalization of maximum entropy image reconstruction, extends to multiple layers. In experiments, mean square reconstruction error reduced by up to a factor of two. The performance improvement diminishes for deeper networks, or for input data with unconstrained values (Gaussian assumption).

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. The model is the message: Lightweight convolutional autoencoders applied to noisy imaging data for planetary science and astrobiology

    astro-ph.EP 2025-07 conditional novelty 4.0 of 10

    A simple convolutional autoencoder reconstructs planetary images with up to 99% pixel loss, and the author argues its latent space could be a more efficient data product than raw imagery.

Pith tools