REVIEW 6 cited by
Density Modeling of Images using a Generalized Normalization Transformation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Density Modeling of Images using a Generalized Normalization Transformation
read the original abstract
We introduce a parametric nonlinear transformation that is well-suited for Gaussianizing data from natural images. The data are linearly transformed, and each component is then normalized by a pooled activity measure, computed by exponentiating a weighted sum of rectified and exponentiated components and a constant. We optimize the parameters of the full transformation (linear transform, exponents, weights, constant) over a database of natural images, directly minimizing the negentropy of the responses. The optimized transformation substantially Gaussianizes the data, achieving a significantly smaller mutual information between transformed components than alternative methods including ICA and radial Gaussianization. The transformation is differentiable and can be efficiently inverted, and thus induces a density model on images. We show that samples of this model are visually similar to samples of natural image patches. We demonstrate the use of the model as a prior probability density that can be used to remove additive noise. Finally, we show that the transformation can be cascaded, with each layer optimized using the same Gaussianization objective, thus offering an unsupervised method of optimizing a deep network architecture.
Forward citations
Cited by 6 Pith papers
-
Density estimation using Real NVP
Real NVP uses affine coupling layers to create invertible transformations that support exact density estimation, sampling, and latent inference without approximations.
-
Hadamard-Domain Model Quantization for Learned Image Coding
Uniform INT8 quantization of learned image codecs becomes more accurate when tensors are first re-expressed in a layer-adaptive Hadamard basis.
-
LANCE: Locally Adaptive Neural Context Estimation for Overfitted Image Compression
LANCE extends OIC frameworks with a spatial hyperprior and predictive coding scheme, reporting BD-rate gains of 1.4-3% over Cool-Chic 4.0 on Kodak and CLIC.
-
ConjNorm: Tractable Density Estimation for Out-of-Distribution Detection
ConjNorm reframes OOD detection score design as optimizing norm p in an exponential family density model via a Bregman divergence theorem, with a tractable Monte Carlo estimator, claiming SOTA gains on CIFAR-100 and I...
-
LANCE: Locally Adaptive Neural Context Estimation for Overfitted Image Compression
A spatial hyperprior compressed by MED plus a tiny learned context model conditions Cool-Chic-style entropy models and yields 1.4–3% BD-rate gains at 606–1481 MAC/pixel.
-
A Compact Hybrid Convolution--Frequency State Space Network for Learned Image Compression
HCFSSNet uses convolutional layers plus a Vision Frequency State Space block with omni-directional scanning and frequency reweighting to reach competitive rate-distortion performance in learned image compression.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.