REVIEW 3 cited by
PQMass: Probabilistic Assessment of the Quality of Generative Models using Probability Mass Estimation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We propose a likelihood-free method for comparing two distributions given samples from each, with the goal of assessing the quality of generative models. The proposed approach, PQMass, provides a statistically rigorous method for assessing the performance of a single generative model or the comparison of multiple competing models. PQMass divides the sample space into non-overlapping regions and applies chi-squared tests to the number of data samples that fall within each region, giving a p-value that measures the probability that the bin counts derived from two sets of samples are drawn from the same multinomial distribution. PQMass does not depend on assumptions regarding the density of the true distribution, nor does it rely on training or fitting any auxiliary models. We evaluate PQMass on data of various modalities and dimensions, demonstrating its effectiveness in assessing the quality, novelty, and diversity of generated samples. We further show that PQMass scales well to moderately high-dimensional data and thus obviates the need for feature extraction in practical applications.
Forward citations
Cited by 3 Pith papers
-
Random Initialization Can't Catch Up: The Advantage of Language Model Transfer for Time Series Forecasting
Pretrained T5 language weights give a persistent validation-loss advantage over random initialization for low-data time series forecasting, and the advantage does not vanish within the training budget.
-
Machine Learning and the SKA for Cosmic Dawn and the Epoch of Reionization
A multi-author overview of machine-learning algorithms proposed for instrument modelling, data analysis, simulation and inference in SKA Cosmic Dawn and Epoch of Reionization science.
-
An Introduction to Bayesian and Frequentist Simulation-Based Inference with Machine Learning
A structured introduction to ML-based simulation-based inference, contrasting Bayesian and frequentist frameworks and covering parameter inference, unfolding, and validation.
Discussion (0). Continue with ORCID to comment.