Pith. sign in

REVIEW 8 cited by

Pareto Smoothed Importance Sampling

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1507.02646 v9 pith:BLSOTXIB submitted 2015-07-09 stat.CO stat.MEstat.ML

classification stat.COstat.MEstat.ML
keywords importancedistributionestimatescarlomonteparetoratiosconvergence
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
abstract

Importance weighting is a general way to adjust Monte Carlo integration to account for draws from the wrong distribution, but the resulting estimate can be highly variable when the importance ratios have a heavy right tail. This routinely occurs when there are aspects of the target distribution that are not well captured by the approximating distribution, in which case more stable estimates can be obtained by modifying extreme importance ratios. We present a new method for stabilizing importance weights using a generalized Pareto distribution fit to the upper tail of the distribution of the simulated importance ratios. The method, which empirically performs better than existing methods for stabilizing importance sampling estimates, includes stabilized effective sample size estimates, Monte Carlo error estimates, and convergence diagnostics. The presented Pareto $\hat{k}$ finite sample convergence rate diagnostic is useful for any Monte Carlo estimator.

Discussion (0). Sign in to comment.

Forward citations

Cited by 8 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Indirect Variational Inference: Applications to Earnings Dynamics

    econ.GN 2026-07 conditional novelty 7.0 of 10

    Indirect variational inference treats a variational approximation as an auxiliary model and inverts its binding function, correcting the bias of variational estimates in nonlinear earnings dynamics.

  2. Rapid Hubble constant inference from GW170817 using GPU-accelerated nested sampling: prior sensitivity and the limits of post-hoc reweighting

    astro-ph.CO 2026-06 accept novelty 6.5 of 10

    Direct sampling under a uniform-in-dL prior raises P(H0>120) from 0.017 to 0.159 for GW170817; post-hoc reweighting recovers only 0.041 because a low-dL mode is undersampled.

  3. On the Eccentricity Distribution and Tidal Evolution of Transiting Brown Dwarfs

    astro-ph.EP 2026-07 conditional novelty 6.0 of 10

    Short-period (P<16 d) transiting brown dwarfs are low-eccentricity while longer-period ones are more excited; assuming a shared primordial Beta distribution, tidal evolution constrains Q_BD ≈ 10^{7.1–8.1}.

  4. Rapid Hubble constant inference from GW170817 using GPU-accelerated nested sampling: prior sensitivity and the limits of post-hoc reweighting

    astro-ph.CO 2026-06 accept novelty 6.0 of 10

    GPU-accelerated nested sampling on GW170817 demonstrates that switching to a uniform-in-dL prior shifts the H0 tail and median far more than post-hoc reweighting captures, due to an under-sampled (dL, iota) bimodality.

  5. pop-cosmos: Disentangling galaxy properties from observables using data-driven approaches

    astro-ph.GA 2026-06 conditional novelty 6.0 of 10

    Rest-frame optical galaxy SEDs from a 16-parameter SPS model are captured by five disentangled VAE latents (mass, young stars, dust, soft/hard ionization); metallicity and age are not independent drivers.

  6. pop-cosmos: Disentangling galaxy properties from observables using data-driven approaches

    astro-ph.GA 2026-06 unverdicted novelty 6.0 of 10

    A beta-VAE analysis of pop-cosmos models finds that five latent dimensions capture the rest-frame optical SED, corresponding to stellar mass, recent star formation, dust, and two gas ionization states.

  7. A parameterization of anisotropic Gaussian fields with penalized complexity priors

    stat.ME 2024-09 unverdicted novelty 6.0 of 10

    New smooth invertible parameterization of anisotropic GF correlation length and diffusion matrix, with PC priors that penalize finite range and nonzero anisotropy for constant-parameter models.

  8. pop-cosmos: Galaxy size evolution across structural and star-formation classifications in COSMOS-Web

    astro-ph.GA 2026-06 unverdicted novelty 5.0 of 10

    Galaxy size-mass relations exhibit double power-law breaks at different pivot masses for quiescent versus bulge-dominated samples, coinciding with AGN activity scales.

Pith tools