REVIEW 55 cited by
Validating Bayesian Inference Algorithms with Simulation-Based Calibration
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Validating Bayesian Inference Algorithms with Simulation-Based Calibration
read the original abstract
Verifying the correctness of Bayesian computation is challenging. This is especially true for complex models that are common in practice, as these require sophisticated model implementations and algorithms. In this paper we introduce \emph{simulation-based calibration} (SBC), a general procedure for validating inferences from Bayesian algorithms capable of generating posterior samples. This procedure not only identifies inaccurate computation and inconsistencies in model implementations but also provides graphical summaries that can indicate the nature of the problems that arise. We argue that SBC is a critical part of a robust Bayesian workflow, as well as being a useful tool for those developing computational algorithms and statistical software.
Forward citations
Cited by 55 Pith papers
-
Prior laundering: learned priors with inherited, undetectable overconfidence
Training a learned prior on legacy reconstructions equals one EM step of the old regularizer, freezing its belief on the operator's blind subspace and yielding overconfident, measurement-undetectable uncertainty.
-
Calibration, Not Compilation: Detecting and Repairing Misspecified Probabilistic Programs Written by Language Models
Bayesian workflow diagnostics outperform unit tests for detecting and repairing statistically misspecified LLM-generated probabilistic programs across benchmarks and real generation tasks.
-
Dark Matter in Draco and Bo\"otes I: Hints of a Core in an Ultra-Faint Dwarf from Simulation-Based Inference
GraphNPE recovers a significantly lower central density for Boötes I consistent with a core while Draco remains marginally cuspy, and demonstrates that higher-order velocity moments reduce bias in dynamical modeling.
-
One Generator, Any Process: LLM-Conditioning for the LHC
LLM embeddings condition generative networks for LHC events, yielding faster convergence, higher quality, and generalization to unseen processes.
-
Conditional Model-Adequacy Tests for Spectral Uncertainty Claims in Lattice QCD
Introduces target-wise model-adequacy tests on Euclidean-admissible mock correlators to evaluate coverage properties of reported spectral uncertainties in lattice QCD reconstructions.
-
Mixed neural posterior estimation for simulators with discrete and continuous parameters
Extends NPE to mixed discrete-continuous parameter spaces via a factorized inference network combining an autoregressive classifier and generative model, trained jointly to yield accurate calibrated posteriors.
-
A Simulation Based Inference Approach to Modelling of Type Ia Supernova Populations
A simulation-based inference pipeline (Stjörnumál) fits SN Ia dust and intrinsic scatter models to DES 5-year data, enabling fast Bayesian model comparison across seven SN Ia population models.
-
Hierarchical Bayesian inference with compositional score modeling for stellar streams
Combining three stellar streams and the rotation curve with compositional score modeling yields a posterior for the Milky Way potential—mildly oblate inner halo—but the underlying simulator fails a misspecification test.
-
Program Synthesis for Simulation-Based Inference: Joint Model Selection and Parameter Estimation
An LLM proposes simulator programs and neural simulation-based inference ranks them, enabling joint model selection and parameter estimation.
-
Neural Posterior Estimation for Inferring Weak Lensing Shear
Neural posterior estimation recovers accurate, well-calibrated constant-shear posteriors from simulated multiband images that include blending, variable PSFs, stars, and detector artifacts.
-
The Three Hundred Project: Validating $H_0$ inference from mock X-ray and millimetre analyses of galaxy clusters
Simulation-informed priors on cluster morphology biases yield unbiased H0 estimates at 1.5% precision from 1000 mock X-ray/SZ cluster observations, with a systematic floor of 0.6–0.8 km/s/Mpc.
-
The Three Hundred Project: Validating $H_0$ inference from mock X-ray and millimetre analyses of galaxy clusters
Simulation-based priors that depend on cluster morphology allow mock X-ray/SZ cluster samples to recover the input Hubble constant with 4% (100 clusters) and 1.5% (1000 clusters) precision plus a systematic floor of 0...
-
Search for strong lensing of gravitational waves in the binary black hole events from O1-O4a
Posterior Overlap 2.0 finds no lensed BBH pairs in O1–O4a (p_L < 0.6% for all pairs) and sets a 90% upper bound of 1.4% on the strong-lensing fraction.
-
Simulation-Based Inference for Cluster Cosmology with Set-Based Neural Network Architectures
SBI framework with GNN-on-sets and masked autoregressive flow recovers input cosmologies from eRASS1 mocks at 11.5% precision on Ω_m and 4.4% on σ_8 using 3259 clusters.
-
One Generator, Any Process: LLM-Conditioning for the LHC
LLM embeddings condition a generative transformer to enable faster convergence, better performance, and generalization to unseen LHC processes using a single model.
-
To select or not to select: predictively consistent priors instead of model selection
Predictively consistent priors let complex Bayesian models match or beat the out-of-sample performance of selected simpler models across linear, logistic, and nonlinear examples without explicit selection.
-
smoothbp: Fast Bayesian Hierarchical Piecewise Regression with Smoothed Transitions and Spike-and-Slab Model Selection
smoothbp is an R package implementing fast Bayesian hierarchical piecewise regression with logistic smoothing, random effects, and spike-and-slab breakpoint selection via a custom Metropolis-within-Gibbs sampler in Rust.
-
pop-cosmos: Disentangling galaxy properties from observables using data-driven approaches
Rest-frame optical galaxy SEDs from a 16-parameter SPS model are captured by five disentangled VAE latents (mass, young stars, dust, soft/hard ionization); metallicity and age are not independent drivers.
-
pop-cosmos: Disentangling galaxy properties from observables using data-driven approaches
A beta-VAE analysis of pop-cosmos models finds that five latent dimensions capture the rest-frame optical SED, corresponding to stellar mass, recent star formation, dust, and two gas ionization states.
-
Amortized Simulation-Based Inference of Colliding-Wind Binaries from Short, Noisy Image Time Series
Amortized SBI with spatio-temporal embeddings infers seven CWB parameters from 10-frame Hα time series with well-calibrated posteriors on synthetic data.
-
Amortized Simulation-Based Inference of Colliding-Wind Binaries from Short, Noisy Image Time Series
A neural spline-flow posterior estimator with a factorized spatio-temporal encoder recovers mass-loss rates and orbital parameters of colliding-wind binaries from 10-frame synthetic Hα photon-count time series.
-
Learning the Universe: Posterior Reliability of Neural Generative Models in High-Dimensional Field-Level Inference of Cosmic Initial Conditions
Generative models for cosmological field-level inference can reproduce posterior means and cross-correlations yet fail to capture correct uncertainty geometry when validated against HMC reference samples.
-
GenSBI: Generative Methods for Simulation-Based Inference in JAX
GenSBI delivers JAX-native implementations of generative SBI methods with transformer backbones and reports near-ideal calibration scores on standard benchmarks.
-
Pointwise Metrics Mislead: An Evaluation Protocol for Multimodal Inverse Problems
Pointwise metrics compress marginal spectra in multimodal inverse problems, and a three-part protocol using CRPS, spectrum fidelity, and calibration reverses model rankings on synthetic and particle-physics benchmarks.
-
Inferring infectiousness: a joint model of the within-host viral kinetics of SARS-CoV-2
Bayesian joint model infers infectious virus shedding trajectories and derived infectiousness metrics from PCR and other proxies in SARS-CoV-2 using data from five cohorts of roughly 2000 infections.
-
Information-Preserving Domain Transfer with Unlabeled Data in Misspecified Simulation-Based Inference
SPIN improves posterior inference under model misspecification in SBI by learning parameter-relevant information-preserving domain transfers from unpaired unlabeled real-world data.
-
Information-Preserving Domain Transfer with Unlabeled Data in Misspecified Simulation-Based Inference
SPIN performs bidirectional domain transfer in SBI to retain parameter mutual information from unlabeled real observations, improving real-world posterior inference under increasing misspecification.
-
Overcoming Selection Bias in Statistical Studies With Amortized Bayesian Inference
Embedding selection mechanisms into generative simulators enables amortized Bayesian inference to produce debiased, well-calibrated posteriors without tractable likelihoods.
-
Combining simulation-based inference and universal relations for precise and accurate neutron star science
A machine-learning simulator trained on 1,491 simulated equations of state discovers a neutron-star radius relation R(M,f,p1), predicting radii to tens of meters with calibrated error bars.
-
Quantifying Weighted Morphological Content of Large-Scale Structures via Simulation-Based Inference
Simulation-based inference on Big Sobol Sequence halos at z=0.5 shows CMD+MFs improves σ8 and Ωm precision by ~27% over MFs alone and outperforms PS by ~45% in mass-selected samples at matched scales.
-
Generalized Guarantees for Variational Inference in the Presence of Even and Elliptical Symmetry
Under even or elliptical symmetry, f-divergence variational objectives have stationary points that recover the target mean or correlation structure, but uniqueness and correlation guarantees are proven only for revers...
-
Gravitational-Wave Parameter Estimation in non-Gaussian noise using Score-Based Likelihood Characterization
Score-based diffusion models learn the empirical distribution of real LIGO noise to enable unbiased gravitational-wave parameter estimation under only an additivity assumption.
-
A parameterization of anisotropic Gaussian fields with penalized complexity priors
New smooth invertible parameterization of anisotropic GF correlation length and diffusion matrix, with PC priors that penalize finite range and nonzero anisotropy for constant-parameter models.
-
A Calibration Audit of a Gaia XP White-Dwarf Main-Sequence Binary Catalog: How Much BP-Band Residual it Takes to Manufacture Contamination
At the realistic ~2% local BP residual, injected contamination of a Gaia XP WD–MS binary selection is a null (spurious rate 0.08 on a 0.05 baseline); failure requires 10–20% local excess.
-
pop-cosmos: Galaxy size evolution across structural and star-formation classifications in COSMOS-Web
Galaxy size-mass relations exhibit double power-law breaks at different pivot masses for quiescent versus bulge-dominated samples, coinciding with AGN activity scales.
-
Artifact-Conditioned Interval Diagnostics for Flow-Matching Neural Posterior Estimation in a Controlled Gravitational-Wave Benchmark
In a controlled binary-black-hole benchmark, soft learned artifact-aware interval rescaling (LAIR) reduces marginal calibration error for frequency masks from 0.1195 to 0.0672 but is not uniformly better than raw inte...
-
Population synthesis of active galactic nuclei based on the radiation-regulated unification model
Using ray-tracing simulations and simulation-based inference, the authors construct an AGN population that reproduces the cosmic X-ray background, number counts, and absorption properties, deriving an intrinsic Compto...
-
Separating Intrinsic Ambiguity from Estimation Uncertainty in Deep Generative Models for Linear Inverse Problems
Introduces a cascade-based structural decomposition of posterior uncertainty to isolate intrinsic ambiguity from estimation uncertainty in deep generative models for linear inverse problems.
-
Neural Posterior Estimation of Terrain Parameters from Radar Sounder Data
Neural posterior estimation trained on simulated radar data enables probabilistic inference of terrain parameters from real Mars radar sounder profiles while conditioning on reference surface assumptions.
-
Neural Posterior Estimation of Terrain Parameters from Radar Sounder Data
Neural posterior estimation trained on GPU-simulated radar data enables calibrated probabilistic inversion of terrain parameters and transfers to real Mars radar profiles.
-
MIRA: A Score for Conditional Distribution Accuracy and Model Comparison
MIRA is a new analytic score for conditional distribution accuracy derived from equal probability mass assignment, enabling Bayesian model comparison via direct posterior validation.
-
The Milky Way - Large Magellanic Cloud Interaction with Simulation Based Inference
Simulation-based inference on outer-halo star velocities gives a Milky Way reflex speed of 26.4 km/s and an LMC enclosed mass of 9.2×10^10 solar masses within 50 kpc.
-
Tests of General Relativity with Binary Black Holes from the second LIGO-Virgo Gravitational-Wave Transient Catalog
No evidence for deviations from general relativity is found in LIGO-Virgo binary black hole events, with improved constraints on waveform parameters, graviton mass, and ringdown properties.
-
Bayesian Inference of Discretization Error Means in ODEs via Ensemble Kalman Filtering
A Bayesian state-space model with an Ensemble Kalman Filter infers the mean of ODE discretization errors from noisy observations, using a step-size-dependent Markov prior whose convergence is proven.
-
Neutron Star Mass across Binary Pulsar Subpopulations: Mass-Spin Correlation, Mass Distributions, and Moment of Inertia Effects
Hierarchical Bayesian analysis of ~50 binary pulsars finds moderate evidence for mass-spin anti-correlation (ρ = -0.26) in the recycled population, plus a small mass offset by white-dwarf companion type and confirmati...
-
Bayesian Extreme Value Theory with Hawkes-AR-Gumbel Dependence for Extreme CVaR Estimation in Operational Risk
Bayesian EVT with Hawkes-AR-Gumbel dependence estimates CVaR up to 99.995% on simulated operational risk data and outperforms independent and shared-factor baselines.
-
Bayesian inference for compact binary coalescences with BILBY: Validation and application to the first LIGO--Virgo gravitational-wave transient catalogue
BILBY is validated on simulated compact binary signals and reproduces the eleven GWTC-1 results with configuration and output files provided for reproduction.
-
Machine Learning and the SKA for Cosmic Dawn and the Epoch of Reionization
A multi-author overview of machine-learning algorithms proposed for instrument modelling, data analysis, simulation and inference in SKA Cosmic Dawn and Epoch of Reionization science.
-
An Introduction to Bayesian and Frequentist Simulation-Based Inference with Machine Learning
A structured introduction to ML-based simulation-based inference, contrasting Bayesian and frequentist frameworks and covering parameter inference, unfolding, and validation.
-
Machine Learning Techniques for Astrophysics and Cosmology: Simulation-Based Inference
Simulation-based inference uses neural networks trained on simulations to enable parameter inference in cosmology and astrophysics where traditional likelihood calculations are intractable.
-
Application of Machine Learning to 21 cm Cosmology
A review chapter groups machine learning methods for 21 cm cosmology by their pipeline roles in handling contaminated data, accelerating simulations, and inferring astrophysical parameters.
-
Application of Machine Learning to 21 cm Cosmology
Review chapter organizing machine learning methods for 21 cm cosmology into observation, theory, and inference domains.
-
Application of Machine Learning to 21 cm Cosmology
Machine learning helps 21 cm cosmology most when it preserves physically relevant structure and propagates uncertainty explicitly instead of replacing the forward model.
-
A Review of Diffusion-based Simulation-Based Inference: Foundations and Applications in Non-Ideal Data Scenarios
A synthesis of diffusion-based simulation-based inference methods that address model misspecification, irregular observations, and missing data in scientific applications.
-
Application of Machine Learning to 21 cm Cosmology
Machine learning can address data contamination, accelerate modeling, and aid inference in 21 cm cosmology when it preserves physical structure and uncertainty rather than acting as an opaque replacement.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.