RECORD
Unbiased Markov chain Monte Carlo for intractable target distributions
Computation · Submitted 23 Jul 2018
abstract compiled · 2026-09-23 · no language-model review
The authors' main claim We show how to use coupling techniques to generate unbiased estimators in finite time, building on recent advances for generic MCMC algorithms.
The compiled record
The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
Open the compiled record
The abstract, sentence by sentence
Performing numerical integration when the integrand itself cannot be evaluated point-wise is a challenging task that arises in statistical analysis, notably in Bayesian inference for models with intractable likelihood functions. Markov chain Monte Carlo (MCMC) algorithms have been proposed for this setting, such as the pseudo-marginal method for latent variable models and the exchange algorithm for a class of undirected graphical models. As with any MCMC algorithm, the resulting estimators are justified asymptotically in the limit of the number of iterations, but exhibit a bias for any fixed number of iterations due to the Markov chains starting outside of stationarity. This "burn-in" bias is known to complicate the use of parallel processors for MCMC computations. We show how to use coupling techniques to generate unbiased estimators in finite time, building on recent advances for generic MCMC algorithms. We establish the theoretical validity of some of these procedures by extending existing results to cover the case of polynomially ergodic Markov chains. The efficiency of the proposed estimators is compared with that of standard MCMC estimators, with theoretical arguments and numerical experiments including state space models and Ising models.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | Performing numerical integration when the integrand itself cannot be evaluated point-wise is a challenging task that arises in statistical analysis, notably in Bayesian inference for models with intractable likelihood functions. | background 1.00 | 0.04 | 0.03 | asserted 1.00 |
| s1 | Markov chain Monte Carlo (MCMC) algorithms have been proposed for this setting, such as the pseudo-marginal method for latent variable models and the exchange algorithm for a class of undirected graphical models. | background 1.00 | 0.04 | 0.02 | asserted 0.99 |
| s2 | As with any MCMC algorithm, the resulting estimators are justified asymptotically in the limit of the number of iterations, but exhibit a bias for any fixed number of iterations due to the Markov chains starting outside of stationarity. | background 0.97 | 0.06 | 0.03 | asserted 1.00 |
| s3 | This "burn-in" bias is known to complicate the use of parallel processors for MCMC computations. | background 0.97 | 0.05 | 0.02 | asserted 1.00 |
| s4 | We show how to use coupling techniques to generate unbiased estimators in finite time, building on recent advances for generic MCMC algorithms. | contribution 0.91 | 0.94 | 0.80 | asserted 1.00 |
| s5 | We establish the theoretical validity of some of these procedures by extending existing results to cover the case of polynomially ergodic Markov chains. | contribution 0.93 | 0.92 | 0.12 | asserted 1.00 |
| s6 | The efficiency of the proposed estimators is compared with that of standard MCMC estimators, with theoretical arguments and numerical experiments including state space models and Ising models. | contribution 0.42 | 0.94 | 0.13 | asserted 0.98 |
What was examined, and what was not
- arXiv listing abstract v3
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
The paper
Original abstract
Performing numerical integration when the integrand itself cannot be evaluated point-wise is a challenging task that arises in statistical analysis, notably in Bayesian inference for models with intractable likelihood functions. Markov chain Monte Carlo (MCMC) algorithms have been proposed for this setting, such as the pseudo-marginal method for latent variable models and the exchange algorithm for a class of undirected graphical models. As with any MCMC algorithm, the resulting estimators are justified asymptotically in the limit of the number of iterations, but exhibit a bias for any fixed number of iterations due to the Markov chains starting outside of stationarity. This "burn-in" bias is known to complicate the use of parallel processors for MCMC computations. We show how to use coupling techniques to generate unbiased estimators in finite time, building on recent advances for generic MCMC algorithms. We establish the theoretical validity of some of these procedures by extending existing results to cover the case of polynomially ergodic Markov chains. The efficiency of the proposed estimators is compared with that of standard MCMC estimators, with theoretical arguments and numerical experiments including state space models and Ising models.
Human review
How the literature uses it
5 arXiv papers cite this in 7 sentences
Papers citing it · 6 sentences without a confident label
Compares with it 1 paper
-
However, in contrast to previous constructions [ref] , our method allows the chains to couple at time $τ=1$ through re-using the initial value $(X̃_1:T^(0),p̃_N^(0))$ as a proposal for the first chain.
Unbiased Smoothing using Particle Independent Metropolis-Hastings · Coupled PIMH · 0.99
What it cites · 6 sentences without a confident label
Uses the method or tool of 1 paper
-
We also consider a variant of the pseudo-marginal approach known as the block pseudo-marginal approach [ref] as well as the exchange algorithm [ref] .
The Block Pseudo-Marginal Sampler · Context · 0.84
Cites as background 1 paper
-
Related schemes include the exchange algorithm [ref] , which applies to scenarios where the likelihood involves an intractable, parameter-dependent normalizing constant.
On the utility of Metropolis-Hastings with asymmetric acceptance ratio · Context · 0.92
Discussion
Know something about this paper? Leave a comment, or highlight any passage above to comment on it.