pith. sign in

arxiv: 2302.08724 · v4 · submitted 2023-02-17 · 📊 stat.ML · cs.LG· stat.OT

Piecewise Deterministic Markov Processes for Bayesian Neural Networks

Ethan Goan , Dimitri Perrin , Kerrie Mengersen , Clinton Fookes This is my paper

Pith reviewed 2026-05-24 09:54 UTC · model grok-4.3

classification 📊 stat.ML cs.LGstat.OT
keywords Bayesian neural networkspiecewise deterministic Markov processesthinning schemeinhomogeneous Poisson processMCMCsubsamplingapproximate inference
0
0 comments X

The pith

A generic adaptive thinning scheme makes PDMP samplers practical for Bayesian neural networks by efficiently sampling their model-specific inhomogeneous Poisson processes.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper develops a generic and adaptive thinning scheme that samples from the inhomogeneous Poisson processes required by Piecewise Deterministic Markov Process samplers when applied to Bayesian neural networks. This removes the main computational barrier that had prevented these exact MCMC-style methods from using data subsampling. The resulting PDMP inference is shown to be computationally feasible while avoiding the independence and posterior-shape assumptions imposed by variational methods. Experiments indicate gains in predictive accuracy, MCMC mixing, and uncertainty quantification relative to other approximate inference approaches.

Core claim

The authors introduce a generic and adaptive thinning scheme for sampling from the inhomogeneous Poisson processes that arise in PDMP samplers for BNNs. This scheme accelerates the application of PDMPs for inference in BNNs, making the methods computationally feasible and yielding improvements in predictive accuracy, MCMC mixing performance, and uncertainty measurements compared to other approximate inference schemes.

What carries the argument

The generic and adaptive thinning scheme for sampling from model-specific inhomogeneous Poisson processes in PDMPs for BNNs.

If this is right

  • PDMP-based inference on BNNs becomes computationally feasible at scales where standard MCMC cannot subsample the likelihood.
  • Predictive accuracy improves relative to variational inference and other approximate schemes.
  • MCMC mixing performance improves over competing methods.
  • Uncertainty measurements become more informative than those from methods that impose posterior independence assumptions.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The thinning construction may apply directly to PDMP formulations on other models that induce similar inhomogeneous Poisson processes.
  • Parallel or distributed implementations of the thinned process could be tested to measure further wall-clock reductions.
  • The method could be benchmarked on very large networks to check whether the per-iteration cost remains sublinear in dataset size.

Load-bearing premise

The adaptive thinning scheme can reliably sample from the inhomogeneous Poisson processes without introducing bias or overhead that cancels the subsampling benefit.

What would settle it

Apply the PDMP sampler with the new thinning to a small BNN whose posterior can be computed exactly by enumeration or quadrature, then test whether the generated samples match the true posterior in total variation or in low-order moments.

Figures

Figures reproduced from arXiv: 2302.08724 by Clinton Fookes, Dimitri Perrin, Ethan Goan, Kerrie Mengersen.

Figure 1
Figure 1. Figure 1: Example of correlations between the parameters [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Figure 2: Example of the progression of the proposed envelope scheme used for thinning. The blue line represents the true [PITH_FULL_IMAGE:figures/full_fig_p005_2.png] view at source ↗
Figure 3
Figure 3. Figure 3: Examples of the different PDMP samplers using the proposed event thinning procedure on synthetic regression [PITH_FULL_IMAGE:figures/full_fig_p007_3.png] view at source ↗
Figure 4
Figure 4. Figure 4: Examples of the predictive mean and variance for [PITH_FULL_IMAGE:figures/full_fig_p007_4.png] view at source ↗
Figure 5
Figure 5. Figure 5: Example of ACF and trace plots for the first prin [PITH_FULL_IMAGE:figures/full_fig_p008_5.png] view at source ↗
Figure 6
Figure 6. Figure 6: Examples from predictive posterior for difficult-to [PITH_FULL_IMAGE:figures/full_fig_p008_6.png] view at source ↗
Figure 7
Figure 7. Figure 7: Entropy histograms comparing SGLD and Boomerang sampler fit on the CIFAR-10 dataset. OOD data represented by SVHN. We see the predictive entropy from the Boomerang sampler increases as desired for OOD data, whilst SGLD remains overly confident for erroneous samples. in samples, however as seen in the trace plot, samples fail to explore the posterior and instead converge to a steady state, whilst the Boomer… view at source ↗
Figure 1
Figure 1. Figure 1: Distribution of acceptance ratios for event thinning across the different PDMP samplers used within this work for [PITH_FULL_IMAGE:figures/full_fig_p012_1.png] view at source ↗
Figure 2
Figure 2. Figure 2: Exampled of predictive posteriors for BNN regression models across synthetic data sets. Training samples are [PITH_FULL_IMAGE:figures/full_fig_p014_2.png] view at source ↗
Figure 3
Figure 3. Figure 3: Examples of predictive distributions for synthetic binary classification task. Top row indicates predictive mean and [PITH_FULL_IMAGE:figures/full_fig_p014_3.png] view at source ↗
Figure 4
Figure 4. Figure 4: Plots summarising samples from tested samples projected onto first principal component. Top row represents the [PITH_FULL_IMAGE:figures/full_fig_p015_4.png] view at source ↗
Figure 5
Figure 5. Figure 5: Plots summarising samples from tested samples projected onto second principal component. Top row represents [PITH_FULL_IMAGE:figures/full_fig_p015_5.png] view at source ↗
Figure 6
Figure 6. Figure 6: Plots summarising samples from tested samples projected onto last principal component. Top row represents the [PITH_FULL_IMAGE:figures/full_fig_p016_6.png] view at source ↗
Figure 7
Figure 7. Figure 7: Trace plots comparing mixing of SGLD and the Boomerang sampler for individual weight parameters within [PITH_FULL_IMAGE:figures/full_fig_p017_7.png] view at source ↗
Figure 8
Figure 8. Figure 8: Effect of scale in velocity reference measure for PDMP samplers applied to BNNs. [PITH_FULL_IMAGE:figures/full_fig_p017_8.png] view at source ↗
Figure 9
Figure 9. Figure 9: Effect of λref on PDMP models applied to BNNs. Shown here is the predictive distribution found with the BPS using the proposed event rate thinning method. E.2 ADDITONAL UCI-DATASET RESULTS We provide here additional results on datasets from the UCI repository?. For each dataset, a simple MLP network with a three hidden layers with 512, 256, and 128 hidden units is used, along with a ReLU activation. MAP es… view at source ↗
Figure 10
Figure 10. Figure 10: Entropy within the final predictive categorical vector obtained from the tested sampling methods for the different [PITH_FULL_IMAGE:figures/full_fig_p021_10.png] view at source ↗
Figure 11
Figure 11. Figure 11: Examples of difficult-to-classify images from the different image data sets used. Below each image is the [PITH_FULL_IMAGE:figures/full_fig_p022_11.png] view at source ↗
read the original abstract

Inference on modern Bayesian Neural Networks (BNNs) often relies on a variational inference treatment, imposing violated assumptions of independence and the form of the posterior. Traditional MCMC approaches avoid these assumptions at the cost of increased computation due to its incompatibility to subsampling of the likelihood. New Piecewise Deterministic Markov Process (PDMP) samplers permit subsampling, though introduce a model specific inhomogenous Poisson Process (IPPs) which is difficult to sample from. This work introduces a new generic and adaptive thinning scheme for sampling from these IPPs, and demonstrates how this approach can accelerate the application of PDMPs for inference in BNNs. Experimentation illustrates how inference with these methods is computationally feasible, can improve predictive accuracy, MCMC mixing performance, and provide informative uncertainty measurements when compared against other approximate inference schemes.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

2 major / 2 minor

Summary. The paper claims that a new generic and adaptive thinning scheme enables efficient sampling from the model-specific inhomogeneous Poisson processes (IPPs) that arise when applying Piecewise Deterministic Markov Process (PDMP) samplers to Bayesian Neural Networks (BNNs). This makes PDMP-based inference computationally feasible for BNNs (via subsampling), and experiments demonstrate gains in predictive accuracy, MCMC mixing performance, and uncertainty quantification relative to other approximate inference methods such as variational inference.

Significance. If the adaptive thinning scheme is unbiased and the overhead remains low enough to preserve the subsampling advantage, the work would supply a practical route to exact (non-variational) posterior sampling for BNNs that avoids independence assumptions while retaining scalability; this would be a notable addition to the set of MCMC methods usable on modern neural-network models.

major comments (2)
  1. [Section describing the adaptive thinning algorithm (likely §3 or §4)] The central claim that the adaptive thinning scheme produces exact (unbiased) samples from the BNN-specific IPPs is load-bearing for all reported performance gains. No verification on a low-dimensional proxy (e.g., logistic regression) where the IPP can be sampled exactly is described; without such a check it remains possible that the reported improvements in mixing or accuracy arise from an altered stationary distribution rather than correct PDMP dynamics.
  2. [Experimental section (likely §5)] The experiments compare predictive accuracy and mixing against other approximate schemes, but do not report diagnostics confirming that the PDMP chain with the new thinning rule has the correct invariant distribution (e.g., via total-variation distance to a gold-standard sampler on a small BNN or via the expected value of a known test function).
minor comments (2)
  1. [Abstract and experimental results] Clarify whether the reported 'MCMC mixing performance' refers to standard autocorrelation times or to a PDMP-specific metric such as the number of velocity flips per unit time.
  2. [Method sections] Notation for the dominating intensity and adaptation rule should be introduced once and used consistently; several symbols appear to be redefined between the general PDMP background and the BNN-specific application.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for their constructive comments, which highlight important aspects of validating the correctness of the proposed adaptive thinning scheme. We address each major comment below, indicating planned revisions where appropriate.

read point-by-point responses

  1. Referee: [Section describing the adaptive thinning algorithm (likely §3 or §4)] The central claim that the adaptive thinning scheme produces exact (unbiased) samples from the BNN-specific IPPs is load-bearing for all reported performance gains. No verification on a low-dimensional proxy (e.g., logistic regression) where the IPP can be sampled exactly is described; without such a check it remains possible that the reported improvements in mixing or accuracy arise from an altered stationary distribution rather than correct PDMP dynamics.

    Authors: The adaptive thinning procedure is constructed to be unbiased by extending the standard thinning algorithm to the model-specific intensity function, with the acceptance probability derived to match the target IPP exactly (see the derivation in Section 3). Nevertheless, we agree that an explicit numerical verification on a low-dimensional proxy such as logistic regression would strengthen the manuscript. In the revision we will add such a check, comparing the empirical distribution of event times obtained via the adaptive scheme against an exact sampler (e.g., via numerical quadrature of the intensity) and confirming that the resulting PDMP chain preserves the known invariant distribution. revision: yes

  2. Referee: [Experimental section (likely §5)] The experiments compare predictive accuracy and mixing against other approximate schemes, but do not report diagnostics confirming that the PDMP chain with the new thinning rule has the correct invariant distribution (e.g., via total-variation distance to a gold-standard sampler on a small BNN or via the expected value of a known test function).

    Authors: We acknowledge that direct confirmation of the invariant distribution on even modestly sized BNNs is computationally demanding. We will augment the experimental section with additional diagnostics, including the long-run average of simple test functions (e.g., posterior mean of selected weights) on a small fully-connected network where a gold-standard HMC run is feasible, as well as standard MCMC convergence metrics. These additions will be included in the revised manuscript. revision: yes

Circularity Check

0 steps flagged

No circularity: new adaptive thinning scheme presented as independent contribution with experimental validation

full rationale

The paper introduces a novel generic adaptive thinning scheme for sampling model-specific IPPs arising in PDMPs applied to BNNs. The abstract and description frame this as a new algorithmic contribution whose unbiasedness and efficiency are asserted as properties of the proposed method, then validated through experimentation on predictive accuracy, mixing, and uncertainty. No equations or steps reduce a claimed prediction or result to a fitted parameter or self-citation by construction. No self-definitional, fitted-input-called-prediction, or load-bearing self-citation patterns appear. The derivation chain is self-contained against external benchmarks (comparisons to other inference schemes) and does not rely on renaming known results or smuggling ansatzes via prior self-work.

Axiom & Free-Parameter Ledger

0 free parameters · 0 axioms · 0 invented entities

Abstract-only; no free parameters, axioms, or invented entities are identifiable from the provided text.

pith-pipeline@v0.9.0 · 5673 in / 1016 out tokens · 21168 ms · 2026-05-24T09:54:53.230750+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Lean theorems connected to this paper

Citations machine-checked in the Pith Canon. Every link opens the source theorem in the public Lean library.

What do these tags mean?
matches
The paper's claim is directly supported by a theorem in the formal canon.
supports
The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
extends
The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
uses
The paper appears to rely on the theorem as machinery.
contradicts
The paper's claim conflicts with a theorem or certificate in the canon.
unclear
Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.

Reference graph

Works this paper leans on

16 extracted references · 16 canonical work pages · 7 internal anchors

  1. [1]

    Adaptive schemes for piecewise deterministic monte carlo algorithms

    Andrea Bertazzi and Joris Bierkens. Adaptive schemes for piecewise deterministic monte carlo algorithms. arXiv preprint arXiv:2012.13924,

    work page arXiv 2012

  2. [2]

    The boomerang sampler

    Joris Bierkens, Sebastiano Grazzi, Kengo Kamatani, and Gareth Roberts. The boomerang sampler. arXiv preprint arXiv:2006.13777,

    work page arXiv 2006

  3. [3]

    TensorFlow Distributions

    Joshua V Dillon, Ian Langmore, Dustin Tran, Eugene Brevdo, Srinivas Vasudevan, Dave Moore, Brian Patton, Alex Alemi, Matt Hoffman, and Rif A Saurous. Ten- sorflow distributions. arXiv preprint arXiv:1711.10604, abs/1711.10604,

    work page internal anchor Pith review Pith/arXiv arXiv

  4. [4]

    Geometric ergodicity of the bouncy particle sampler

    ALAIN DURMUS, ARNAUD GUILLIN, and PIERRE MONMARCHÉ. Geometric ergodicity of the bouncy particle sampler. The Annals of Applied Probability, 30 (5):2069–2098,

    work page 2069

  5. [5]

    Bayesian infer- ence for large scale image classification

    Jonathan Heek and Nal Kalchbrenner. Bayesian infer- ence for large scale image classification. arXiv preprint arXiv:1908.03491,

    work page arXiv 1908

  6. [6]

    What are bayesian neu- ral network posteriors really like? arXiv preprint arXiv:2104.14421,

    Pavel Izmailov, Sharad Vikram, Matthew D Hoffman, and Andrew Gordon Wilson. What are bayesian neu- ral network posteriors really like? arXiv preprint arXiv:2104.14421,

    work page arXiv

  7. [7]

    Preconditioned Stochastic Gradient Langevin Dynamics for Deep Neural Networks

    Chunyuan Li, Changyou Chen, David Carlson, and Lawrence Carin. Preconditioned stochastic gradient langevin dynamics for deep neural networks. arXiv preprint arXiv:1512.07666,

    work page internal anchor Pith review Pith/arXiv arXiv

  8. [8]

    Maddox, Pavel Izmailov, Timur Garipov, Dmitry P

    Wesley J. Maddox, Pavel Izmailov, Timur Garipov, Dmitry P. Vetrov, and Andrew Gordon Wilson. A simple baseline for bayesian uncertainty in deep learning. In Hanna M. Wallach, Hugo Larochelle, Alina Beygelzimer, Florence d’Alché-Buc, Emily B. Fox, and Roman Gar- nett, editors, Advances in Neural Information Processing Systems 32: Annual Conference on Neura...

    work page 2019

  9. [9]

    neurips.cc/paper/2019/hash/ 118921efba23fc329e6560b27861f0c2-Abstract

    URL https://proceedings. neurips.cc/paper/2019/hash/ 118921efba23fc329e6560b27861f0c2-Abstract. html. Stephan Mandt, Matthew D Hoffman, and David M Blei. Stochastic gradient descent as approximate bayesian in- ference. Journal of Machine Learning Research, 18:1–35,

    work page 2019

  10. [10]

    The True Cost of Stochastic Gradient Langevin Dynamics

    Tigran Nagapetyan, Andrew B Duncan, Leonard Hasen- clever, Sebastian J V ollmer, Lukasz Szpruch, and Kon- stantinos Zygalakis. The true cost of stochastic gradient langevin dynamics. arXiv preprint arXiv:1706.02692 ,

    work page internal anchor Pith review Pith/arXiv arXiv

  11. [11]

    Reading digits in natural images with unsupervised feature learning

    Yuval Netzer, Tao Wang, Adam Coates, Alessandro Bis- sacco, Bo Wu, and Andrew Y Ng. Reading digits in natural images with unsupervised feature learning. In NIPS workshop on deep learning and unsupervised fea- ture learning, volume 2011, page 5,

    work page 2011

  12. [12]

    Piecewise-Deterministic Markov Chain Monte Carlo

    Paul Vanetti, Alexandre Bouchard-Côté, George Deligianni- dis, and Arnaud Doucet. Piecewise-deterministic markov chain monte carlo. arXiv preprint arXiv:1707.05296 ,

    work page internal anchor Pith review Pith/arXiv arXiv

  13. [13]

    Generalized Bouncy Particle Sampler

    Changye Wu and Christian P Robert. Generalized bouncy particle sampler. arXiv preprint arXiv:1706.04781, art. arXiv:1706.04781, Jun

    work page internal anchor Pith review Pith/arXiv arXiv

  14. [14]

    Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms

    Han Xiao, Kashif Rasul, and Roland V ollgraf. Fashion- mnist: a novel image dataset for benchmarking machine learning algorithms. arXiv preprint arXiv:1708.07747,

    work page internal anchor Pith review Pith/arXiv arXiv

  15. [15]

    Piecewise Deterministic Markov Processes for Bayesian Neural Networks

    with Corrigendum. arXiv:2302.08724v2 [stat.ML] 19 Oct 2023 Table 1: Summary of predictive performance with and timings as the scaling value ofαis increased for the PDMP samplers demonstrated within. All models are fit to the MNIST dataset using the Lenet5 architecture. α Inference ACC NLL ECC Time α= 1.0 BPS 0.9896 0.0536 2.66 71 σBPS 0.9923 0.0227 0.4127...

    work page internal anchor Pith review Pith/arXiv arXiv 2023

  16. [16]

    In a similar vein, we would state that any Bayesian neural network user would have a difficult time honestly saying their inference strategy has sufficiently explored the posterior, including the work proposed here. Previous research has investigated gold-standard MCMC methods for larger networks ?, though were unable to obtain a sufficient number of samp...

    work page 2012