Pith. sign in

REVIEW 4 cited by

posteriordb: Testing, Benchmarking and Developing Bayesian Inference Algorithms

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2407.04967 v1 pith:DWAY2UTE submitted 2024-07-06 stat.CO

posteriordb: Testing, Benchmarking and Developing Bayesian Inference Algorithms

classification stat.CO
keywords inferenceposteriordbalgorithmsmodelstargetcarlodensitiesdeveloping
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

The generality and robustness of inference algorithms is critical to the success of widely used probabilistic programming languages such as Stan, PyMC, Pyro, and Turing.jl. When designing a new general-purpose inference algorithm, whether it involves Monte Carlo sampling or variational approximation, the fundamental problem arises in evaluating its accuracy and efficiency across a range of representative target models. To solve this problem, we propose posteriordb, a database of models and data sets defining target densities along with reference Monte Carlo draws. We further provide a guide to the best practices in using posteriordb for model evaluation and comparison. To provide a wide range of realistic target densities, posteriordb currently comprises 120 representative models and has been instrumental in developing several general inference algorithms.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Divide, Interact, Sample: The Two-System Paradigm

    stat.CO 2025-09 unverdicted novelty 7.0

    A two-system paradigm unifies disparate Monte Carlo approaches by having two particle subsystems interact symmetrically, yielding new overdamped and underdamped Langevin samplers that show higher ESS per gradient and ...

  2. AI4BayesCode: From Natural Language Descriptions to Validated Modular Stateful Bayesian Samplers

    stat.CO 2026-05 unverdicted novelty 6.0

    AI4BayesCode generates validated modular stateful MCMC samplers from natural language Bayesian model descriptions via LLM translation, modular blocks, and recursive stateful composition.

  3. AI4BayesCode: From Natural Language Descriptions to Validated Modular Stateful Bayesian Samplers

    stat.CO 2026-05 conditional novelty 6.0

    A new LLM-based system generates and validates runnable modular MCMC samplers directly from natural-language Bayesian model descriptions, reporting success on 120 of 132 benchmark models.

  4. RefineStat: Efficient Exploration for Probabilistic Program Synthesis

    cs.LG 2025-09 unverdicted novelty 6.0

    RefineStat improves small language model performance on probabilistic program synthesis by adding semantic constraint enforcement and diagnostic-aware refinement, producing syntactically and statistically reliable cod...