pith. sign in

arxiv: 2007.05579 · v4 · submitted 2020-07-10 · 🌌 astro-ph.IM · astro-ph.HE· gr-qc

Inferring the properties of a population of compact binaries in presence of selection effects

Pith reviewed 2026-05-24 13:42 UTC · model grok-4.3

classification 🌌 astro-ph.IM astro-ph.HEgr-qc
keywords hierarchical Bayesian inferenceselection effectscompact binariesgravitational wavespopulation inferencedetection probabilityBayesian statistics
0
0 comments X

The pith

The equations for hierarchical Bayesian inference of compact binary populations can be derived from first principles even when selection effects are present.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

This paper derives the statistical framework needed to infer properties of populations of compact binaries while correctly handling the fact that detectors miss many sources. It obtains the central likelihood and posterior expressions starting from basic definitions of probability and conditional probability. The approach is presented pedagogically with two worked examples and applies to any catalog where detection is not uniform. Readers learn how to write the population-level inference so that the selection function enters explicitly as a normalization term.

Core claim

The posterior for the population hyperparameters is given by the product, over all detected events, of the integral of the single-event likelihood times the population density, divided by the population-averaged detection probability, all obtained directly from the joint probability of the data and the population model without additional assumptions about the form of either.

What carries the argument

The selection-aware hierarchical likelihood, which marginalizes each event's parameters under the population model and normalizes by the integral of the detection probability weighted by that same model.

If this is right

  • Catalogs of detected compact binaries can be used to infer whether one or several underlying populations are required.
  • Population parameters such as mass and spin distributions can be estimated without the bias that would arise from ignoring varying detection probabilities.
  • The same expressions apply when new events are added to the catalog, allowing sequential updating of the population inference.
  • The framework remains valid for any observational selection process that can be expressed as a detection probability for each source.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • Once the statistical expressions are fixed, the dominant remaining uncertainty in any application is the accuracy with which the detection probability can be computed for the specific instrument and search pipeline.
  • The derivation structure suggests the same first-principles steps could be repeated for time-dependent populations or for selection effects that correlate across multiple observables.
  • The method provides a template for correcting selection biases in other selected samples, such as flux-limited astronomical surveys or clinical trial recruitment.

Load-bearing premise

The probability that any given source is detected can be calculated or modeled accurately enough that the selection function introduces no uncontrolled bias into the population inference.

What would settle it

A Monte Carlo simulation in which the input population parameters are known exactly, the detection probability is computed without error, and the derived posterior fails to recover those parameters within the expected statistical uncertainty would show the first-principles equations are incorrect.

read the original abstract

Shortly after a new class of objects is discovered, the attention shifts from the properties of the individual sources to the question of their origin: do all sources come from the same underlying population, or several populations are required? What are the properties of these populations? As the detection of gravitational waves is becoming routine and the size of the event catalog increases, finer and finer details of the astrophysical distribution of compact binaries are now within our grasp. This Chapter presents a pedagogical introduction to the main statistical tool required for these analyses: hierarchical Bayesian inference in the presence of selection effects. All key equations are obtained from first principles, followed by two examples of increasing complexity. Although many remarks made in this Chapter refer to gravitational-wave astronomy, the write-up is generic enough to be useful to researchers and graduate students from other fields.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

0 major / 2 minor

Summary. The manuscript presents a pedagogical derivation from first principles of the hierarchical Bayesian posterior for inferring the properties of a population of compact binaries, explicitly incorporating selection effects via the normalization over detectable events. It supplies two worked examples of increasing complexity and emphasizes applicability beyond gravitational-wave astronomy.

Significance. If the derivations hold, the work provides a self-contained, first-principles reference that lowers the barrier for researchers and students applying hierarchical inference to selection-biased catalogs. Explicit credit is due for the generic framing and the step-by-step construction of the selection-function integral, which matches the standard construction in the literature without hidden circularity.

minor comments (2)
  1. The abstract states that 'all key equations are obtained from first principles,' yet the manuscript would benefit from an explicit statement (near the start of §2) confirming that the detection probability p(det|θ) is treated as an externally supplied function rather than derived internally.
  2. In the second example, the transition from the single-event likelihood to the population-level integral could include a one-sentence reminder of the change of variables that converts the integral over detectable events into the form shown in Eq. (X).

Simulated Author's Rebuttal

0 responses · 0 unresolved

We thank the referee for their positive review and recommendation to accept the manuscript. The assessment correctly identifies the pedagogical intent and the generic framing of the derivations, which we aimed to achieve.

Circularity Check

0 steps flagged

No significant circularity; derivation from first principles is self-contained

full rationale

The paper is a pedagogical review that derives the standard hierarchical Bayesian posterior p(θ|d) ∝ p(d|θ)p(θ) with selection effects entering via the normalization integral, explicitly from first principles as stated in the abstract. No load-bearing step reduces by construction to a fitted parameter, self-citation chain, or ansatz smuggled from prior work by the same authors; the central equations follow directly from Bayes' theorem and the definition of detectability without internal redefinition or renaming of known results. This matches the most common honest finding for self-contained pedagogical derivations against external benchmarks.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 0 invented entities

Only the abstract is available; the ledger is therefore limited to what is stated in the abstract. The work relies on standard Bayesian probability rules and the existence of a computable selection function.

axioms (1)
  • standard math Standard rules of probability and Bayesian inference hold and can be applied directly to the detection process.
    The paper states that all key equations are obtained from first principles, implying reliance on textbook probability.

pith-pipeline@v0.9.0 · 5679 in / 1060 out tokens · 16552 ms · 2026-05-24T13:42:23.608337+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 7 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. End-to-End Population Inference from Gravitational-Wave Strain using Transformers

    gr-qc 2026-05 unverdicted novelty 7.0

    Dingo-Pop uses a transformer to perform amortized, end-to-end population inference from GW strain data in seconds, bypassing per-event Monte Carlo sampling.

  2. First measurement of the Hubble constant from a combined weak lensing and gravitational-wave standard siren analysis

    astro-ph.CO 2026-01 unverdicted novelty 7.0

    Joint analysis of LVK standard sirens and DES 3x2pt data yields H0 = 67.9 +4.4/-4.3 km s^{-1} Mpc^{-1} at 6.4% precision while tightening the Omega_m constraint by 22%.

  3. Signatures of a subpopulation of hierarchical mergers in the GWTC-4 gravitational-wave dataset

    gr-qc 2026-01 unverdicted novelty 6.0

    GWTC-4 data show a transition to nearly all hierarchical mergers above 46 solar masses, with the hierarchical rate peaking at 15.7 solar masses, indicating mass-dependent substructure in black hole spins.

  4. Evidence of the pair instability gap from black hole masses

    astro-ph.HE 2025-09 unverdicted novelty 6.0

    GWTC-4 data reveals a pair-instability gap at 44 M_⊙ in secondary black hole masses, interpreted as evidence for hierarchical mergers and used to constrain the S-factor for 12C(α,γ)16O.

  5. Gravitational-wave constraints on $H_0$ are robust to (putative) redshift evolution in the binary black hole mass spectrum at current sensitivity

    astro-ph.CO 2026-05 conditional novelty 5.0

    Spectral-siren H0 constraints from GWTC-4.0 binary black holes remain robust when the mass spectrum is permitted to evolve with redshift at current detector sensitivity.

  6. Emergent structure in the binary black hole mass distribution and implications for population-based cosmology

    gr-qc 2026-04 unverdicted novelty 5.0

    B-spline agnostic reconstruction of binary black hole masses from GWTC-4.0 reveals multiple features and a logarithmic hierarchy that impacts Hubble constant measurements, with a low-mass subpopulation isolation metho...

  7. Gravitational-wave astronomy requires population-informed parameter estimation

    gr-qc 2026-04 unverdicted novelty 4.0

    Population-informed hierarchical parameter estimation is required for unbiased astrophysical interpretation of gravitational-wave events rather than using standard individual posteriors with reference priors.

Reference graph

Works this paper leans on

92 extracted references · 92 canonical work pages · cited by 7 Pith papers · 7 internal anchors

  1. [1]

    K. G. Malmquist, Meddelanden fran Lunds Astronomiska Observatorium Se- rie I 100, 1 (1922)

  2. [2]

    K. G. Malmquist, Meddelanden fran Lunds Astronomiska Observatorium Se- rie I 106, 1 (1925)

  3. [3]

    Extracting distribution parameters from multiple uncertain observations with selection biases

    I. Mandel, W. M. Farr, and J. R. Gair, Mon. Not. Roy. Astron. Soc. 486, 1086 (2019), 1809.02063

  4. [4]

    T. J. Loredo and D. Q. Lamb, Phys. Rev. D 65, 063002 (2002), astro-ph/ 0107260

  5. [5]

    Exoplanet population inference and the abundance of Earth analogs from noisy, incomplete catalogs

    D. Foreman-Mackey, D. W. Hogg, and T. D. Morton, Astrophys. J. 795, 64 (2014), 1406.3020

  6. [6]

    J. N. Winn and D. C. Fabrycky, Annual Review of Astronomy and Astro- physics 53, 409 (2015), 1410.4199

  7. [7]

    T. J. Loredo and I. M. Wasserman, Astrophys. J. Supp. 96, 261 (1995)

  8. [8]

    T. J. Loredo and I. M. Wasserman, Astrophys. J. 502, 75 (1998), astro-ph/ 9701111

  9. [9]

    Biscoveanu, E

    S. Biscoveanu, E. Thrane, and S. Vitale, Astrophys. J. 893, 38 (2020), 1911. 01379

  10. [10]

    Hayes, I

    F. Hayes, I. S. Heng, J. Veitch, and D. Williams, Astrophys. J.891, 124 (2020), 1911.04190

  11. [11]

    B. P. Abbott et al. (LIGO and Virgo Scientific Collaboration), Astrophys. J. Lett. 882, L24 (2019), 1811.12940

  12. [12]

    B. P. Abbott et al. (LIGO and Virgo Scientific Collaboration), Phys. Rev. X9, 031040 (2019), 1811.12907

  13. [13]

    S. R. Taylor and D. Gerosa, Phys. Rev. D 98, 083017 (2018), 1806.08365

  14. [14]

    Constraints on Binary Black Hole Populations from LIGO-Virgo Detections

    J. Roulet and M. Zaldarriaga, MNRAS 484, 4216 (2019), 1806.10610

  15. [15]
  16. [16]

    Constraining Formation Models of Binary Black Holes with Gravitational-Wave Observations

    M. Zevin, C. Pankow, C. L. Rodriguez, L. Sampson, E. Chase, V . Kalogera, and F. A. Rasio, Astrophys. J. 846, 82 (2017), 1704.07379

  17. [17]

    Use of gravitational waves to probe the formation channels of compact binaries

    S. Vitale, R. Lynch, R. Sturani, and P. Graff, Class. Quant. Grav. 34, 03LT01 (2017), 1503.04307

  18. [18]

    W. M. Farr, S. Stevenson, M. Coleman Miller, I. Mandel, B. Farr, and A. Vec- chio, Nature 548, 426 (2017), 1706.01385

  19. [19]

    Determining the population properties of spinning black holes

    C. Talbot and E. Thrane, Phys. Rev. D 96, 023012 (2017), 1704.08370

  20. [20]

    Fishbach and D

    M. Fishbach and D. E. Holz, Astrophys. J. Lett. 891, L27 (2020), 1905. 12669

  21. [21]

    Del Pozzo, T

    W. Del Pozzo, T. G. F. Li, M. Agathos, C. Van Den Broeck, and S. Vitale, Physical Review Letters 111, 071101 (2013), 1307.8338

  22. [22]

    Chatziioannou, Gen

    K. Chatziioannou (2020), 2006.03168. Inferring populations with selection effects 55

  23. [23]

    Landry, R

    P. Landry, R. Essick, and K. Chatziioannou, Phys. Rev. D101, 123007 (2020), 2003.04880

  24. [24]

    Wysocki, R

    D. Wysocki, R. O’Shaughnessy, L. Wade, and J. Lange (2020),2001.01747

  25. [25]

    B. P. Abbott, R. Abbott, T. D. Abbott, F. Acernese, K. Ackley, C. Adams, T. Adams, P. Addesso, R. X. Adhikari, V . B. Adya, et al., Nature 551, 85 (2017), 1710.05835

  26. [26]

    R. Gray, I. M. Hernandez, H. Qi, A. Sur, P. R. Brady, H.-Y . Chen, W. M. Farr, M. Fishbach, J. R. Gair, A. Ghosh, et al., Phys. Rev. D 101, 122001 (2020), 1908.06050

  27. [27]

    H.-Y . Chen, M. Fishbach, and D. E. Holz, Nature 562, 545 (2018), 1712. 06531

  28. [28]

    S. R. Taylor, J. R. Gair, and I. Mandel, Phys. Rev. D 85, 023535 (2012), 1108.5161

  29. [29]

    Chen, Phys

    H.-Y . Chen, Phys. Rev. Lett.125, 201301 (2020), 2006.02779

  30. [30]

    D. J. Mortlock, S. M. Feeney, H. V . Peiris, A. R. Williamson, and S. M. Nis- sanke, Phys. Rev. D 100, 103523 (2019), 1811.11723

  31. [31]

    S. M. Feeney, H. V . Peiris, A. R. Williamson, S. M. Nissanke, D. J. Mortlock, J. Alsing, and D. Scolnic, Phys. Rev. Lett.122, 061105 (2019),1802.03404

  32. [32]

    S. R. Taylor, J. Simon, and L. Sampson, Phys. Rev. Lett. 118, 181102 (2017), 1612.02817

  33. [33]

    R. J. E. Smith, C. Talbot, F. Hernand ez Vivanco, and E. Thrane, MNRAS496, 3281 (2020), 2004.09700

  34. [34]

    S. Chen, H. Middleton, A. Sesana, W. Del Pozzo, and A. Vecchio, MNRAS 468, 404 (2017), 1612.02826

  35. [35]

    Thrane and C

    E. Thrane and C. Talbot, Publ. Astron. Soc. Austral. 36, e010 (2019), 1809. 02293

  36. [36]

    T. J. Loredo and M. A. Hendry (2019), 1911.12337

  37. [37]

    B. P. Abbott et al. (LIGO and Virgo Scientific Collaboration), Phys. Rev. Lett. 116, 061102 (2016), 1602.03837

  38. [38]

    Abadie et al., Class

    J. Abadie et al., Class. Quantum Grav. 27, 173001 (2010), 1003.2480

  39. [39]

    Double Compact Objects II: Cosmological Merger Rates

    M. Dominik, K. Belczynski, C. Fryer, D. E. Holz, E. Berti, T. Bulik, I. Mandel, and R. O’Shaughnessy, Astrophys. J. 779, 72 (2013), 1308.1546

  40. [40]

    B. P. Abbott et al. (LIGO and Virgo Scientific Collaboration) (2016),https: //dcc.ligo.org/LIGO-P1500217/public/main, 1602.03842

  41. [41]

    W. M. Farr, Research Notes of the American Astronomical Society 3, 66 (2019), 1904.10879

  42. [42]

    B. P. Abbott et al. (LIGO and Virgo Scientific Collaboration) (2016),https: //dcc.ligo.org/LIGO-P1500238/public/main, 1602.03844

  43. [43]
  44. [44]

    S. M. Gaebel, J. Veitch, T. Dent, and W. M. Farr, Mon. Not. Roy. Astron. Soc. 484, 4008 (2019), 1809.03815

  45. [45]

    B. P. Abbott et al. (LIGO and Virgo Scientific Collaboration), Living Reviews in Relativity 19 (2016), 1304.0670

  46. [46]

    Does the Black Hole Merger Rate Evolve with Redshift?

    M. Fishbach, D. E. Holz, and W. M. Farr, Astrophys. J. Lett. 863, L41 (2018), 1805.10270. 56 Vitale et al

  47. [47]

    Robust parameter estimation for compact binaries with ground-based gravitational-wave observations using the LALInference software library

    J. Veitch, V . Raymond, B. Farr, W. Farr, P. Graff, S. Vitale, B. Aylott, K. Black- burn, N. Christensen, M. Coughlin, et al., Phys. Rev. D 91, 042003 (2015), 1409.7215

  48. [48]

    Bilby: A user-friendly Bayesian inference library for gravitational-wave astronomy

    G. Ashton et al., Astrophys. J. Suppl. 241, 27 (2019), 1811.02042

  49. [49]

    MacKay, Information theory, inference, and learning algorithms (Cam- bridge University Press, Cambridge, UK, 2003)

    D. MacKay, Information theory, inference, and learning algorithms (Cam- bridge University Press, Cambridge, UK, 2003)

  50. [50]

    G. M. Harry (LIGO Scientific Collaboration), Class. Quant. Grav. 27, 084006 (2010)

  51. [51]

    Advanced Virgo: a 2nd generation interferometric gravitational wave detector

    F. Acernese et al. (Virgo Collaboration), Class. Quant. Grav. 32, 024001 (2015), 1408.3978

  52. [52]

    html (2020)

    LIGO and Virgo Scientific Collaboration, LIGO/Virgo Public Alerts User Guide, https://emfollow.docs.ligo.org/userguide/index. html (2020)

  53. [53]

    Fishbach, W

    M. Fishbach, W. M. Farr, and D. E. Holz, Astrophys. J. Lett. 891, L31 (2020), 1911.05882

  54. [54]

    W. M. Farr, J. R. Gair, I. Mandel, and C. Cutler, Phys. Rev. D 91, 023005 (2015), 1302.5341

  55. [55]

    C. L. Rodriguez, M. Zevin, C. Pankow, V . Kalogera, and F. A. Rasio, Astro- phys. J. Lett. 832, L2 (2016), 1609.05916

  56. [56]

    Bouffanais, M

    Y . Bouffanais, M. Mapelli, D. Gerosa, U. N. Di Carlo, N. Giacobbo, E. Berti, and V . Baibhav, Astrophys. J.886, 25 (2019), 1905.11054

  57. [57]

    P. A. R. Ade et al. (Planck Collaboration), Astron. Astrophys.594, A13 (2016), 1502.01589

  58. [58]

    A. M. Price-Whelan et al., Astronomical J. 156, 123 (2018), 1801.02634

  59. [59]

    K. S. Thorne, Gravitational radiation (Three Hundred Years of Gravitation, Cambridge University Press, Cambridge UK, 1987), pp. 330–458

  60. [60]

    D. V . Martynov et al., Phys. Rev. D 93, 112004 (2016), [Addendum: Phys.Rev.D 97, 059901 (2018)], 1604.00439

  61. [61]

    B. S. Sathyaprakash and B. F. Schutz, Living Reviews in Relativity 12, 2 (2009), 0903.0338

  62. [62]
  63. [63]

    S. A. Usman et al., Class. Quant. Grav. 33, 215004 (2016), 1508.02357

  64. [64]

    B. P. Abbott et al., Phys. Rev. D 93, 122003 (2016), 1602.03839

  65. [65]

    Gerosa, G

    D. Gerosa, G. Pratten, and A. Vecchio (2020), 2007.06585

  66. [66]

    Wysocki, J

    D. Wysocki, J. Lange, and R. O’Shaughnessy, Phys. Rev. D 100, 043012 (2019), 1805.06442

  67. [67]

    K. K. Ng, S. Vitale, A. Zimmerman, K. Chatziioannou, D. Gerosa, and C.-J. Haster, Phys. Rev. D 98, 083007 (2018), 1805.03046

  68. [68]

    Spin orientations of merging black holes formed from the evolution of stellar binaries

    D. Gerosa, E. Berti, R. O’Shaughnessy, K. Belczynski, M. Kesden, D. Wysocki, and W. Gladysz, Phys. Rev. D98, 084036 (2018), 1808.02491

  69. [69]

    Maggiore, Gravitational Waves, V olume 1: Theory and Experiments (Ox- ford University Press, 2007)

    M. Maggiore, Gravitational Waves, V olume 1: Theory and Experiments (Ox- ford University Press, 2007)

  70. [70]

    Cutler and ´E

    C. Cutler and ´E. E. Flanagan, Phys. Rev. D 49, 2658 (1994), gr-qc/ 9402014. Inferring populations with selection effects 57

  71. [71]

    Abbott et al

    R. Abbott et al. (LIGO and Virgo Scientific Collaboration) (2020), 2004. 08342

  72. [72]

    L. S. Finn and D. F. Chernoff, Phys. Rev. D 47, 2198 (1993), gr-qc/ 9301003

  73. [73]

    L. S. Finn, Phys. Rev. D 53, 2878 (1996), gr-qc/9601048

  74. [74]

    E. E. Flanagan and S. A. Hughes, Phys. Rev. D 57, 4535 (1998), gr-qc/ 9701039

  75. [75]

    Binary compact object coalescence rates: The role of elliptical galaxies

    R. O’Shaughnessy, V . Kalogera, and K. Belczynski, Astrophys. J. 716, 615 (2010), 0908.3635

  76. [76]

    Dominik, E

    M. Dominik, E. Berti, R. O’Shaughnessy, I. Mandel, K. Belczynski, C. Fryer, D. E. Holz, T. Bulik, and F. Pannarale, Astrophys. J. 806, 263 (2015), 1405. 7016

  77. [77]

    B. F. Schutz, Class. Quantum Grav. 28, 125023 (2011), 1102.5421

  78. [78]

    S. W. Hawking and W. Israel, Journal of the British Astronomical Association 99, 196 (1989)

  79. [79]

    B. F. Schutz, Nature 323, 310 (1986)

  80. [80]

    Krolak and B

    A. Krolak and B. F. Schutz, General Relativity and Gravitation 19, 1163 (1987)

Showing first 80 references.