Inferring the properties of a population of compact binaries in presence of selection effects
Pith reviewed 2026-05-24 13:42 UTC · model grok-4.3
The pith
The equations for hierarchical Bayesian inference of compact binary populations can be derived from first principles even when selection effects are present.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The posterior for the population hyperparameters is given by the product, over all detected events, of the integral of the single-event likelihood times the population density, divided by the population-averaged detection probability, all obtained directly from the joint probability of the data and the population model without additional assumptions about the form of either.
What carries the argument
The selection-aware hierarchical likelihood, which marginalizes each event's parameters under the population model and normalizes by the integral of the detection probability weighted by that same model.
If this is right
- Catalogs of detected compact binaries can be used to infer whether one or several underlying populations are required.
- Population parameters such as mass and spin distributions can be estimated without the bias that would arise from ignoring varying detection probabilities.
- The same expressions apply when new events are added to the catalog, allowing sequential updating of the population inference.
- The framework remains valid for any observational selection process that can be expressed as a detection probability for each source.
Where Pith is reading between the lines
- Once the statistical expressions are fixed, the dominant remaining uncertainty in any application is the accuracy with which the detection probability can be computed for the specific instrument and search pipeline.
- The derivation structure suggests the same first-principles steps could be repeated for time-dependent populations or for selection effects that correlate across multiple observables.
- The method provides a template for correcting selection biases in other selected samples, such as flux-limited astronomical surveys or clinical trial recruitment.
Load-bearing premise
The probability that any given source is detected can be calculated or modeled accurately enough that the selection function introduces no uncontrolled bias into the population inference.
What would settle it
A Monte Carlo simulation in which the input population parameters are known exactly, the detection probability is computed without error, and the derived posterior fails to recover those parameters within the expected statistical uncertainty would show the first-principles equations are incorrect.
read the original abstract
Shortly after a new class of objects is discovered, the attention shifts from the properties of the individual sources to the question of their origin: do all sources come from the same underlying population, or several populations are required? What are the properties of these populations? As the detection of gravitational waves is becoming routine and the size of the event catalog increases, finer and finer details of the astrophysical distribution of compact binaries are now within our grasp. This Chapter presents a pedagogical introduction to the main statistical tool required for these analyses: hierarchical Bayesian inference in the presence of selection effects. All key equations are obtained from first principles, followed by two examples of increasing complexity. Although many remarks made in this Chapter refer to gravitational-wave astronomy, the write-up is generic enough to be useful to researchers and graduate students from other fields.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript presents a pedagogical derivation from first principles of the hierarchical Bayesian posterior for inferring the properties of a population of compact binaries, explicitly incorporating selection effects via the normalization over detectable events. It supplies two worked examples of increasing complexity and emphasizes applicability beyond gravitational-wave astronomy.
Significance. If the derivations hold, the work provides a self-contained, first-principles reference that lowers the barrier for researchers and students applying hierarchical inference to selection-biased catalogs. Explicit credit is due for the generic framing and the step-by-step construction of the selection-function integral, which matches the standard construction in the literature without hidden circularity.
minor comments (2)
- The abstract states that 'all key equations are obtained from first principles,' yet the manuscript would benefit from an explicit statement (near the start of §2) confirming that the detection probability p(det|θ) is treated as an externally supplied function rather than derived internally.
- In the second example, the transition from the single-event likelihood to the population-level integral could include a one-sentence reminder of the change of variables that converts the integral over detectable events into the form shown in Eq. (X).
Simulated Author's Rebuttal
We thank the referee for their positive review and recommendation to accept the manuscript. The assessment correctly identifies the pedagogical intent and the generic framing of the derivations, which we aimed to achieve.
Circularity Check
No significant circularity; derivation from first principles is self-contained
full rationale
The paper is a pedagogical review that derives the standard hierarchical Bayesian posterior p(θ|d) ∝ p(d|θ)p(θ) with selection effects entering via the normalization integral, explicitly from first principles as stated in the abstract. No load-bearing step reduces by construction to a fitted parameter, self-citation chain, or ansatz smuggled from prior work by the same authors; the central equations follow directly from Bayes' theorem and the definition of detectability without internal redefinition or renaming of known results. This matches the most common honest finding for self-contained pedagogical derivations against external benchmarks.
Axiom & Free-Parameter Ledger
axioms (1)
- standard math Standard rules of probability and Bayesian inference hold and can be applied directly to the detection process.
Forward citations
Cited by 7 Pith papers
-
End-to-End Population Inference from Gravitational-Wave Strain using Transformers
Dingo-Pop uses a transformer to perform amortized, end-to-end population inference from GW strain data in seconds, bypassing per-event Monte Carlo sampling.
-
First measurement of the Hubble constant from a combined weak lensing and gravitational-wave standard siren analysis
Joint analysis of LVK standard sirens and DES 3x2pt data yields H0 = 67.9 +4.4/-4.3 km s^{-1} Mpc^{-1} at 6.4% precision while tightening the Omega_m constraint by 22%.
-
Signatures of a subpopulation of hierarchical mergers in the GWTC-4 gravitational-wave dataset
GWTC-4 data show a transition to nearly all hierarchical mergers above 46 solar masses, with the hierarchical rate peaking at 15.7 solar masses, indicating mass-dependent substructure in black hole spins.
-
Evidence of the pair instability gap from black hole masses
GWTC-4 data reveals a pair-instability gap at 44 M_⊙ in secondary black hole masses, interpreted as evidence for hierarchical mergers and used to constrain the S-factor for 12C(α,γ)16O.
-
Gravitational-wave constraints on $H_0$ are robust to (putative) redshift evolution in the binary black hole mass spectrum at current sensitivity
Spectral-siren H0 constraints from GWTC-4.0 binary black holes remain robust when the mass spectrum is permitted to evolve with redshift at current detector sensitivity.
-
Emergent structure in the binary black hole mass distribution and implications for population-based cosmology
B-spline agnostic reconstruction of binary black hole masses from GWTC-4.0 reveals multiple features and a logarithmic hierarchy that impacts Hubble constant measurements, with a low-mass subpopulation isolation metho...
-
Gravitational-wave astronomy requires population-informed parameter estimation
Population-informed hierarchical parameter estimation is required for unbiased astrophysical interpretation of gravitational-wave events rather than using standard individual posteriors with reference priors.
Reference graph
Works this paper leans on
-
[1]
K. G. Malmquist, Meddelanden fran Lunds Astronomiska Observatorium Se- rie I 100, 1 (1922)
work page 1922
-
[2]
K. G. Malmquist, Meddelanden fran Lunds Astronomiska Observatorium Se- rie I 106, 1 (1925)
work page 1925
-
[3]
Extracting distribution parameters from multiple uncertain observations with selection biases
I. Mandel, W. M. Farr, and J. R. Gair, Mon. Not. Roy. Astron. Soc. 486, 1086 (2019), 1809.02063
-
[4]
T. J. Loredo and D. Q. Lamb, Phys. Rev. D 65, 063002 (2002), astro-ph/ 0107260
work page 2002
-
[5]
Exoplanet population inference and the abundance of Earth analogs from noisy, incomplete catalogs
D. Foreman-Mackey, D. W. Hogg, and T. D. Morton, Astrophys. J. 795, 64 (2014), 1406.3020
-
[6]
J. N. Winn and D. C. Fabrycky, Annual Review of Astronomy and Astro- physics 53, 409 (2015), 1410.4199
-
[7]
T. J. Loredo and I. M. Wasserman, Astrophys. J. Supp. 96, 261 (1995)
work page 1995
-
[8]
T. J. Loredo and I. M. Wasserman, Astrophys. J. 502, 75 (1998), astro-ph/ 9701111
work page 1998
-
[9]
S. Biscoveanu, E. Thrane, and S. Vitale, Astrophys. J. 893, 38 (2020), 1911. 01379
work page 2020
- [10]
- [11]
-
[12]
B. P. Abbott et al. (LIGO and Virgo Scientific Collaboration), Phys. Rev. X9, 031040 (2019), 1811.12907
work page internal anchor Pith review Pith/arXiv arXiv 2019
-
[13]
S. R. Taylor and D. Gerosa, Phys. Rev. D 98, 083017 (2018), 1806.08365
-
[14]
Constraints on Binary Black Hole Populations from LIGO-Virgo Detections
J. Roulet and M. Zaldarriaga, MNRAS 484, 4216 (2019), 1806.10610
-
[15]
Measuring the binary black hole mass spectrum with an astrophysically motivated parameterization
C. Talbot and E. Thrane, Astrophys. J. 856, 173 (2018), 1801.02699
-
[16]
Constraining Formation Models of Binary Black Holes with Gravitational-Wave Observations
M. Zevin, C. Pankow, C. L. Rodriguez, L. Sampson, E. Chase, V . Kalogera, and F. A. Rasio, Astrophys. J. 846, 82 (2017), 1704.07379
-
[17]
Use of gravitational waves to probe the formation channels of compact binaries
S. Vitale, R. Lynch, R. Sturani, and P. Graff, Class. Quant. Grav. 34, 03LT01 (2017), 1503.04307
-
[18]
W. M. Farr, S. Stevenson, M. Coleman Miller, I. Mandel, B. Farr, and A. Vec- chio, Nature 548, 426 (2017), 1706.01385
-
[19]
Determining the population properties of spinning black holes
C. Talbot and E. Thrane, Phys. Rev. D 96, 023012 (2017), 1704.08370
-
[20]
M. Fishbach and D. E. Holz, Astrophys. J. Lett. 891, L27 (2020), 1905. 12669
work page 2020
-
[21]
W. Del Pozzo, T. G. F. Li, M. Agathos, C. Van Den Broeck, and S. Vitale, Physical Review Letters 111, 071101 (2013), 1307.8338
work page Pith/arXiv arXiv 2013
-
[22]
K. Chatziioannou (2020), 2006.03168. Inferring populations with selection effects 55
- [23]
-
[24]
D. Wysocki, R. O’Shaughnessy, L. Wade, and J. Lange (2020),2001.01747
-
[25]
B. P. Abbott, R. Abbott, T. D. Abbott, F. Acernese, K. Ackley, C. Adams, T. Adams, P. Addesso, R. X. Adhikari, V . B. Adya, et al., Nature 551, 85 (2017), 1710.05835
- [26]
-
[27]
H.-Y . Chen, M. Fishbach, and D. E. Holz, Nature 562, 545 (2018), 1712. 06531
work page 2018
-
[28]
S. R. Taylor, J. R. Gair, and I. Mandel, Phys. Rev. D 85, 023535 (2012), 1108.5161
- [29]
- [30]
-
[31]
S. M. Feeney, H. V . Peiris, A. R. Williamson, S. M. Nissanke, D. J. Mortlock, J. Alsing, and D. Scolnic, Phys. Rev. Lett.122, 061105 (2019),1802.03404
-
[32]
S. R. Taylor, J. Simon, and L. Sampson, Phys. Rev. Lett. 118, 181102 (2017), 1612.02817
work page Pith/arXiv arXiv 2017
- [33]
-
[34]
S. Chen, H. Middleton, A. Sesana, W. Del Pozzo, and A. Vecchio, MNRAS 468, 404 (2017), 1612.02826
work page Pith/arXiv arXiv 2017
-
[35]
E. Thrane and C. Talbot, Publ. Astron. Soc. Austral. 36, e010 (2019), 1809. 02293
work page 2019
- [36]
-
[37]
B. P. Abbott et al. (LIGO and Virgo Scientific Collaboration), Phys. Rev. Lett. 116, 061102 (2016), 1602.03837
work page internal anchor Pith review Pith/arXiv arXiv 2016
-
[38]
J. Abadie et al., Class. Quantum Grav. 27, 173001 (2010), 1003.2480
work page Pith/arXiv arXiv 2010
-
[39]
Double Compact Objects II: Cosmological Merger Rates
M. Dominik, K. Belczynski, C. Fryer, D. E. Holz, E. Berti, T. Bulik, I. Mandel, and R. O’Shaughnessy, Astrophys. J. 779, 72 (2013), 1308.1546
-
[40]
B. P. Abbott et al. (LIGO and Virgo Scientific Collaboration) (2016),https: //dcc.ligo.org/LIGO-P1500217/public/main, 1602.03842
-
[41]
W. M. Farr, Research Notes of the American Astronomical Society 3, 66 (2019), 1904.10879
-
[42]
B. P. Abbott et al. (LIGO and Virgo Scientific Collaboration) (2016),https: //dcc.ligo.org/LIGO-P1500238/public/main, 1602.03844
-
[43]
M. Zevin et al., Class. Quant. Grav. 34, 064003 (2017), 1611.04596
-
[44]
S. M. Gaebel, J. Veitch, T. Dent, and W. M. Farr, Mon. Not. Roy. Astron. Soc. 484, 4008 (2019), 1809.03815
-
[45]
B. P. Abbott et al. (LIGO and Virgo Scientific Collaboration), Living Reviews in Relativity 19 (2016), 1304.0670
work page internal anchor Pith review Pith/arXiv arXiv 2016
-
[46]
Does the Black Hole Merger Rate Evolve with Redshift?
M. Fishbach, D. E. Holz, and W. M. Farr, Astrophys. J. Lett. 863, L41 (2018), 1805.10270. 56 Vitale et al
-
[47]
J. Veitch, V . Raymond, B. Farr, W. Farr, P. Graff, S. Vitale, B. Aylott, K. Black- burn, N. Christensen, M. Coughlin, et al., Phys. Rev. D 91, 042003 (2015), 1409.7215
-
[48]
Bilby: A user-friendly Bayesian inference library for gravitational-wave astronomy
G. Ashton et al., Astrophys. J. Suppl. 241, 27 (2019), 1811.02042
work page internal anchor Pith review Pith/arXiv arXiv 2019
-
[49]
D. MacKay, Information theory, inference, and learning algorithms (Cam- bridge University Press, Cambridge, UK, 2003)
work page 2003
-
[50]
G. M. Harry (LIGO Scientific Collaboration), Class. Quant. Grav. 27, 084006 (2010)
work page 2010
-
[51]
Advanced Virgo: a 2nd generation interferometric gravitational wave detector
F. Acernese et al. (Virgo Collaboration), Class. Quant. Grav. 32, 024001 (2015), 1408.3978
work page internal anchor Pith review Pith/arXiv arXiv 2015
-
[52]
LIGO and Virgo Scientific Collaboration, LIGO/Virgo Public Alerts User Guide, https://emfollow.docs.ligo.org/userguide/index. html (2020)
work page 2020
-
[53]
M. Fishbach, W. M. Farr, and D. E. Holz, Astrophys. J. Lett. 891, L31 (2020), 1911.05882
-
[54]
W. M. Farr, J. R. Gair, I. Mandel, and C. Cutler, Phys. Rev. D 91, 023005 (2015), 1302.5341
-
[55]
C. L. Rodriguez, M. Zevin, C. Pankow, V . Kalogera, and F. A. Rasio, Astro- phys. J. Lett. 832, L2 (2016), 1609.05916
-
[56]
Y . Bouffanais, M. Mapelli, D. Gerosa, U. N. Di Carlo, N. Giacobbo, E. Berti, and V . Baibhav, Astrophys. J.886, 25 (2019), 1905.11054
-
[57]
P. A. R. Ade et al. (Planck Collaboration), Astron. Astrophys.594, A13 (2016), 1502.01589
-
[58]
A. M. Price-Whelan et al., Astronomical J. 156, 123 (2018), 1801.02634
-
[59]
K. S. Thorne, Gravitational radiation (Three Hundred Years of Gravitation, Cambridge University Press, Cambridge UK, 1987), pp. 330–458
work page 1987
-
[60]
D. V . Martynov et al., Phys. Rev. D 93, 112004 (2016), [Addendum: Phys.Rev.D 97, 059901 (2018)], 1604.00439
-
[61]
B. S. Sathyaprakash and B. F. Schutz, Living Reviews in Relativity 12, 2 (2009), 0903.0338
-
[62]
S. Sachdev et al. (2019), 1901.08580
-
[63]
S. A. Usman et al., Class. Quant. Grav. 33, 215004 (2016), 1508.02357
-
[64]
B. P. Abbott et al., Phys. Rev. D 93, 122003 (2016), 1602.03839
- [65]
-
[66]
D. Wysocki, J. Lange, and R. O’Shaughnessy, Phys. Rev. D 100, 043012 (2019), 1805.06442
-
[67]
K. K. Ng, S. Vitale, A. Zimmerman, K. Chatziioannou, D. Gerosa, and C.-J. Haster, Phys. Rev. D 98, 083007 (2018), 1805.03046
-
[68]
Spin orientations of merging black holes formed from the evolution of stellar binaries
D. Gerosa, E. Berti, R. O’Shaughnessy, K. Belczynski, M. Kesden, D. Wysocki, and W. Gladysz, Phys. Rev. D98, 084036 (2018), 1808.02491
-
[69]
Maggiore, Gravitational Waves, V olume 1: Theory and Experiments (Ox- ford University Press, 2007)
M. Maggiore, Gravitational Waves, V olume 1: Theory and Experiments (Ox- ford University Press, 2007)
work page 2007
-
[70]
C. Cutler and ´E. E. Flanagan, Phys. Rev. D 49, 2658 (1994), gr-qc/ 9402014. Inferring populations with selection effects 57
work page 1994
-
[71]
R. Abbott et al. (LIGO and Virgo Scientific Collaboration) (2020), 2004. 08342
work page 2020
-
[72]
L. S. Finn and D. F. Chernoff, Phys. Rev. D 47, 2198 (1993), gr-qc/ 9301003
work page 1993
-
[73]
L. S. Finn, Phys. Rev. D 53, 2878 (1996), gr-qc/9601048
-
[74]
E. E. Flanagan and S. A. Hughes, Phys. Rev. D 57, 4535 (1998), gr-qc/ 9701039
work page 1998
-
[75]
Binary compact object coalescence rates: The role of elliptical galaxies
R. O’Shaughnessy, V . Kalogera, and K. Belczynski, Astrophys. J. 716, 615 (2010), 0908.3635
-
[76]
M. Dominik, E. Berti, R. O’Shaughnessy, I. Mandel, K. Belczynski, C. Fryer, D. E. Holz, T. Bulik, and F. Pannarale, Astrophys. J. 806, 263 (2015), 1405. 7016
work page 2015
-
[77]
B. F. Schutz, Class. Quantum Grav. 28, 125023 (2011), 1102.5421
-
[78]
S. W. Hawking and W. Israel, Journal of the British Astronomical Association 99, 196 (1989)
work page 1989
-
[79]
B. F. Schutz, Nature 323, 310 (1986)
work page 1986
-
[80]
A. Krolak and B. F. Schutz, General Relativity and Gravitation 19, 1163 (1987)
work page 1987
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.