Assessment of normalizing flows for parameter estimation on time-frequency representations of gravitational-wave data

Daniel Lanchares; Joaqu\'in Gonz\'alez-Nuevo; Jos\'e A. Font; Luigi Toffolatti; Lysiane Mornas; Osvaldo G. Freitas; Pietro Vischia

REVIEW 2 major objections 1 minor 1 cited by

A normalizing flow model on RGB images of BBH spectrograms recovers LVK parameter estimates for most quantities.

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

T0 review · grok-4.3

2026-05-22 15:13 UTC pith:NEYNERQR

load-bearing objection This paper shows a fast spectrogram-to-RGB normalizing flow that matches LVK posteriors on real GWTC events but trains only on clean simulations without noise or PSD conditioning. the 2 major comments →

arxiv 2505.08089 v3 pith:NEYNERQR submitted 2025-05-12 gr-qc astro-ph.IM

Assessment of normalizing flows for parameter estimation on time-frequency representations of gravitational-wave data

Daniel Lanchares , Osvaldo G. Freitas , Lysiane Mornas , Jos\'e A. Font , Joaqu\'in Gonz\'alez-Nuevo , Luigi Toffolatti , Pietro Vischia This is my paper

classification gr-qc astro-ph.IM

keywords gravitational wavesparameter estimationnormalizing flowsbinary black holesspectrogramsdeep learningLIGOVirgo

verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper presents GP15, a method that converts time-frequency spectrograms of binary black hole gravitational-wave signals from LIGO and Virgo into RGB images and processes them with residual networks combined with normalizing flows. Trained exclusively on IMRPhenomXPHM simulations, the model is tested on all three-detector events from the GWTC-3 and GWTC-2.1 catalogs. It produces posterior samples in roughly one second and shows good agreement with the official LVK results over most parameters. A sympathetic reader would care because rapid sampling could complement slower traditional methods as the number of detected events grows.

Core claim

GP15 maps BBH spectrograms from the Advanced LIGO and Advanced Virgo detectors to color channels in an RGB image and uses residual networks with normalizing flows to estimate binary black hole parameters. The model is trained on IMRPhenomXPHM waveform simulations and tested on real three-detector events reported in the GWTC-3 and GWTC-2.1 catalogs. It yields good agreement with LVK results over most parameters and can generate large numbers of posterior samples in about one second.

What carries the argument

GP15, which converts BBH spectrograms to RGB images and applies residual networks together with normalizing flows to produce parameter posteriors

Load-bearing premise

Converting BBH spectrograms into RGB images and training exclusively on IMRPhenomXPHM simulations is sufficient to recover accurate posteriors on real detector data without explicit noise conditioning.

What would settle it

A side-by-side comparison of the model's posterior distributions against LVK results for mass ratio, effective spin, or luminosity distance on a fresh set of real events would reveal whether agreement holds or breaks for specific parameters.

Watch this falsifier — get emailed when new claim-graph text bears on it.

If this is right

Large numbers of posterior samples can be generated in roughly one second.
The approach complements existing normalizing flow methods that operate directly on time or frequency representations.
Shortcomings such as the lack of detector PSD noise conditioning limit current performance.
Splitting the parameter space into intrinsic and extrinsic subspaces offers one route for future refinement.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

The image-based format might allow the same architecture to incorporate additional data channels such as strain amplitude alongside the spectrogram.
Retraining on a broader set of waveform approximants could reduce systematic differences when the model is applied to events whose signals deviate from IMRPhenomXPHM.
Integration with existing LVK pipelines could provide rapid initial posteriors that are later refined by slower samplers.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Desk Editor's Note

This paper shows a fast spectrogram-to-RGB normalizing flow that matches LVK posteriors on real GWTC events but trains only on clean simulations without noise or PSD conditioning.

read the letter

Colleague, the main thing to take from this paper is that their GP15 model converts BBH spectrograms into RGB images, runs them through a residual network plus normalizing flow, and gets reasonable agreement with the official LVK parameter estimates on the three-detector events in GWTC-2.1 and GWTC-3. It also generates large numbers of posterior samples in roughly a second, which is the practical selling point. What is actually new is the specific choice to treat the time-frequency representation as a color image and feed it to this established architecture for gravitational-wave parameter estimation. They build directly on their earlier work and then validate the output against real catalog results rather than stopping at simulated injections. That combination is incremental but concrete, and the speed advantage over standard sampling is clear. The paper does a decent job laying out the method and noting where it falls short. The soft spot is the training setup. Everything comes from noise-free IMRPhenomXPHM waveforms with no PSD conditioning or marginalization over noise realizations. Real detector data has colored, event-dependent noise, so the distribution shift is real and could bias results, especially for extrinsic parameters or marginal events. The authors flag noise conditioning as future work, which is honest, but it means the current agreement is more of a demonstration than a fully stress-tested result. Quantitative metrics and ablation studies on the RGB encoding would help pin down how much of the performance comes from the image representation versus other choices. This is for researchers already working on machine-learning methods for gravitational-wave inference who want to explore image-based inputs as a complement to time- or frequency-domain flows. A reader focused on practical speed-ups for the LVK era would get value from the implementation and the real-event tests. It deserves a serious referee because the work is grounded in actual catalog comparisons and ships a usable model, even if revisions are needed on the noise side. I would send it to peer review.

Referee Report

2 major / 1 minor

Summary. The manuscript introduces GP15, a deep-learning method that converts BBH spectrograms from Advanced LIGO and Advanced Virgo into RGB images and employs residual networks combined with normalizing flows to estimate binary black hole parameters. The model is trained exclusively on noise-free simulations generated with the IMRPhenomXPHM waveform approximant and evaluated on three-detector events from the GWTC-3 and GWTC-2.1 catalogs, with the central claim being overall good agreement with LVK collaboration results alongside rapid generation of large numbers of posterior samples in approximately one second.

Significance. If validated with quantitative metrics, this image-based normalizing flow approach offers a potentially useful complement to existing time- or frequency-domain machine-learning methods for gravitational-wave parameter estimation, particularly for its speed in producing posterior samples. The work acknowledges current limitations and suggests future directions such as noise conditioning, which helps frame its scope as an initial assessment rather than a complete replacement for standard Bayesian pipelines.

major comments (2)

[Abstract] Abstract: The claim that the model 'yields good agreement with the LVK results over most parameters' is presented without any quantitative metrics (e.g., median errors, credible-interval coverage fractions, or posterior overlap measures), error budgets, or ablation studies. This absence makes it impossible to assess whether the reported agreement is statistically meaningful or affected by post-hoc selections.
[Methods] Methods (training procedure): The model is trained solely on clean IMRPhenomXPHM simulations without any conditioning on detector PSDs or marginalization over noise realizations. Real GWTC events contain colored Gaussian noise whose statistics vary by event and detector; the resulting distribution shift is load-bearing for the claim of applicability to real data, especially for extrinsic parameters and events near detection thresholds. The abstract itself identifies noise conditioning as a required future extension.

minor comments (1)

[Abstract] Abstract: The description of the spectrogram-to-RGB conversion lacks sufficient detail on channel assignment, frequency scaling, and time-frequency resolution to allow independent reproduction of the input representation.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for their constructive and detailed comments, which have helped clarify the scope and presentation of our work. We address each major comment below and outline the revisions we will make to the manuscript.

read point-by-point responses

Referee: [Abstract] Abstract: The claim that the model 'yields good agreement with the LVK results over most parameters' is presented without any quantitative metrics (e.g., median errors, credible-interval coverage fractions, or posterior overlap measures), error budgets, or ablation studies. This absence makes it impossible to assess whether the reported agreement is statistically meaningful or affected by post-hoc selections.

Authors: We agree that the abstract statement would be more precise if supported by explicit quantitative references. In the revised manuscript we will update the abstract to note that agreement is assessed via direct comparison of median posterior values and 90% credible-interval widths for the full set of three-detector events in GWTC-2.1 and GWTC-3, with the complete event list and all parameter comparisons shown in the results section (Figures 3–5 and associated tables). We will also state that no post-hoc event selection was performed. These changes will allow readers to evaluate the strength of the agreement directly from the reported figures and tables. revision: yes
Referee: [Methods] Methods (training procedure): The model is trained solely on clean IMRPhenomXPHM simulations without any conditioning on detector PSDs or marginalization over noise realizations. Real GWTC events contain colored Gaussian noise whose statistics vary by event and detector; the resulting distribution shift is load-bearing for the claim of applicability to real data, especially for extrinsic parameters and events near detection thresholds. The abstract itself identifies noise conditioning as a required future extension.

Authors: We concur that the absence of noise conditioning and PSD marginalization constitutes a genuine limitation when applying the model to real data. The manuscript already frames the work as an initial assessment and explicitly lists noise conditioning as a required future extension. In the revision we will expand the methods section to describe the clean-simulation training set in greater detail and add a dedicated paragraph in the discussion that addresses the expected impact of the distribution shift, particularly on extrinsic parameters. We will also reiterate that the current results on GWTC events should be viewed as a proof-of-concept demonstration rather than a fully noise-robust pipeline. revision: yes

Circularity Check

0 steps flagged

No significant circularity; validation relies on external LVK benchmarks

full rationale

The paper presents an empirical ML pipeline: spectrograms from IMRPhenomXPHM simulations are converted to RGB images, a residual-network + normalizing-flow model is trained, and posteriors are generated for real GWTC events then compared directly to independent LVK catalog results. No equations, fitted parameters, or self-citations reduce the reported agreement to a quantity defined by the model's own inputs. The comparison to LVK provides external falsifiability outside any fitted values in the present work. The mention of 'building on our early work' for the RGB mapping is a minor self-citation that does not bear the central performance claim.

Axiom & Free-Parameter Ledger

1 free parameters · 1 axioms · 0 invented entities

The approach depends on standard machine-learning assumptions plus domain-specific modeling choices whose validity is not independently verified in the provided abstract.

free parameters (1)

neural-network weights and hyperparameters
The residual network and normalizing-flow parameters are learned from simulated data; their specific values are not reported.

axioms (1)

domain assumption Simulated BBH signals generated with IMRPhenomXPHM are statistically representative of real Advanced LIGO/Virgo observations for the purpose of training and validation.
The entire training and testing pipeline rests on this assumption.

pith-pipeline@v0.9.0 · 5785 in / 1385 out tokens · 35875 ms · 2026-05-22T15:13:39.365963+00:00 · methodology

0 comments

read the original abstract

The speed-up of parameter estimation is an active field of research in gravitational-wave data analysis. In this paper we present GP15, a deep-learning method that merges residual networks and normalizing flows into a general-purpose, image-based estimator of binary black hole (BBH) parameters. Building on our early work, we map BBH spectrograms from the Advanced LIGO and Advanced Virgo detectors to color channels in an RGB image amenable to be processed with residual networks. GP15 is trained on simulated data for BBH mergers obtained with the \texttt{IMRPhenomXPHM} waveform approximant and tested for all three-detector events from the GWTC-3 and GWTC-2.1 catalogs reported by the LIGO-Virgo-KAGRA (LVK) collaboration. Overall, our model yields good agreement with the LVK results over most parameters. Our simple model can produce large amounts of posterior samples in the order of a second, complementing existing approaches with normalizing flows based on time or frequency representation of gravitational-wave data. We also discuss current shortcomings of our model and possible improvements for future extensions (e.g. including noise conditioning from the detectors' PSD or splitting the parameter space into intrinsic and extrinsic subspaces).

Figures

Figures reproduced from arXiv: 2505.08089 by Daniel Lanchares, Joaqu\'in Gonz\'alez-Nuevo, Jos\'e A. Font, Luigi Toffolatti, Lysiane Mornas, Osvaldo G. Freitas, Pietro Vischia.

**Figure 2.** Figure 2: FIG. 2: Model diagram depicting the flow of information [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗

**Figure 3.** Figure 3: The average training loss decreases monotonically [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗

**Figure 4.** Figure 4: FIG. 4: Jensen-Shannon divergences for all three-detector events of GWTC-2.1 [5] with posterior distributions match [PITH_FULL_IMAGE:figures/full_fig_p005_4.png] view at source ↗

**Figure 5.** Figure 5: FIG. 5: Jensen-Shannon divergences for all three-detector events of GWTC-3 [4] with posterior distributions matching [PITH_FULL_IMAGE:figures/full_fig_p006_5.png] view at source ↗

**Figure 6.** Figure 6: FIG. 6: Comparison (90% credible intervals) between the estimations of all compatible events and parameters of [31]. [PITH_FULL_IMAGE:figures/full_fig_p007_6.png] view at source ↗

discussion (0)

Lean theorems connected to this paper

Citations machine-checked in the Pith Canon. Every link opens the source theorem in the public Lean library.

IndisputableMonolith/Cost/FunctionalEquation.lean washburn_uniqueness_aczel unclear

?

unclear
Relation between the paper passage and the cited Recognition theorem.

rational-quadratic coupling transform … masked affine autoregressive transform … ResNet-18 as embedder

What do these tags mean?

matches: The paper's claim is directly supported by a theorem in the formal canon.
supports: The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
extends: The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
uses: The paper appears to rely on the theorem as machinery.
contradicts: The paper's claim conflicts with a theorem or certificate in the canon.
unclear: Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

Model-Agnostic Population Inference for Gravitational-Wave Astronomy: From LVK to LISA
astro-ph.IM 2026-01 conditional novelty 5.0

A flow-guided mixture density network with Gaussian copulas recovers black-hole merger population shapes and rates from sparse, selection-biased gravitational-wave catalogs.