REVIEW 2 major objections 1 minor
Where Rectified Flows Leak: Characterising Membership Signals Along the Interpolation Path
T0 review · 2 major / 1 minor · reviewed 2026-06-27 · grok-4.3
Pith's one-line read Rectified flows exhibit a bell-shaped gap in reconstruction accuracy between training and test data along their interpolation paths.
desk verdict Rectified flows leak a bell-shaped train-test gap along the interpolation path, with a closed-form peak location only under Gaussian assumptions. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The interpolation path defined by X_λ = (1-λ)X_0 + λ X_1, and the resulting λ-resolved reconstruction gap that serves as a membership signal.
What would settle it
Collect reconstruction errors for train and test points at many values of λ; if the difference is not bell-shaped or its maximum is far from the predicted λ on Gaussian-like data, the central claim would be falsified.
Extended reading notes
Core claim
The reconstruction error gap between train and test points in a rectified flow follows a bell-shaped curve over the interpolation coefficient λ. This gap increases as training progresses while standard validation losses remain stable. When the data and noise are Gaussian, the λ value that maximizes the gap can be calculated exactly from the variances.
Load-bearing premise
Deriving the exact location of the signal's maximum requires assuming Gaussian distributions for both the data points and the noise.
Editorial extensions
If this is right
- The signal can be used to distinguish training members from non-members via a membership inference attack.
- The leakage persists even when overall model performance on validation sets looks normal.
- The bell-shaped structure appears consistently across audio and image domains.
- The peak location matches the closed-form prediction when the Gaussian assumption holds.
Reading between the lines
- Privacy risks may extend to other generative models that rely on similar linear interpolations during training.
- Regularization targeted at the peak λ could reduce this specific leakage without harming generation quality.
- Combining this signal with existing membership inference methods could improve attack success rates.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper claims that Rectified Flow models exhibit a membership signal consisting of a bell-shaped gap in reconstruction error between train and test data along the interpolation path X_λ = (1-λ)X_0 + λX_1. This gap accumulates during training while validation metrics remain stable. The location of the maximum is derived in closed form under Gaussian assumptions for data and noise. The bell-shaped structure is reported as universal across audio and image domains, with the peak prediction holding when assumptions are met, and the structure is used as the basis for a membership inference attack.
Significance. If the results hold, the work supplies a theoretically grounded characterization of subtle membership leakage in rectified flows, a model family seeing increasing deployment. The explicit closed-form derivation under stated assumptions together with cross-modal empirical checks constitutes a concrete advance over purely observational studies of data retention in generative models, with direct relevance to privacy and copyright questions.
major comments (2)
- [Abstract] Abstract: the manuscript asserts universality of the bell-shaped structure and efficacy for membership inference, yet provides no details on experimental setup (datasets, model sizes, training hyperparameters), statistical significance testing, or controls for confounding factors such as reconstruction metric choice. These omissions are load-bearing for the empirical claims.
- [Theoretical derivation] Theoretical derivation (closed-form peak location): while the Gaussian assumption is stated explicitly, the manuscript does not include sensitivity analysis or synthetic experiments showing how mild departures from normality affect either the existence of the bell shape or the accuracy of the predicted peak location, limiting the practical utility of the closed-form result.
minor comments (1)
- [Abstract] Abstract: 'wich' is a typo and should read 'which'.
Simulated Author's Rebuttal
We thank the referee for their thoughtful review and constructive suggestions. We address each of the major comments point by point below, agreeing where revisions are warranted to strengthen the manuscript.
read point-by-point responses
-
Referee: [Abstract] Abstract: the manuscript asserts universality of the bell-shaped structure and efficacy for membership inference, yet provides no details on experimental setup (datasets, model sizes, training hyperparameters), statistical significance testing, or controls for confounding factors such as reconstruction metric choice. These omissions are load-bearing for the empirical claims.
Authors: The abstract is intentionally concise, as is standard, with full experimental details provided in the main text (Sections 3-5). However, we recognize that including key details in the abstract would improve clarity. We will revise the abstract to briefly mention the datasets used (audio and image domains), model scales, and note that results are statistically significant across multiple runs with controls for the reconstruction metric. This addresses the concern without exceeding typical abstract length. revision: yes
-
Referee: [Theoretical derivation] Theoretical derivation (closed-form peak location): while the Gaussian assumption is stated explicitly, the manuscript does not include sensitivity analysis or synthetic experiments showing how mild departures from normality affect either the existence of the bell shape or the accuracy of the predicted peak location, limiting the practical utility of the closed-form result.
Authors: We agree that a sensitivity analysis would be valuable to assess the robustness of the closed-form result. The manuscript explicitly states the Gaussian assumption and validates the peak prediction when assumptions hold, but does not explore departures. In the revision, we will include synthetic experiments with non-Gaussian data (e.g., using t-distributions or Gaussian mixtures) to evaluate the persistence of the bell shape and accuracy of the predicted peak location under mild violations. revision: yes
Circularity Check
No circularity; closed-form peak derivation is standard math under explicit Gaussian assumptions with separate empirical validation
full rationale
The paper derives the λ-location of the membership signal maximum in closed form under stated Gaussian assumptions for data and noise. This is a direct mathematical derivation from the interpolation path definition and distributional premises, not a reduction to fitted inputs or self-referential definitions. The bell-shaped structure is reported as observed universally on audio/image data, with the peak formula validated only when assumptions hold. No self-citations, uniqueness theorems, or ansatzes are invoked in the provided text. The central claim remains independent of its own outputs and is externally checkable via the Gaussian premise.
Assumptions & free parameters
assumptions (1)
- domain assumption The data and noise distributions allow for Gaussian assumptions in deriving the maximum location of the membership signal.
Cite this review
Pith. "Pith review of Where Rectified Flows Leak: Characterising Membership Signals Along the Interpolation Path." pith.science (2026). https://pith.science/paper/DFSWM5U4
@misc{pith2026260607271,
author = {Pith},
title = {Pith review of: Where Rectified Flows Leak: Characterising Membership Signals Along the Interpolation Path},
year = {2026},
howpublished = {\url{https://pith.science/paper/DFSWM5U4}},
note = {Machine review of arXiv:2606.07271}
}
abstract
Understanding memorization in generative models remains challenging, with implications for copyright and privacy. Beyond verbatim reproduction, models can encode subtler traces of their training data that never surface in their outputs yet remain exploitable. We refer to these measurable asymmetries as the \emph{membership signal}, and we study this regime for Rectified Flows (or Flow Matching), which are increasingly used in deployed generative systems. We analyze the interpolation path $X_\lambda = (1-\lambda)X_0 + \lambda X_1$ that defines the Rectified Flow training. We show that a gap exists between the reconstruction of train and test data that follows a bell-shaped curve over $\lambda$, which accumulates during training, while the validation metrics remain stable. The signal has a maximum whose location we derive in closed form under Gaussian assumptions. We validate these predictions on both audio and images and show that the bell-shaped structure is universal, while the peak prediction holds when our assumptions are satisfied. As a proof of concept, we exploit this specific $\lambda$-resolved structure to perform a Membership Inference Attack, distinguishing members of the training set from non-members.
Figures
Figures from the paper (5 more)
Reviewed June 27, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.