{"id":"16a2574a-e447-4efe-8e37-ac303bedcceb","arxiv_id":"2611.17035","paper_version":1,"verdict":"ACCEPT","confidence":"HIGH","novelty_score":7.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":3,"one_line_summary":"A method to bound the prevalence of watermarked text in a corpus using a power envelope derived from the watermark mechanism, with finite-sample guarantees and calibration sensitivity analysis.","lead":"This paper derives statistical bounds on the share of watermarked documents in a corpus, even when every document may be edited by an unknown amount. The bounds use a power envelope based on three interpretable budgets and are valid for finite samples, with careful treatment of null calibration and sensitivity.","discovery_kind":"new_method","skeptic_critique":{"model":"deepseek/deepseek-v4-flash","headline":"The envelope's strictness condition for substitutions (σmax ≤ εmin δ/(1−δ)) is derived under the assumption that the substitution pivot bound Fsub(x;1−δ) is the worst case, but Lemma 2's KGW bound is not proved to be pointwise maximal; if the true worst-case substitution pivot distribution is…","rationale":"The reader's weakest_assumption was the exact null (Assumption 1). While that is indeed critical, the paper studies its sensitivity extensively (Section 5, Table 4) and provides a calibrated null alternative (Proposition 6). The reader's verdict of ACCEPT with high confidence seems to accept that the null sensitivity is adequately addressed. My concern is different: it targets the validity of the KGW envelope itself when substitutions are allowed (σmax > 0). The paper's Lemma 2 for KGW only bounds the mean green probability, not the full distribution. Proposition 2 then uses this mean bound to construct a stochastic dominance argument via Lemma 3, but Lemma 3 requires pointwise dominance of the distribution function, not just of the mean. For Gumbel-max, Lemma 2 provides the exact distribution function F_sub, so the envelope is on solid ground. For KGW, the paper does not prove that the pivot distribution at a substituted position is stochastically dominated by Bernoulli(¯μ). This is a gap in the proof of Proposition 2 for the case σmax > 0. The paper's own experiments show that KGW paraphrase pools fall below the envelope (Table 6), which is consistent with this gap being practically relevant. The paper acknowledges this as a limitation (Section 7: 'LLM paraphrasing is outside that model'), but the gap is more fundamental: even within the edit model (1), the KGW envelope with substitutions may not be valid. The concrete test I propose would settle whether this gap is real or can be closed. If the test shows the envelope is valid, then the paper's claims for KGW with substitutions are supported. If not, the KGW results with σmax > 0 are unreliable, and the paper should either restrict σmax=0 for KGW or derive a proper distributional bound. I therefore recommend CONDITIONAL acceptance, contingent on resolving this gap. I disagree with the reader's assessment that the weakest assumption is the exact null; the KGW envelope gap is more load-bearing because it is not studied in the paper and could invalidate a core theoretical contribution.","tokens_in":35629,"tokens_out":1185,"duration_ms":7410,"concrete_test":"For a fixed KGW configuration (γ=0.5, b=2, large vocabulary), simulate the exact pivot distribution at a substituted position under the worst-case NTP P*=(1−δ,δ,0,...) and the worst-case substitution token (the one with highest probability under P* that is not the emitted token). Compute the exact distribution function of the green indicator at that position, and compare it pointwise to Bernoulli(¯μ) where ¯μ uses the bound g_sub(1−δ). If the true distribution function is pointwise ≤ Bernoulli(¯μ) (i.e., the true green probability is at least ¯μ and the distribution is stochastically dominated), then the envelope is valid. If not, the envelope is invalid for KGW with substitutions. This test can be done analytically or by exhaustive enumeration for small |V| (e.g., |V|=10) and Monte Carlo for larger |V|.","verdict_should_be":"CONDITIONAL","load_bearing_attack":"The paper's central identification result (Theorem 1) and all downstream bounds rely on the power envelope h(t;n,εmin,δ) or h_KGW(t;n). For KGW with substitutions, the envelope uses a lower bound on the green probability at a substituted position: g_sub(q) ≥ g_sub(1−δ) (Lemma 2). However, Lemma 2 only proves that the green probability of a substituted token is at least g_sub(q), and that g_sub(q) is decreasing in q. It does not prove that this bound is pointwise maximal in the sense that the entire pivot distribution function is stochastically dominated by a worst-case distribution. For Gumbel-max, Lemma 2 gives the exact distribution function F_sub(x;q) and proves it is pointwise ≥ x, so the envelope uses a genuine worst-case distribution. For KGW, the envelope only uses a bound on the mean (green probability), not on the full distribution. Proposition 2 then constructs h_KGW by assuming that the pivot is Bernoulli with probability at least ¯μ, which is a mean-only bound. If the true distribution of a substituted KGW pivot is not stochastically dominated by Bernoulli(¯μ) (i.e., if its distribution function is not pointwise ≤ that of Bernoulli(¯μ)), then the stochastic dominance argument (Lemma 3) fails, and the envelope may not be valid. The paper does not address this gap. The KGW envelope is therefore on weaker theoretical ground than the Gumbel-max envelope when σmax > 0. The paper acknowledges that 'the KGW paraphrase pools fall below the envelope at moderate thresholds' (Section 6), which is consistent with this gap being real. The load-bearing concern is that the KGW envelope with substitutions may not be a valid lower bound on the alternative distribution, potentially invalidating the upper bound of the identified set for KGW when σmax > 0.","agreement_with_reader":"disagree"},"referee_report":{"model":"deepseek/deepseek-v4-flash","summary":"The paper studies the problem of estimating the share of watermarked documents in a corpus when each document may have been edited. It derives a power envelope for the alternative distribution of p-values under Gumbel-max and green-list (KGW) watermarks, using three budgets: a retention floor εmin, a substitution cap σmax, and an entropy budget δ. The envelope yields finite-sample bounds on the realized share of watermarked documents in a fixed corpus (Propositions 5 and 6), confidence sequences for streams (Theorem 2), and an identified set under i.i.d. sampling (Corollary 1). The paper includes extensive simulations and experiments with real models (OPT-1.3B, Qwen3-1.7B) to validate coverage and examine sensitivity to null deviations and assumption violations. The central claim is that the envelope provides a valid and useful restriction on the alternative, enabling meaningful prevalence bounds despite unknown per-document edits.","tokens_in":36209,"tokens_out":3019,"duration_ms":26988,"significance":"If the results hold, the paper makes a significant contribution to the statistical theory of watermark auditing. It moves beyond per-document detection to corpus-level prevalence estimation, a problem of practical importance for providers and auditors. The envelope is derived from the watermark mechanism and interpretable budgets, and the bounds are finite-sample and non-asymptotic. The paper also provides a thorough sensitivity analysis, including null calibration and the impact of assumption violations. The code and experiments are reproducible. The work is likely to be influential in the watermarking community and in applied statistics for partial identification.","major_comments":[{"comment":"The KGW envelope (Proposition 2) relies on a mean-only bound for the green probability at a substituted position (Lemma 2). The envelope then assumes that the pivot is Bernoulli with probability at least ¯μ, which is a stochastic dominance claim. However, Lemma 2 only provides a lower bound on the mean (green probability), not on the entire distribution. For the stochastic dominance argument (Lemma 3) to hold, one needs that the distribution function of the substituted pivot is pointwise ≤ that of Bernoulli(¯μ). The paper does not prove this; it only proves that the mean is at least ¯μ. This is a gap in the theoretical foundation for the KGW envelope when σmax > 0. The paper acknowledges that 'the KGW paraphrase pools fall below the envelope at moderate thresholds' (abstract, §6), but the issue is not just empirical: the envelope itself may not be valid under the stated assumptions. The authors should either prove the required stochastic dominance or state the envelope as a heuristic bound that is not guaranteed to be conservative.","section":"§3.1, Lemma 2 (KGW part)","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The proof of Lemma 2 for KGW uses a pairing argument and claims that the posterior odds of the replacement token being green are at least gsub(q). However, the derivation assumes that the emission probability under the list in A is at least 1/(1+cq) times that under its partner. This inequality is not fully justified: it relies on the fact that the green mass of the list in A exceeds that of its partner by at most q, but the emission probability is a nonlinear function of the green mass (φ(S) = e^b S/(1+cS)). The paper states that 'the emission probability under the list in A is at least 1/(1+cq) times that under its partner', but this requires a proof that φ(S_A) / φ(S_B) ≥ 1/(1+cq) given S_A - S_B ≤ q. This is not obvious and is not proved. The Monte Carlo check (sim/substitution.py) is not a proof. This weakens the theoretical support for the KGW envelope.","section":"§3.1, Lemma 2 (KGW part)","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The sharpness claim in Theorem 1 is with respect to the relaxed class Grel_n, not the actual mechanism class A(εmin, δ). The paper acknowledges this in §3.2 and Appendix B, but the practical relevance of sharpness is limited because the relaxed class is larger. The paper attempts to quantify the loss via a linear programming diagnostic (Appendix C) but notes that 'two processes also cannot show that the relaxed class is nearly lossless in general' (line b575). This is a significant caveat: the bounds may be wider than necessary for the true mechanism class. The authors should discuss the implications for the interpretation of the bounds: they are valid but potentially conservative, and the degree of conservatism is unknown in general.","section":"§3.2, Theorem 1","authors_acknowledge":"Two processes also cannot show that the relaxed class is nearly lossless in general.","authors_acknowledge_p":0.91},{"comment":"The conservative envelope h_low is computed using a lattice approximation and floating-point tolerance. The paper states that 'the floating-point error is measured, not bounded' and that 'at n = 100, 200, 300, the envelope with Δs = 0.01 is conservative by at most 0.024 relative to a lattice four times finer.' This is a numerical check, not a rigorous guarantee. For longer documents (n up to 1000) the check was not performed. The paper subtracts a tolerance of 10^{-8} and clips to [0,1], but this does not provide a formal guarantee that h_low ≤ h pointwise. Given that the bounds are finite-sample and rely on h_low being a lower bound, this is a concern. The authors should either provide a rigorous bound on the discretization error or state that the envelope is approximate and the bounds are valid only up to numerical error.","section":"§4.1, Conservative envelope","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"Table 2 shows that when the assumption on δ is violated (top probability 0.9 with assumed δ=0.2, i.e., maxP ≤ 0.8), coverage drops to 0.00. This is a load-bearing issue: the envelope is not robust to violations of the entropy budget. The paper acknowledges this in Remark 1 and §6, but the practical implication is that the bounds are only valid if the user can guarantee that max_w P_t(w) ≤ 1-δ at every scored position. The paper shows that in real models, 10-19% of positions exceed this threshold (Table 6), so the per-position condition is routinely violated. The paper argues that the document-level condition may still hold, but this is not proved. The sensitivity analysis in Table 2 is for a specific violation (deterministic remainder), but other violations may also cause undercoverage. The authors should discuss the practical difficulty of verifying the entropy budget and the consequences of its violation.","section":"§5, Table 2","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The paper reports that for KGW paraphrase pools, the normalized ratio r_s(t) falls below 1 in every stratum, down to 0.39 for OPT with KGW. This indicates that the envelope is violated for these pools. Yet the bounds still covered at N=2000. The paper explains this by noting that the sampling slack (β_s) can mask violations. This is a crucial point: coverage in moderate-sized corpora does not validate the envelope. The paper should emphasize more strongly that the bounds are only guaranteed under the assumptions, and that empirical coverage in experiments does not imply the assumptions hold. The current discussion in §7 ('What the slack hides') is good, but it should be elevated to a major caveat in the abstract or introduction.","section":"§6, Table 6 and surrounding text","authors_acknowledge":"Coverage at N = 2000 therefore does not validate the envelope; violations that persist in the population can matter as the sampling slack shrinks.","authors_acknowledge_p":0.94}],"minor_comments":[{"comment":"The abstract states 'the threshold that maximizes the gap between envelope and null is generally as tight as twelve thresholds.' This is unclear: does 'as tight as twelve thresholds' mean that using twelve thresholds is no better than using the single best threshold? Please rephrase for clarity.","section":"Abstract","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The phrase 'the upper end of the identified set is 1' appears twice (abstract and §1). It is correct but could be stated more precisely: the upper end is 1 without restrictions on the alternative.","section":"§1, Introduction","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The notation F_s,it is used but not defined until Lemma 2. Consider defining it earlier or adding a forward reference.","section":"§2, Equation (1)","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The Gumbel-max part of Lemma 2 gives F_sub(x;q) = x^{1/q} + x(1 - x^{1/q-1})/(1-q). Please verify the expression: the second term should be x(1 - x^{1/q-1})/(1-q) or x(1 - x^{1/q-1})/(1-q)? The paper writes 'x(1−x 1/q−1)1−q' which is ambiguous. Please use parentheses.","section":"§3.1, Lemma 2","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The KGW bound g_sub(q) = g / {g + (1-g)(1+cq)} is derived under the assumption that the replacement token is drawn independently of the key. The paper should state this assumption explicitly in the lemma statement.","section":"§3.1, Lemma 2","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The proof sketch says 'When F_n ≠ U we have π_{n,L} > 0, so π > 0 throughout'. This is not strictly necessary for the argument; it is fine.","section":"§3.2, Theorem 1","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The expression for Δ_KGW(δ) uses p_{10} = γ|V|(|V| - γ|V|) / (|V|(|V|-1)). This simplifies to γ(1-γ) * |V|/(|V|-1). Please state the simplified form for clarity.","section":"§3.3, Proposition 2","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The bound uses β_s = {N_s log(2KJ/α)/2}^{1/2}. This is from Azuma-Hoeffding. The paper should note that this bound can be improved with a time-uniform or empirical-Bernstein bound, but it is fine for the fixed-N setting.","section":"§4.2, Proposition 5","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The boundary bd_k uses a mixture over λ ~ N(0, 1/ρ). The paper should cite the source of this boundary (Robbins 1970, Howard et al. 2021) more explicitly in the theorem statement.","section":"§4.5, Theorem 2","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The column 'maxh−t' is the single threshold maximizing h(t)-t. The paper should state whether this threshold is chosen with knowledge of the true parameters or from the envelope alone. It appears to be from the envelope alone, which is fine.","section":"§5, Table 3","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The table shows coverage for η = +0.005, +0.010, etc. The paper should clarify that η is the deviation from uniformity at t=0.5, and that the distribution is H(t) = t - 4η t(1-t). This is a specific parametric deviation; the results may not generalize to other forms of null deviation.","section":"§5, Table 4","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The table reports average lower and upper ends. The paper should also report the range or standard deviation of the bounds across corpora to give a sense of variability.","section":"§6, Table 5","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The paper describes an earlier undercoverage that did not replicate on fresh data. This is important but the explanation is somewhat buried. Consider moving it to a more prominent location or summarizing the lesson in the discussion.","section":"§6, 'The earlier undercoverage'","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The paper recommends reporting the upper end over a range of budgets. This is good advice. The paper could also recommend reporting the lower end from the Storey-type estimator, which is more robust.","section":"§7, Discussion","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The proof for KGW is sketchy. The paper says 'Exhaustive enumeration over all green lists for |V|=10 and 300 random NTPs confirmed the bound'. This is not a proof. The authors should either provide a rigorous proof or state the bound as a conjecture supported by simulations.","section":"Appendix A, Proof of Lemma 2","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The betting confidence sequence assumes that P(Z_i = 1 | F_{i-1}) = π, i.e., the prevalence is constant. This is a stronger assumption than the stream setting of Theorem 2, which allows arbitrary drift. The paper should clarify this difference.","section":"Appendix E, Theorem 3","authors_acknowledge":null,"authors_acknowledge_p":null}],"recommendation":"major_revision"},"author_rebuttal":null,"desk_editor":{"model":"deepseek/deepseek-v4-flash","letter":"The paper delivers what it promises: a mechanism-derived power envelope that turns three user-chosen budgets (εmin, σmax, δ) into finite-sample bounds on the share of watermarked documents in a corpus, with clean theory and honest empirical work. I read the proofs and the central claims hold up. The genuinely new piece is Lemma 2: an in-place substitution leaves the replacement under the original key draw, so for Gumbel-max edited positions look less watermarked than human text, not merely null — which corrects the usual hybrid-text model in a conservative direction and is why the substitution budget enters the envelope at all.\n\nI do not think the stress-test concern about the KGW envelope survives reading. For a Bernoulli pivot the distribution function is determined by the success probability, so a lower bound on the conditional green probability is exactly a pointwise upper bound on the conditional distribution function — precisely Lemma 3's hypothesis — and the count then dominates Bin(n, ¯µ) by the standard quantile coupling. The KGW envelope with substitutions stands on the same footing as the Gumbel-max one, given Lemma 2's green-probability bound, whose proof is sketched but structurally right. The real gap is the class, not the envelope: LLM paraphrasing is outside A(εmin, δ), and the paper's Table 6 shows KGW paraphrase pools fall below the envelope at moderate thresholds. The paper owns this and warns that coverage at N = 2000 is too weak to validate the envelope.\n\nSoft spots, in proportion. The Gumbel envelope's validity rests on a floating-point tolerance that is measured, not bounded (10^-8); a purist referee will ask for interval arithmetic. Monotonicity of h in n is numerical, not proven, and the stratum-min envelope relies on it. Both are minor. Lemma 2's KGW bound deserves full detail in the journal version. The bounds are wide in the honest regime ([0.14, 0.38] at share 0.2), the envelope is informative only when σmax ≤ εmin δ/(1−δ), and the budgets cannot be estimated from the audited corpus, so the paper's advice to report over a budget range is right but limits the bite. The exact null is load-bearing at scale: their own simulation shows a null error of 0.01 breaks coverage at 100,000 documents, and the calibrated null is the right fix.\n\nCredit where due: 12,000 fresh human documents, three keys, the earlier Qwen3 undercoverage reported rather than buried, the \"what the slack hides\" decomposition, and code plus data released for everything. Careful, reproducible work. The audience is statisticians working on two-groups partial identification and key holders who want to run real audits.\n\nSend it to serious peer review; accept with minor revision. Expand the proof sketches, address the floating-point caveat, and the envelope, the identification theorem, and the calibration analysis all stand.","headline":"A mechanism-derived power envelope that actually delivers finite-sample prevalence bounds for edited watermarks; the theory holds, the honesty about limits is exemplary, and the KGW-envelope stress-test concern dissolves on inspection.","tokens_in":36629,"tokens_out":10947,"duration_ms":71373},"pith_extraction":{"msc":["62G10","62G15","62L10"],"pacs":[],"model":"deepseek/deepseek-v4-flash","headline":"The watermark-origin share of an edited corpus is not a point estimate but a finite-sample interval, sharp for the alternatives the mechanism's power envelope dominates.","keywords":["watermark prevalence","partial identification","power envelope","Gumbel-max watermark","green-list watermark","finite-sample bounds","confidence sequences","null calibration"],"falsifier":"Score 100,000 known human-only documents under one fixed key and measure the largest deviation of the empirical p-value distribution from uniform; if the deviation reaches 0.01 while the exact-null bounds of Proposition 5 still claim 95 percent coverage on corpora mixing these humans with least-favourable watermarked documents, the exact-null guarantee is falsified. The paper's own paraphrase pools offer a second probe: running its KGW paraphrase experiment at $N \\ge 20{,}000$ should produce undercoverage once the sampling slack shrinks below the observed envelope shortfall.","tokens_in":37208,"feed_emoji":"📊","tokens_out":12962,"duration_ms":93094,"temperature":0.7,"pith_summary":"Watermark detectors answer one text at a time; this paper asks what share of a whole corpus came from the watermarked model after users edited the documents. Its central claim is that this share is only partially identified — without edit restrictions the upper end of any honest interval is 1 — but the watermark mechanism itself supplies a power envelope that, under three budgets (a retention floor, an entropy cap, and a budget for in-place substitutions), yields finite-sample bounds on the realized share of a fixed corpus. A key discovery is that a substituted position keeps a key draw under which the replacement token lost, so Gumbel-max edits make edited text look less watermarked than human text rather than merely null. If the paper is right, a key-holding auditor can report an interval such as $[0.14, 0.38]$ when the true share is 0.2 on real-model text, monitor streams with anytime-valid sequences, and know precisely where the guarantee breaks: a null deviation of 0.01 is invisible at 2,000 documents yet destroys exact-null coverage at 100,000.","feed_headline":"Three budgets bound the share of edited AI text in a corpus","feed_subtitle":"Edits blur the signal, yet a power envelope pins the watermark share to intervals like [0.14, 0.38].","key_machinery":"The load-bearing object is the power envelope $h(t;n,\\varepsilon_{\\min},\\delta)$, a pointwise lower bound on the p-value distribution of any watermarked document whose edits respect the three budgets, defined as $\\mathbb{P}(\\bar T_n \\ge \\bar\\Gamma_n^{-1}(t))$ where $\\bar T_n$ sums $-\\log(1-\\bar Y_t)$ for independent draws $\\bar Y_t$ from the worst-case pivot distribution $\\bar F(x)=(1-\\varepsilon_{\\min}-\\sigma_{\\max})x+\\varepsilon_{\\min}F^*(x;\\delta)+\\sigma_{\\max}F_{\\mathrm{sub}}(x;1-\\delta)$. It is assembled from three parts: the least-favourable two-point next-token distribution $P^*=(1-\\delta,\\delta,0,\\ldots)$ that maximizes the single-pivot distribution under the entropy cap (Lemma 1), the substitution lemma $F_{\\mathrm{sub}}(x)\\ge x$ showing in-place replacements subtract signal for Gumbel-max (Lemma 2), and a sequential coupling that lifts position-wise stochastic dominance to the full-document statistic (Lemma 3). The envelope converts per-position budgets into a restriction on the alternative in the two-groups mixture, so that Theorem 1's upper endpoint $\\inf_t (F_n(t)-t)/(h_n(t)-t)$ is below 1 and sharp over the relaxed class. For inference the envelope is evaluated conservatively by lattice truncation and FFT convolution, then fed into martingale bounds (Azuma–Hoeffding for fixed corpora, mixture supermartingales for streams) to produce simultaneous finite-sample statements.","core_discovery":"The paper claims that the watermark-origin share of a corpus is a partial-identification problem whose identified set can be made informative by translating the watermark mechanism into a document-level power envelope $h(t;n,\\varepsilon_{\\min},\\delta)$, the least probability that an edited watermarked document's p-value falls below $t$ over the mechanism class. Three results carry the argument. Lemma 2 shows that for Gumbel-max an in-place substitution leaves the key draw under which the replacement lost, so substituted pivots stochastically exceed null pivots ($F_{\\mathrm{sub}}(x)\\ge x$): edited text looks less watermarked than human text, and the usual edit model that treats edited positions as null is optimistic. Theorem 1 then shows the identified set $[\\pi_L,\\pi_U]$ with $\\pi_U=\\inf_t (F_n(t)-t)/(h_n(t)-t)$ is sharp over the relaxed class of alternatives that dominate the envelope, for both Gumbel-max and the green-list scheme (closed form in Proposition 2). On the inference side, Propositions 5 and 6 bound the realized share of a fixed, heterogeneous corpus under an exact or reference-calibrated null, and Theorem 2 gives a confidence sequence for drifting streams. The empirical claim is that on real OPT and Qwen3 text the exact null holds approximately (no coherent departure in 12,000 fresh human documents under three keys), the bounds cover in resampling trials with random edits, substitutions and paraphrases, and the fragility is quantitative: LLM-paraphrased KGW pools fall below the envelope, and a 0.01 null error that is harmless at 2,000 documents breaks coverage at 100,000.","pith_inferences":["If these bounds were deployed on platform-scale corpora, the practical bottleneck would shift to reference-sample design: the calibrated null requires reference documents from the same population as the audited corpus, and the paper leaves open how to build such a sample when a corpus mixes domains.","Because Gumbel-max substitutions make edited text look less watermarked than human text, an adversarial editor who knows the budgets could edit at rates just inside the tolerance to keep the share unidentifiable; the paper's assumption that edits are made without regard to tokens is the natural target for an adversarial stress test.","A testable extension suggested by the KGW paraphrase failure is to replace the in-place edit restriction with a semantic-distance restriction on rewrites and check whether a corresponding envelope recovers the power that the paraphrase pools lose.","For instruction-tuned or low-temperature models the entropy budget $\\delta$ should bind harder, since the paper itself notes that post-trained models produce lower-entropy text; running its per-stratum ratio check $r_s(t)$ on such models' own generations would show where the envelope starts to fail before any prevalence claim is made."],"forward_implications":["A key-holding auditor can replace the question 'is this text watermarked?' with 'what fraction of this corpus is?', and answer with an interval — about [0.14, 0.38] at a true share of 0.2 on real-model text under the exact null.","Detection counts with worst-case sensitivity are far wider in the low-power regime (upper ends of 0.56–0.75 versus about 0.38 for the envelope bound), so the envelope, not the null correction, is what makes prevalence statements useful.","Prevalence is unidentifiable when next-token distributions may be point masses (Proposition 3): nearly deterministic text such as code, templates, or lists cannot be audited for watermark origin, whatever the retention assumption.","Corpus size changes the meaning of empirical support: coverage at 2,000 documents says little, because the sampling slack shrinks like $N^{-1/2}$ while a null error or envelope violation does not; large audits need the calibrated null of Proposition 6 and a reference sample large enough to stay narrow.","Text streams with drifting adoption can be monitored at every stopping time by Theorem 2's confidence sequence, with no stationarity assumption and labels chosen adaptively so long as each label is fixed before its document is seen."],"supporting_citations":[{"why":"Supplies the least-favourable next-token distribution under the entropy cap (Lemma 1), the load-bearing input to the power envelope.","marker":"Li et al. (2025a)"},{"why":"Defines the Gumbel-max watermark whose uniform pivot is the null law the bounds rely on.","marker":"Aaronson (2023)"},{"why":"Defines the green-list (KGW) watermark whose green-pivot law the closed-form envelope of Proposition 2 bounds.","marker":"Kirchenbauer et al. (2023)"},{"why":"Provides the hybrid human-watermarked edit model that equation (1) extends with per-document retention and substitution rates.","marker":"Li et al. (2026)"},{"why":"Introduces the within-document watermark-proportion problem and the pivot model whose per-token identification results the paper contrasts with its document-level bounds.","marker":"Li et al. (2025b)"},{"why":"Gives the two-groups mixture identified set whose unrestricted upper end is 1 and whose lower endpoint the paper reuses.","marker":"Genovese and Wasserman (2004)"},{"why":"Motivates the null-corrected detection rate that the paper shows cannot estimate the corpus share.","marker":"Storey (2002)"},{"why":"Supplies the time-uniform confidence-sequence machinery behind Theorem 2's mixture boundary.","marker":"Howard et al. (2021)"},{"why":"Supplies the hedged betting capital process that the appendix's fixed-prevalence confidence sequence builds on.","marker":"Waudby-Smith and Ramdas (2024)"}],"fun_headline_variants":[],"cache_read_input_tokens":0,"weakest_assumption_plain":"The load-bearing premise is the exact null together with the three-budget edit model; of the two, the exact null is the one most likely to give way, because a deviation of 0.01 in the human p-value distribution — comparable to the largest the paper's own 12,000-document sample can detect — is absorbed at 2,000 documents but destroys coverage at 100,000.","fun_headline_variants_meta":{"raw":{"variants":[]},"model":"deepseek/deepseek-v4-flash","effort":"low","cost_usd":0.000106,"raw_usage":{"cost":0.0001055782,"is_byok":false,"cost_details":{"upstream_inference_cost":0.0001055782,"upstream_inference_prompt_cost":0.0001052142,"upstream_inference_completions_cost":3.64e-07},"total_tokens":1363,"prompt_tokens":1361,"completion_tokens":2,"prompt_tokens_details":{"audio_tokens":0,"video_tokens":0,"cached_tokens":256,"cache_write_tokens":0},"completion_tokens_details":{"audio_tokens":0,"image_tokens":0,"reasoning_tokens":0}},"tokens_in":1361,"tokens_out":2,"cost_source":"openrouter_usage","duration_ms":2145,"image_pages":[],"temperature":1.0,"billed_attempts":1,"reasoning_tokens":0,"transport_provider":"openrouter","cache_read_input_tokens":0,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-11-13T07:12:15.945529+00:00","model_set":{"reader":"deepseek/deepseek-v4-flash"},"pipeline_version":"pith-pipeline@v1.4.1-daily-deepseek-or-medium","input_kind":null,"input_chars":null,"input_total_chars":null,"passes_missing":null,"published_standing":null,"published_confidence":null,"objection_audit":null,"run_record":null,"basis":{"kind":"not_recorded","source":null,"chars_given":null,"chars_total":null},"receipt":null,"falsifier":"Score 100,000 known human-only documents under one fixed key and measure the largest deviation of the empirical p-value distribution from uniform; if the deviation reaches 0.01 while the exact-null bounds of Proposition 5 still claim 95 percent coverage on corpora mixing these humans with least-favourable watermarked documents, the exact-null guarantee is falsified. The paper's own paraphrase pools offer a second probe: running its KGW paraphrase experiment at $N \\ge 20{,}000$ should produce undercoverage once the sampling slack shrinks below the observed envelope shortfall.","supporting_citations":[],"lane_accuracy":{"status":"not yet measured","lane":{"model":"deepseek/deepseek-v4-flash","input_kind":null},"url":"https://pith.science/accuracy"},"review_version":1}