Strong duality for the GROW criterion
Pith reviewed 2026-06-25 21:45 UTC · model grok-4.3
The pith
The GROW value for bounded e-variables always equals the relative entropy of a weak-* joint information projection pair that exists between any composite null and alternative.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
We identify a weak-* joint information projection pair between arbitrary Pcal and Qcal that always exists and show that the GROW value for bounded e-variables always equals the relative entropy of this pair, without any restrictions on Pcal or Qcal. We also prove a similarly general strong duality for the REGROW criterion with bounded e-variables and arbitrary bounded offsets. Under various assumptions our results extend to unbounded e-variables, and examples show that without any assumptions such extensions fail.
What carries the argument
The weak-* joint information projection pair between the composite null Pcal and alternative Qcal, whose relative entropy equals the GROW value for bounded e-variables.
If this is right
- The GROW criterion for bounded e-variables admits strong duality via relative entropy for arbitrary composite hypotheses.
- A similar strong duality holds for the REGROW criterion with bounded e-variables and arbitrary bounded offsets.
- Extensions of the duality to unbounded e-variables hold only under additional assumptions, with counterexamples otherwise.
- The results are analogous to strong duality statements that swap tests for bounded e-variables, minimax risk for the GROW criterion, and total variation for relative entropy.
Where Pith is reading between the lines
- Optimal bounded e-variables might be located by solving for the joint projection pair instead of directly optimizing the original minimax expression.
- The same projection technique could apply to other log-optimal betting problems in sequential hypothesis testing.
- Numerical checks on simple cases such as bounded support distributions could confirm whether the equality holds exactly as predicted.
Load-bearing premise
A weak-* joint information projection pair always exists for any arbitrary composite null and alternative sets of distributions.
What would settle it
A specific pair of composite sets Pcal and Qcal for which either no such weak-* projection pair exists or the GROW value for bounded e-variables does not equal the relative entropy of the pair.
read the original abstract
This paper presents general strong duality results when testing hypotheses by betting against them. A bet is an e-variable for a composite null hypothesis $\mathcal{P}$: a nonnegative random variable $X$ whose expected value is at most one under every $\P \in \Pcal$. Following Kelly, Breiman, Cover, Shafer, Gr\"unwald and others, we study a natural minimax \emph{log-optimality} criterion: given a composite alternative $\Qcal$, we characterize the ``GROW value'' $\sup_{X} \inf_{\Q} \E_{\Q}[\log X]$. This paper generalizes the results of \cite{larsson2025numeraire} from (arbitrary $\Pcal$ and) simple $\Qcal$ to arbitrary $\Qcal$. We identify a weak-$*$ joint information projection pair between arbitrary $\Pcal$ and $\Qcal$ that always exists and show that the GROW value for \emph{bounded} e-variables always equals the relative entropy of this pair, without any restrictions on $\Pcal$ or $\Qcal$. We also prove a similarly general strong duality for the REGROW criterion with bounded e-variables and arbitrary bounded offsets. Under various assumptions our results extend to unbounded e-variables, and examples show that without any assumptions such extensions fail. Our results are analogous to those in~\cite{larsson2026complete}, swapping tests for bounded e-variables, minimax risk for the GROW criterion, and total variation for relative entropy.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper presents general strong duality results for the GROW criterion when testing composite hypotheses via e-variables. It generalizes prior work on simple alternatives to arbitrary composite Qcal, claiming that a weak-* joint information projection pair (P*,Q*) between arbitrary Pcal and Qcal always exists, and that the GROW value for bounded e-variables equals the relative entropy D(Q*||P*) with no restrictions on the sets. Analogous strong duality is shown for the REGROW criterion with bounded e-variables and arbitrary bounded offsets. Extensions to unbounded e-variables hold under various assumptions, with counterexamples showing failures without them. The results are positioned as analogous to complete-class theorems, replacing tests with bounded e-variables, minimax risk with GROW, and total variation with relative entropy.
Significance. If the claimed existence of the weak-* joint projection pair and the resulting duality hold in full generality, this provides a parameter-free characterization of the GROW value via relative entropy, extending the theoretical toolkit for log-optimal betting and e-value based inference to fully composite settings. The generality for bounded e-variables without restrictions on Pcal or Qcal would be a clear advance over the cited prior results, with the counterexamples for unbounded cases adding useful boundary clarification.
major comments (1)
- [Abstract] Abstract (and main duality theorem): The assertion that a weak-* joint information projection pair always exists for arbitrary Pcal and Qcal is load-bearing for the strong duality claim that GROW equals D(Q*||P*) with no restrictions. The manuscript must supply the explicit argument establishing attainment in the weak* topology, including verification that the relative entropy functional is lower semi-continuous and that the relevant sets admit a minimizer (e.g., via compactness in the dual ball); without this, the equality cannot be guaranteed in the stated generality.
Simulated Author's Rebuttal
We thank the referee for the careful reading and the detailed comment on the existence argument. We address the point below.
read point-by-point responses
-
Referee: [Abstract] Abstract (and main duality theorem): The assertion that a weak-* joint information projection pair always exists for arbitrary Pcal and Qcal is load-bearing for the strong duality claim that GROW equals D(Q*||P*) with no restrictions. The manuscript must supply the explicit argument establishing attainment in the weak* topology, including verification that the relative entropy functional is lower semi-continuous and that the relevant sets admit a minimizer (e.g., via compactness in the dual ball); without this, the equality cannot be guaranteed in the stated generality.
Authors: We agree that the existence claim is central and that the current write-up would benefit from a more self-contained verification. In the revision we will add an explicit subsection (or appendix) proving attainment of the weak-* joint information projection pair. The argument will (i) recall that relative entropy is lower semi-continuous with respect to the weak-* topology on probability measures, (ii) establish that the relevant constraint sets are weak-* compact (via the Banach-Alaoglu theorem applied to the dual ball), and (iii) conclude existence of a minimizer by the standard compactness-plus-lsc argument. This will be inserted into the proof of the main duality theorem so that the generality statement is fully justified. revision: yes
Circularity Check
No significant circularity; derivation is self-contained mathematical proof
full rationale
The paper claims to prove existence of a weak-* joint information projection pair for arbitrary composite sets and to establish equality between the GROW value (for bounded e-variables) and relative entropy of that pair. This is presented as a direct generalization of prior results to the composite case, with the proofs supplied in the manuscript itself rather than reduced to inputs by definition, fitted parameters renamed as predictions, or load-bearing self-citations. Analogous results in cited works are referenced for context but do not substitute for the claimed derivations here. No self-definitional, ansatz-smuggling, or renaming patterns appear in the provided abstract or structure.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption Existence of a weak-* joint information projection pair between arbitrary composite null Pcal and alternative Qcal
Reference graph
Works this paper leans on
-
[1]
Optimal e-values for testing the mean of a bounded random variable against a composite alternative
Sebastian Arnold and Eugenio Clerico. Optimal e-values for testing the mean of a bounded random variable against a composite alternative. arXiv preprint arXiv:2601.11347, 2026
arXiv 2026
-
[2]
Vladimir I. Bogachev. Measure Theory, volume 1 and 2. Springer-Verlag, Berlin, Heidelberg, 2007. ISBN 978-3-540-34513-8. doi:10.1007/978-3-540-34514-5
-
[3]
Optimal gambling systems for favorable games
Leo Breiman. Optimal gambling systems for favorable games. Berkeley Symp. on Math. Statist. and Prob, 1961
1961
-
[4]
Gambling Research: Gambling and Risk Taking,
Thomas M Cover. Log optimal portfolios. In Chapter in “Gambling Research: Gambling and Risk Taking,” Seventh International Conference, volume 4, 1987
1987
-
[5]
I-divergence geometry of probability distributions and minimization problems
I Csiszar. I-divergence geometry of probability distributions and minimization problems. The Annals of Probability, 3 0 (1): 0 146--158, 1975
1975
-
[6]
Pitt, Positively correlated normal variables are associated, Ann
Imre Csisz \' a r. Sanov property, generalized I -projection and a conditional limit theorem. The Annals of Probability, 12 0 (3): 0 768--793, 08 1984. doi:10.1214/aop/1176993227
-
[7]
Large Deviations Techniques and Applications, volume 38
Amir Dembo and Ofer Zeitouni. Large Deviations Techniques and Applications, volume 38. Springer Science & Business Media, 2009
2009
-
[8]
Judith ter Schure and Peter Grünwald
Peter Gr \"u nwald, Rianne de Heide, and Wouter Koolen. Safe testing. Journal of the Royal Statistical Society Series B: Statistical Methodology, 86 0 (5): 0 1091--1128, 11 2024 a . doi:10.1093/jrsssb/qkae011
-
[9]
Growth-optimal e-variables and an extension to the multivariate Csiszar-Sanov-Chernoff theorem
Peter Gr \"u nwald, Yunda Hao, and Akshay Balsubramani. Growth-optimal e-variables and an extension to the multivariate Csiszar-Sanov-Chernoff theorem. arXiv preprint arXiv:2412.17554, 2024 b
arXiv 2024
-
[10]
Huber and Volker Strassen
Peter J. Huber and Volker Strassen. Minimax tests and the N eyman- P earson lemma for capacities. Ann. Statist., 1: 0 251--263, 1973. ISSN 0090-5364,2168-8966
1973
-
[11]
A new interpretation of information rate
John L Kelly. A new interpretation of information rate. The Bell System Technical Journal, 35 0 (4): 0 917--926, 1956
1956
-
[12]
Some conditions for consistency and uniform consistency of statistical procedures
Charles Kraft. Some conditions for consistency and uniform consistency of statistical procedures. University of California Publication in Statistics, 2: 0 125--141, 1955
1955
-
[13]
u nwald, and Peter Harremo \
Tyron Lardy, Peter Gr \"u nwald, and Peter Harremo \"e s. Reverse information projections and optimal e-statistics. IEEE Transactions on Information Theory, 2024
2024
-
[14]
The numeraire e-variable and reverse information projection
Martin Larsson, Aaditya Ramdas, and Johannes Ruf. The numeraire e-variable and reverse information projection. The Annals of Statistics, 53 0 (3): 0 1015--1043, 2025. doi:10.1214/24-AOS2487
-
[15]
Testing hypotheses generated by constraints
Martin Larsson, Aaditya Ramdas, and Johannes Ruf. Testing hypotheses generated by constraints. Mathematics of Operations Research, 2026 a
2026
-
[16]
A complete characterization of testable hypotheses
Martin Larsson, Johannes Ruf, and Aaditya Ramdas. A complete characterization of testable hypotheses. arXiv preprint arXiv:2601.05217, 2026 b
arXiv 2026
-
[17]
Estimation of Mixture Models
Qiang Jonathan Li. Estimation of Mixture Models. PhD thesis, Yale University, 1999
1999
-
[18]
The optimal betting wealth growth rate
Ashwin Ram and Aaditya Ramdas. The optimal betting wealth growth rate. arXiv preprint arXiv:2604.25280, 2026
Pith/arXiv arXiv 2026
-
[19]
Hypothesis testing with e-values
Aaditya Ramdas and Ruodu Wang. Hypothesis testing with e-values. Foundations and Trends in Statistics , 1 0 (1-2): 0 1--390, 2025
2025
-
[20]
Huber-robust likelihood ratio tests for composite nulls and alternatives
Aytijhya Saha and Aaditya Ramdas. Huber-robust likelihood ratio tests for composite nulls and alternatives. IEEE Transactions on Information Theory, 2025
2025
-
[21]
Testing by betting: A strategy for statistical and scientific communication
Glenn Shafer. Testing by betting: A strategy for statistical and scientific communication. Journal of the Royal Statistical Society Series A: Statistics in Society, with discussion, 184 0 (2): 0 407--431, 2021
2021
-
[22]
Information-theoretical optimization techniques
Flemming Tops e. Information-theoretical optimization techniques. Kybernetika, 15 0 (1): 0 8--27, 1979
1979
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.