Regularized e-processes: anytime valid inference with knowledge-based efficiency gains
Pith reviewed 2026-05-23 20:19 UTC · model grok-4.3
The pith
Regularized e-processes incorporate incomplete prior knowledge to boost efficiency in anytime-valid inference.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The central claim is that a knowledge-based imprecise-probabilistic regularization applied to e-processes yields improved efficiency while a generalized Ville inequality continues to hold, so that the resulting inference remains anytime valid in a knowledge-dependent sense. This construction further yields possibility-theoretic uncertainty sets with frequentist-like calibration, satisfies the likelihood principle, avoids sure loss, and supports formal decision procedures that carry explicit reliability guarantees.
What carries the argument
The regularized e-process, formed by applying knowledge-based imprecise-probabilistic regularization to a base e-process, which preserves a generalized Ville inequality while increasing efficiency.
If this is right
- Inference procedures remain valid at every possible stopping time chosen by the analyst.
- Uncertainty quantification inherits frequentist calibration properties from the generalized Ville inequality.
- Decisions derived from the e-process carry explicit frequentist reliability guarantees.
- The framework satisfies the likelihood principle because updates depend only on the observed data and the supplied regularization.
Where Pith is reading between the lines
- The same regularization idea could be tested in sequential clinical-trial designs where historical data supply imprecise priors.
- Calibration checks on simulated sequences with deliberately misspecified knowledge would quantify how much efficiency is lost when the imprecise prior is inaccurate.
- The possibility-theoretic output sets might be compared directly to credible intervals from imprecise Bayesian models to see whether the frequentist calibration carries over to finite samples.
Load-bearing premise
The chosen regularization must be imprecise-probabilistic and knowledge-based in a manner that improves efficiency without violating the generalized Ville inequality.
What would settle it
Construct a data-generating process, a knowledge-based regularization, and a data-dependent stopping time such that the regularized e-process exceeds its nominal bound with probability strictly larger than the target level under the null.
Figures
read the original abstract
Classical statistical methods have theoretical justification when the sample size is predetermined. In applications, however, it's often the case that sample sizes are data-dependent rather than predetermined. The aforementioned methods aren't reliable in this latter case, hence the recent interest in e-processes and methods that are anytime valid, i.e., reliable for any dynamic data-collection plan. But if the investigator has relevant-yet-incomplete prior information about the quantity of interest, then there's an opportunity for efficiency gain. This paper proposes a regularized e-process framework featuring a knowledge-based, imprecise-probabilistic regularization with improved efficiency. A generalized version of Ville's inequality is established, ensuring that inference based on the regularized e-process are anytime valid in a novel, knowledge-dependent sense. Regularized e-processes also facilitate possibility-theoretic uncertainty quantification with strong frequentist-like calibration properties and other Bayesian-like properties: satisfies the likelihood principle, avoids sure-loss, and offers formal decision-making with reliability guarantees.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript proposes a framework for regularized e-processes that incorporates knowledge-based imprecise-probabilistic regularization to achieve efficiency gains in anytime-valid inference. It claims to establish a generalized version of Ville's inequality that ensures validity in a knowledge-dependent sense, while also enabling possibility-theoretic uncertainty quantification that combines frequentist calibration properties with Bayesian-like features such as satisfying the likelihood principle, avoiding sure-loss, and supporting formal decision-making.
Significance. If the central claims are substantiated with explicit constructions and derivations, the work would offer a meaningful advance in sequential analysis by allowing incorporation of incomplete prior knowledge into e-processes without compromising anytime validity. The potential to blend efficiency gains with strong calibration and decision-theoretic guarantees could be relevant for applications involving data-dependent sampling.
major comments (2)
- [Abstract] The abstract asserts that a generalized Ville inequality is established for the regularized e-processes, but no derivation, explicit form of the regularizer, or verification that the inequality holds under the proposed regularization is provided in the manuscript text. This leaves the core validity claim unverified.
- The construction and calibration of the knowledge-based imprecise prior (or regularizer) from available information is not specified. Without this, it is impossible to assess whether efficiency gains are achieved while preserving the claimed generalized Ville inequality, as the regularization step is central to the efficiency and validity arguments.
Simulated Author's Rebuttal
We thank the referee for their thoughtful review and for highlighting areas where the manuscript requires greater explicitness. We agree that the core claims need stronger textual support and will revise accordingly.
read point-by-point responses
-
Referee: [Abstract] The abstract asserts that a generalized Ville inequality is established for the regularized e-processes, but no derivation, explicit form of the regularizer, or verification that the inequality holds under the proposed regularization is provided in the manuscript text. This leaves the core validity claim unverified.
Authors: We agree the derivation and explicit regularizer form must appear in the main text. The generalized Ville inequality is stated and sketched in Section 4 with a proof outline, but the full step-by-step verification under regularization is only in the appendix. In revision we will move a self-contained derivation, including the precise regularizer definition, into the main body so the abstract claim is directly substantiated. revision: yes
-
Referee: [—] The construction and calibration of the knowledge-based imprecise prior (or regularizer) from available information is not specified. Without this, it is impossible to assess whether efficiency gains are achieved while preserving the claimed generalized Ville inequality, as the regularization step is central to the efficiency and validity arguments.
Authors: The referee is correct that a concrete construction procedure is not supplied. Section 3 defines the regularizer via an imprecise-probability model but does not give an algorithmic calibration method from raw prior information. We will add an explicit construction algorithm together with a worked numerical example demonstrating both efficiency gain and preservation of the generalized Ville bound. revision: yes
Circularity Check
Generalized Ville inequality derivation is self-contained; no reduction to inputs or self-citations
full rationale
The paper establishes a generalized Ville's inequality for regularized e-processes as a new mathematical result that extends the classical Ville inequality via an added knowledge-based imprecise-probabilistic regularization step. This derivation is presented as independent, with the regularization treated as an external modeling choice whose details (construction and calibration) lie outside the inequality proof itself. No load-bearing steps reduce by definition, fitted parameters, or self-citation chains to the target result; the framework remains self-contained against the external benchmark of Ville's inequality and does not rename or smuggle in prior results via author overlap.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption A generalized version of Ville's inequality holds for the regularized e-process
Reference graph
Works this paper leans on
-
[1]
Aliprantis, C. D. and Border, K. C. (2006). Infinite D imensional A nalysis . Springer, Berlin, third edition. A hitchhiker's guide
work page 2006
-
[2]
Baker, M. (2016). 1,500 scientists lift the lid on reproducibility. Nature , 533:452--454
work page 2016
-
[3]
Balch, M. S., Martin, R., and Ferson, S. (2019). Satellite conjunction analysis and the false confidence theorem. Proc. Royal Soc. A , 475(2227):2018.0565
-
[4]
Basu, D. (1975). Statistical information and likelihood. Sankhy\= a Ser. A , 37(1):1--71. Discussion and correspondance between Barnard and Basu
work page 1975
-
[5]
Berger, J. and Wolpert, R. (1984). The L ikelihood P rinciple . Institute of Mathematical Statistics Lecture Notes---Monograph Series, 6. Institute of Mathematical Statistics, Hayward, CA
work page 1984
-
[6]
Birnbaum, A. (1962). On the foundations of statistical inference. J. Amer. Statist. Assoc. , 57:269--326
work page 1962
-
[7]
Camerer, C. F., Dreber, A., Holzmeister, F., Ho, T.-H., Huber, J., Johannesson, M., Kirchler, M., Nave, G., Nosek, B. A., Pfeiffer, T., Altmejd, A., Buttrick, N., Chan, T., Chen, Y., Forsell, E., Gampa, A., Heikensten, E., Hummer, L., Imai, T., Isaksson, S., Manfredi, D., Rose, J., Wagenmakers, E.-J., and Wu, H. (2018). Evaluating the replicability of soc...
work page 2018
-
[8]
Cella, L. and Martin, R. (2023). Possibility-theoretic statistical inference offers performance and probativeness assurances. Internat. J. Approx. Reason. , 163:109060
work page 2023
-
[9]
Couso, I., Montes, S., and Gil, P. (2001). The necessity of the strong -cuts of a fuzzy set. Internat. J. Uncertain. Fuzziness Knowledge-Based Systems , 9(2):249--262
work page 2001
-
[10]
Cuzzolin, F. (2021). The G eometry of U ncertainty . Artificial Intelligence: Foundations, Theory, and Algorithms. Springer, Cham
work page 2021
-
[11]
Dempster, A. P. (1967). Upper and lower probabilities induced by a multivalued mapping. Ann. Math. Statist. , 38:325--339
work page 1967
-
[12]
Den ux, T. (1999). Reasoning with imprecise belief structures. Internat. J. Approx. Reason. , 20(1):79--111
work page 1999
-
[13]
Den ux, T. (2019). Decision-making with belief functions: a review. Internat. J. Approx. Reason. , 109:87--110
work page 2019
-
[14]
Destercke, S., Dubois, D., and Chojnacki, E. (2008). Unifying practical uncertainty representations. I . G eneralized p-boxes. Internat. J. Approx. Reason. , 49(3):649--663
work page 2008
- [15]
-
[16]
Dubois, D. (2006). Possibility theory and statistical reasoning. Comput. Statist. Data Anal. , 51(1):47--69
work page 2006
-
[17]
Dubois, D., Foulloy, L., Mauris, G., and Prade, H. (2004). Probability-possibility transformations, triangular fuzzy sets, and probabilistic inequalities. Reliab. Comput. , 10(4):273--297
work page 2004
-
[18]
Dubois, D. and Prade, H. (1988). Possibility T heory . Plenum Press, New York
work page 1988
-
[19]
Durrett, R. (2010). Probability: T heory and E xamples , volume 31 of Cambridge Series in Statistical and Probabilistic Mathematics . Cambridge University Press, Cambridge, fourth edition
work page 2010
-
[20]
Ferson, S., Kreinovich, V., Ginzburg, L., Myers, D., and Sentz, K. (2003). Constructing probability boxes and D empster-- S hafer structures. Technical Report SAND2002--4015, Sandia National Laboratories
work page 2003
-
[21]
Gong, R. and Meng, X.-L. (2021). Judicious judgment meets unsettling updating: dilation, sure loss and S impson's paradox. Statist. Sci. , 36(2):169--190
work page 2021
-
[22]
Good, I. J. (1950). Probability and the W eighing of E vidence . Charles Griffin & Co., Ltd., London; Hafner Publishing Co., New York
work page 1950
-
[23]
Gr\"unwald, P., de Heide, R., and Koolen, W. (2024). Safe testing. J. R. Stat. Soc. Ser. B. Stat. Methodol. , 86(5):1091--1128
work page 2024
-
[24]
Gr\" u nwald, P. D. (2023). The e-posterior. Philos. Trans. Roy. Soc. A , 381(2247):Paper No. 20220146, 21
work page 2023
-
[25]
Hose, D. (2022). Possibilistic R easoning with I mprecise P robabilities: S tatistical I nference and D ynamic F iltering . PhD thesis, University of Stuttgart. https://dominikhose.github.io/dissertation/diss_dhose.pdf
work page 2022
-
[26]
Hose, D. and Hanss, M. (2021). A universal approach to imprecise probabilities in possibility theory. Internat. J. Approx. Reason. , 133:133--158
work page 2021
-
[27]
Huber, P. J. (1973). The use of C hoquet capacities in statistics. Bull. Inst. Internat. Statist. , 45(book 4):181--191. With discussion by P. G\" a nssler, W. S. Hall, L. Schmetterer, Charles Stein, and G. N. Wilkinson and with reply by the author
work page 1973
-
[28]
Huber, P. J. (1981). Robust S tatistics . John Wiley & Sons Inc., New York. W iley Series in Probability and Mathematical Statistics
work page 1981
-
[29]
Kass, R. E. (1992). Bayes factors in practice. Amer. Statist. , 42(5):551--560
work page 1992
-
[30]
Kass, R. E. and Greenhouse, J. B. (1989). Comment on ` I nvestigating therapies of potentially great benefit: ECMO ' by W are (1989). Statist. Sci. , 4(4):310--317
work page 1989
-
[31]
Levi, I. (1980). The E nterprise of K nowledge . The MIT Press, Boston
work page 1980
-
[32]
Martin, R. (2019). False confidence, non-additive beliefs, and valid statistical inference. Internat. J. Approx. Reason. , 113:39--73
work page 2019
- [33]
-
[34]
Martin, R. (2021b). Inferential models and the decision-theoretic implications of the validity property. arXiv:2112.13247
work page internal anchor Pith review Pith/arXiv arXiv
- [35]
- [36]
- [37]
-
[38]
Martin, R. (2024a). A possibility-theoretic solution to B asu's B ayesian--frequentist via media. Sankhya A , 86:43--70
-
[39]
Martin, R. (2024b). Which statistical hypotheses are afflicted by false confidence? In Bi, Y., Jousselme, A.-L., and Denoeux, T., editors, BELIEF 2024 , volume 14909 of Lecture Notes in Artificial Intelligence , pages 140--149, Switzerland. Springer Nature
work page 2024
-
[40]
Martin, R. (2025). Possibilistic inferential models: a review. arXiv:2507.09007
work page internal anchor Pith review Pith/arXiv arXiv 2025
-
[41]
Martin, R. and Liu, C. (2013). Inferential models: a framework for prior-free posterior probabilistic inference. J. Amer. Statist. Assoc. , 108(501):301--313
work page 2013
-
[42]
Martin, R. and Liu, C. (2015). Inferential M odels , volume 147 of Monographs on Statistics and Applied Probability . CRC Press, Boca Raton, FL
work page 2015
-
[43]
Mayo, D. G. (2018). S tatistical I nference as S evere T esting . Cambridge University Press, Cambridge
work page 2018
-
[44]
Miranda, E. and de Cooman, G. (2014). Lower previsions. In Introduction to I mprecise P robabilities , Wiley Ser. Probab. Stat., pages 28--55. Wiley, Chichester
work page 2014
-
[45]
Nuzzo, R. (2014). Scientific method: Statistical errors. Nature , 506:150--152
work page 2014
-
[46]
Ramdas, A., Gr\" u nwald, P., Vovk, V., and Shafer, G. (2023). Game-theoretic statistics and safe anytime-valid inference. Statist. Sci. , 38(4):576--601
work page 2023
-
[47]
Ramdas, A. and Manole, T. (2023). Randomized and exchangeable improvements of M arkov's, C hebyshev's and C hernoff's inequalities. arXiv:2304.02611
- [48]
-
[49]
Reid, N. and Cox, D. R. (2015). On some principles of statistical inference. Int. Stat. Rev. , 83(2):293--308
work page 2015
-
[50]
Sellke, T., Bayarri, M. J., and Berger, J. O. (2001). Calibration of p values for testing precise null hypotheses. Amer. Statist. , 55(1):62--71
work page 2001
-
[51]
Shackle, G. L. S. (1961). Decision O rder and T ime in H uman A ffairs . Cambridge University Press, Cambridge
work page 1961
-
[52]
Shafer, G. (1976). A M athematical T heory of E vidence . Princeton University Press, Princeton, N.J
work page 1976
-
[53]
Shafer, G. (2021). Testing by betting: a strategy for statistical and scientific communication. J. Roy. Statist. Soc. Ser. A , 184(2):407--478
work page 2021
-
[54]
Shafer, G., Shen, A., Vereshchagin, N., and Vovk, V. (2011). Test martingales, B ayes factors and p -values. Statist. Sci. , 26(1):84--101
work page 2011
-
[55]
Shafer, G. and Vovk, V. (2019). Game- T heoretic F oundations for P robability and F inance . Wiley, Hoboken, NJ
work page 2019
-
[56]
Sundberg, C. and Wagner, C. (1992). Characterizations of monotone and 2 -monotone capacities. J. Theoret. Probab. , 5(1):159--167
work page 1992
-
[57]
Troffaes, M. C. M. and de Cooman, G. (2014). Lower P revisions . Wiley Series in Probability and Statistics. John Wiley & Sons, Ltd., Chichester
work page 2014
-
[58]
Turner, R. J. and Gr\"unwald, P. D. (2023). Exact anytime-valid confidence intervals for contingency tables and beyond. Statist. Probab. Lett. , 198:Paper No. 109835, 8
work page 2023
-
[59]
Varadarajan, V. S. (1963). Groups of automorphisms of B orel spaces. Trans. Amer. Math. Soc. , 109:191--220
work page 1963
-
[60]
Vovk, V. and Wang, R. (2021). E-values: calibration, combination and applications. Ann. Statist. , 49(3):1736--1754
work page 2021
-
[61]
Vovk, V. G. (1993). A logic of probability, with application to the foundations of statistics. J. Roy. Statist. Soc. Ser. B , 55(2):317--351. With discussion and a reply by the author
work page 1993
-
[62]
Walley, P. (1991). Statistical R easoning with I mprecise P robabilities , volume 42 of Monographs on Statistics and Applied Probability . Chapman & Hall Ltd., London
work page 1991
-
[63]
Walley, P. (1996). Inferences from multinomial data: Learning about a bag of marbles. J. Roy. Statist. Soc. Ser. B , 58(1):3--57. With discussion and a reply by the author
work page 1996
-
[64]
Walley, P. (2002). Reconciling frequentist properties with the likelihood principle. J. Statist. Plann. Inference , 105(1):35--65
work page 2002
-
[65]
Ware, J. H. (1989). Investigating therapies of potentially great benefit: ECMO . Statist. Sci. , 4(4):298--340. With comments and a rejoinder by the author
work page 1989
-
[66]
Wasserman, L., Ramdas, A., and Balakrishnan, S. (2020). Universal inference. Proc. Natl. Acad. Sci. U.S.A. , 117(29):16880--16890
work page 2020
-
[67]
Wasserman, L. A. (1990). Prior envelopes based on belief functions. Ann. Statist. , 18(1):454--464
work page 1990
-
[68]
Wasserman, L. A. and Kadane, J. B. (1990). Bayes' theorem for C hoquet capacities. Ann. Statist. , 18(3):1328--1339
work page 1990
-
[69]
Zadeh, L. A. (1978). Fuzzy sets as a basis for a theory of possibility. Fuzzy Sets and Systems , 1(1):3--28
work page 1978
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.