Pith. sign in

REVIEW 3 major objections 5 minor 1 cited by

The paper claims that the scattered literature on sequential stopping rules for Monte Carlo mean estimation becomes coherent once organized by a few core choices: absolute versus relative accuracy, iid versus dependent samples, and asymptot

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

T0 review · deepseek-v4-flash

2026-08-04 07:59 UTC pith:LZYSPENA

load-bearing objection A competent but uneven survey: its organizational value is real, yet the most novel sections rest on unverifiable author preprints and at least one displayed algorithm is missing a parameter. the 3 major comments →

arxiv 2510.22688 v3 pith:LZYSPENA submitted 2025-10-26 stat.ME math.STstat.TH

Stopping Rules for Monte Carlo Methods: A Review

classification stat.ME math.STstat.TH MSC 65C0562E2062L0562L1560G42
keywords sequential stopping rulesMonte Carlo methodsfixed-width confidence intervalsabsolute precisionrelative precisionBernoulli trialsmartingale differencecoverage probability
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper tries to establish that the apparently fragmented literature on sequential stopping rules for Monte Carlo mean estimation is actually organized around a small set of choices: whether accuracy is measured in absolute or relative terms, whether the samples are independent, whether guarantees are asymptotic or finite-sample, and what extra information (moment bounds, boundedness) is available. By collecting and comparing recent work under these headings, it aims to give practitioners and researchers a usable guide for choosing a stopping rule and a baseline for developing new ones. A sympathetic reader would care because simulations routinely waste compute or terminate early with misleading coverage, and the relevant results are currently scattered across specialized papers.

Core claim

On its own terms, the review's central claim is that the many recent stopping rules—two-stage rules that inflate the variance estimate to guarantee coverage, rules that add third- and fourth-moment corrections to the normal approximation, relative-precision rules for bounded and Bernoulli variables, rules for martingale-difference and quasi-Monte Carlo sequences, and rules for estimating several means at once—are not isolated tricks but instances of a common design problem: finding the smallest sample size that keeps the error probability under a prescribed threshold. The paper's contribution is to state that problem once, to classify the solutions by their assumptions and guarantees, and to

What carries the argument

The central object is the stopping time, the smallest sample size such that the probability the empirical mean misses the true mean by more than a tolerance is below a significance level (or the relative version with the true mean in the denominator). Because exact determination is impossible without extra information, each rule in the review is a way of approximating that stopping time: two-stage designs estimate the variance first, moment-based corrections improve the normal approximation, concentration inequalities give non-asymptotic bounds for bounded variables, and the martingale-difference rule extends the approach to dependent sequences with batch indices. The review also uses covera

Load-bearing premise

The load-bearing premise is that the post-1991 papers the review selected are representative of the state of the art for Monte Carlo mean estimation, and that the authors' short summaries of each cited result are accurate.

What would settle it

A concrete check: recompute the stated cost factor for the bounded-variable Bernoulli rule (claimed between 3.64 and 5.09 times the normal-approximation sample size for significance levels between 0.001 and 0.1); if the factor falls outside that range, the summary is wrong. For the comprehensiveness claim, find a stopping rule in active use for Monte Carlo mean estimation that fits no category in the review—say a confidence-sequence rule with no fixed width—and show it delivers better expected run length in the same iid setting.

Watch this falsifier — get emailed when new claim-graph text bears on it.

If this is right

  • If the classification is right, then selecting a stopping rule is a matching problem: check boundedness and moment information, decide absolute vs relative accuracy, and only then choose between asymptotic and finite-sample rules.
  • The review makes the classic fixed-width interval asymptotics the common benchmark, so different rules can be compared in terms of asymptotic consistency and efficiency.
  • Finite-sample reliability is not free: two-stage and moment-based rules require prior information such as a kurtosis bound or a bounded support, and coverage profiles show that otherwise early stopping can badly undercut coverage.
  • Relative-precision rules can cut run length substantially but are risky when the mean is near zero, since the procedure may stop too early; the review flags this trade-off.
  • Valid stopping rules exist beyond iid data, including martingale-difference sequences and low-discrepancy quasi-Monte Carlo, so dependent-sample users are not restricted to the iid toolbox.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • A direct extension of the review's map is a decision procedure: if a practitioner can bound the support or moments, use a finite-sample rule; otherwise use an asymptotic rule with a coverage-profile pre-check and a variance inflation factor.
  • The deliberate exclusions—confidence sequences, resampling, and group-sequential trials—suggest a follow-up review that integrates those with the current taxonomy, since betting-based confidence sequences share the same goal with different machinery.
  • The coverage-profile diagnostic could be turned into a standardized benchmark: run each candidate rule on a suite of distributions and report coverage against run length, giving an empirical table that the field currently lacks.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. This paper is a review article on sequential stopping rules for Monte Carlo estimation of expectations, with emphasis on iid sampling and lightly generalized settings (bounded, Bernoulli, martingale-difference, low-discrepancy, multiple means). It first lays out essential components—error tolerances, confidence/significance levels, multivariate outputs, non-iid sequences, preliminary sample sizes, large-sample theory, normal approximation, and single- versus two-stage procedures—then surveys recent developments organized by asymptotic analyses, moment-based rules, distributional assumptions, non-iid sequences, multiple means, quality assessment, and unconventional criteria. The stated aim is to provide a comprehensive, up-to-date guidebook of core assumptions, algorithms, convergence properties, and practical trade-offs.

Significance. If taken at face value, the review fills a real gap: the sequential-stopping-rule literature for Monte Carlo is scattered, and the paper provides a structured map of it. The classical summaries in Sections 2 and 3 (Chow–Robbins asymptotics, Glynn–Whitt framework, two-stage kurtosis-based rules, Berry–Esseen refinements, relative-precision rules) are consistent with the original sources and will be useful to both practitioners and researchers entering the area. The paper's contribution is synthesis and organization rather than new mathematics or reproducible code. Its value therefore depends on the accuracy and verifiability of the summaries, and it is precisely there that the manuscript needs work: one displayed algorithm uses an undefined parameter, and several key recent results are drawn from unnumbered preprints without accessible details.

major comments (3)
  1. [§3.3.2] The first stopping rule of [27] is presented with ϒ = 4(e−2)λ ln(2/δ)/ε², but λ is never defined anywhere in the manuscript. Since τ1 = argmin{n : X1+...+Xn ≥ ϒ1} and the displayed bound E[τ1] ≤ ϒ1/E[X1] both depend on λ, a reader cannot implement or check the algorithm. This is a concrete internal defect in a section whose purpose is to summarize numerical algorithms. Please define λ (or state its range/value as in the source) and reconcile the notation with [27].
  2. [§3.1.1, §3.4.2, Refs. [58], [59], [113]] The review's most recent content—non-asymptotic malfunction of stopping rules and a martingale-difference stopping rule—rests on two unnumbered preprints by the corresponding author ([58], [59]) and one by both authors ([113]), cited as 'available here' without URLs or theorem/page numbers. These are not standard archival sources, so the accuracy of the summarized claims cannot be independently checked from the manuscript. Since the paper's central claim is to be a reliable up-to-date guide, please either state the precise results with assumptions and theorem numbers, or provide public links and identify the exact statements being summarized.
  3. [§3 (overall)] The introduction promises 'comparisons' and a guidebook covering 'core assumptions, numerical algorithms, convergence properties, and practical trade-offs', but the review contains no synthesis table or side-by-side comparison of the surveyed rules beyond descriptive prose. Given the stated aim, a summary table (columns: assumptions, algorithm type, convergence properties, required inputs, limitations) would make the comparison and selection criteria explicit. This is not a correctness issue but it is load-bearing for the paper's contribution as a review.
minor comments (5)
  1. [§3.1.2] Notation for the significance level changes from δ to α without explanation; e.g., α appears in the second-order expansions after δ was used in §2.6. Please harmonize.
  2. [§3.3.2] In the second stopping rule, S_n := 2^{-1}∑_{k=1}^n (X_{2k-1}-X_{2k})² uses n for a number of pairs, while τ2 and τ3 are sample sizes; clarify the index conventions.
  3. [References] Refs. [58], [59], [113] should include arXiv IDs or URLs if they are to be usable. There are also typos in [2] ('randam'), [35] ('Marcel Dekkerr'), and [55] (author list formatting).
  4. [§3.2.2, §3.2.3] Several displayed results (e.g., the Berry-Esseen stopping criterion and the [61] complexity bound) are given without theorem or proposition numbers from the sources; this makes verification unnecessarily difficult for a review.
  5. [§2.4] The statement that resampling methods are not explored is helpful, but the exclusion criteria for confidence sequences and group-sequential clinical-trial methods could be stated more explicitly in one place.

Circularity Check

0 steps flagged

No significant circularity: the review summarizes external results and does not derive predictions from fitted inputs.

full rationale

This manuscript is a literature review rather than an original derivation chain. It organizes results from external primary sources (Chow–Robbins, Glynn–Whitt, Hickernell et al., Bayer et al., Huber, Gajek et al.) and does not claim to derive new predictions from fitted parameters. The nearest thing to a derivation, Section 2.8, explicitly explains that the normal-approximation rule defines τ in terms of the stopped empirical standard deviation, so the asymptotic identities in Eq. (2.2) are consequences of that construction rather than advertised as independent predictions. The author-affiliated preprints [58], [59], and [113] are cited as sources for recent developments, and this is a visible self-citation pattern; however, the review's content is the summarized results themselves, and no central claim or target quantity is defined in terms of those summaries in a way that would make the summary equivalent to its input. The undefined λ in Section 3.3.2 and the lack of page/theorem numbers for several cited results are verification and reproducibility concerns, not circularity. Under the hard rule requiring quotation of a specific equation-to-equation reduction or a fitted parameter renamed as a prediction, none is present. The appropriate finding is therefore no significant circularity, score 0.

Axiom & Free-Parameter Ledger

0 free parameters · 3 axioms · 0 invented entities

The ledger is minimal because the paper introduces no new mathematical objects, parameters, or entities. Its load-bearing assumptions are about the fidelity of its literature summaries and the representativeness of its selection, which are necessary premises for the review to be useful. The classical statistical assumptions (iid or martingale-difference structure, bounded moments, normal approximation) are attributed to the cited rules rather than introduced by this paper.

axioms (3)
  • domain assumption The norm of representing the literature is accuracy of summarization, including that the cited theorems are rendered correctly and that the categorization is faithful to the sources.
    The entire paper is a review; its correctness depends on the accuracy of its summaries of other papers, which cannot be verified from the text alone. The authors acknowledge some summaries are brief, and two preprints are cited without full bibliographic details.
  • domain assumption The papers selected are representative of the recent literature on sequential stopping rules for Monte Carlo methods.
    The review deliberately focuses on standard and lightly generalized Monte Carlo methods, and explicitly leaves aside confidence sequences, resampling methods, and clinical-trial stopping rules. No selection criteria are given beyond approximate dates and topic, so representativeness is assumed.
  • standard math Standard results of sequential analysis, such as the central limit theorem for random sums and the nonexistence theorems of Chow-Robbins and Bahadur-Savage, hold as stated in the cited literature.
    Section 2.6 and 2.8 invoke classical results about asymptotic consistency and efficiency of Chow-Robbins-type stopping rules, and Section 2.5 calls on Bahadur-Savage and Takada. These are standard results in the field.

pith-pipeline@v1.3.0-alltime-deepseek · 20305 in / 6514 out tokens · 49116 ms · 2026-08-04T07:59:46.587897+00:00 · methodology

0 comments
read the original abstract

Sequential analysis encompasses simulation theories and methods where the sample size is determined dynamically based on accumulating data. Since the conceptual inception, numerous sequential stopping rules have been introduced, and many more are currently being refined and developed. This article aims to deliver an up-to-date review of recent developments in sequential stopping rules, with a deliberate emphasis on Monte Carlo methods for estimating an unknown expectation, including binomial proportions, primarily under standard iid sampling and also under certain lightly generalized settings. These methodologies have long served and likely will continue to serve, as fundamental bases for both theoretical and practical developments in stopping rules for general statistical inference, advanced Monte Carlo techniques, and their modern applications. Building upon over a hundred references and empirical studies, we explore the essential aspects of these methods, such as core assumptions, numerical algorithms, convergence properties, and practical trade-offs to guide further developments, particularly at the intersection of sequential stopping rules and related areas of research.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Stop the Sampler! Classifier-Based Adaptive Stopping for Sampling Kernels

    cs.LG 2026-06 conditional novelty 6.0

    Classifier-based adaptive stopping, trained as a non-acyclic GFlowNet, shortens MCMC trajectories while preserving or improving sample quality relative to ULA and diffusion-sampler baselines.

Reference graph

Works this paper leans on

114 extracted references · 1 linked inside Pith · cited by 1 Pith paper

  1. [1]

    V . G. Adlakha and G. S. Fishman. Starting and stopping rules for simulations using a priori information. European Journal of Operational Research, 10(4):379–394, 1982

  2. [2]

    Aerts and H

    M. Aerts and H. Callaert. The exact approximation order in the central limit theorem for randam u-statistics. Sequential Analysis, 5(1):19–35, 1986

  3. [3]

    Aerts and H

    M. Aerts and H. Callaert. The convergence rate of sequential fixed-width confidence intervals for regular functionals.Australian Journal of Statistics, 28(1):97–106, 1986

  4. [4]

    F. S. Almeida, F. H. Silveira, and S. Visacro. Stopping criterion for Monte Carlo method-based simulations of the lightning performance of transmission lines.Electric Power Systems Research, 214:108797, 2023

  5. [5]

    F. J. Anscombe. Large-sample theory of sequential estimation.Biometrika, 36(3/4):455–458, 1949

  6. [6]

    F. J. Anscombe. Large-sample theory of sequential estimation.Mathematical Proceedings of the Cambridge Philosophical Society, 48(4):600–607, 1952

  7. [7]

    F. J. Anscombe. Sequential estimation.Journal of the Royal Statistical Society. Series B (Methodological), 15(1):1–29, 1953

  8. [8]

    F. J. Anscombe. Fixed-sample-size analysis of sequential observations.Biometrics, 10(1):89–100, 1954

  9. [9]

    M. Y . Ata. A convergence criterion for the Monte Carlo estimates.Simulation Modelling Practice and Theory, 15(3):237–246, 2007. 19

  10. [10]

    R. R. Bahadur and L. J. Savage. The nonexistence of certain statistical procedures in nonparametric problems. The Annals of Mathematical Statistics, 27(4):1115–1122, 1956

  11. [11]

    O. Balci. Validation, verification, and testing techniques throughout the life cycle of a simulation study.Annals of Operations Research, 53(1):121–173, 1994

  12. [12]

    B. P. G. V . P. Bartolomeo Stellato and P. J. Goulart. Multivariate Chebyshev inequality with estimated mean and variance.The American Statistician, 71(2):123–127, 2017

  13. [13]

    Bayer, H

    C. Bayer, H. Hoel, E. von Schwerin, and R. Tempone. On nonasymptotic optimal stopping criteria in Monte Carlo simulations.SIAM Journal on Scientific Computing, 36(2):A869–A885, 2014

  14. [14]

    Bicher, M

    M. Bicher, M. Wastian, D. Brunmeir, and N. Popper. Review on Monte Carlo simulation stopping rules: How many samples are really enough?Simulation Notes Europe SNE, 32(1):1–8, 2022

  15. [15]

    Billingsley.Probability and Measure

    P. Billingsley.Probability and Measure. Wiley Series in Probability and Statistics. Wiley, 1995

  16. [16]

    Bratley, B

    P. Bratley, B. L. Fox, and L. E. Schrage.A Guide to Simulation. 2nd ed. Springer, New York, 1987

  17. [17]

    Callaert and P

    H. Callaert and P. Janssen. The convergence rate of fixed-width sequential confidence intervals for the mean. Sankhy¯a: The Indian Journal of Statistics, Series A (1961-2002), 43(2):211–219, 1981

  18. [18]

    Chen and W

    E. Chen and W. Kelton. A stopping procedure based on phi-mixing conditions. In2000 Winter Simulation Conference Proceedings, pages 617–626, 2000

  19. [19]

    Chen and W

    E. Chen and W. Kelton. Determining simulation run length with the runs test.Simulation Modelling Practice and Theory, 11(3):237–250, 2003

  20. [20]

    E. J. Chen. A stopping rule using the quasi-independent sequence.Journal of Simulation, 6(2):71–80, 2012

  21. [21]

    Y . S. Chiew, G. M. Shaw, P. Docherty, J. Dickson, C. Pretty, and J. G. Chase. Early clinical trial termination: Simulation-based design of a robust stopping rule using difference in interventional effect on mortality. In 2016 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES), pages 484–489, 2016

  22. [22]

    Y . S. Chow and H. Robbins. On the asymptotic theory of fixed-width sequential confidence intervals for the mean.The Annals of Mathematical Statistics, 36(2):457–462, 1965

  23. [23]

    Chuang and T

    C.-S. Chuang and T. L. Lai. Hybrid resampling methods for confidence intervals.Statistica Sinica, 10(1):1– 33, 2000

  24. [24]

    M. C. Costanza and A. A. Afifi. Comparison of stopping rules in forward stepwise discriminant analysis. Journal of the American Statistical Association, 74(368):777–785, 1979

  25. [25]

    D. R. Cox. Estimation by double sampling.Biometrika, 39(3/4):217–227, 1952

  26. [26]

    A. Csenki. On the convergence rate of fixed-width sequential confidence intervals.Scandinavian Actuarial Journal, 1980(2):107–111, 1980

  27. [27]

    Dagum, R

    P. Dagum, R. Karp, M. Luby, and S. Ross. An optimal algorithm for Monte Carlo estimation.SIAM Journal on Computing, 29(5):1484–1496, 2000. 20

  28. [28]

    Dammertz, J

    H. Dammertz, J. Hanika, A. Keller, and H. Lensch. A hierarchical automatic stopping condition for Monte Carlo global illumination. InProceedings of the WSCG 2010, pages 159–164, 2010

  29. [29]

    Student’s

    G. B. Dantzig. On the non-existence of tests of “Student’s” hypothesis having power functions independent ofσ.The Annals of Mathematical Statistics, 11(2):186–192, 6 1940

  30. [30]

    Ellingwood, M

    B. Ellingwood, M. Maes, F. Michael Bartlett, A. T. Beck, C. Caprani, A. Der Kiureghian, L. Due ˜nas-Osorio, N. Galv˜ao, R. Gilbert, J. Li, J. Matos, Y . Mori, I. Papaioannou, R. Parades, D. Straub, and B. Sudret. Devel- opment of methods of structural reliability.Structural Safety, 113:102474, 2025

  31. [31]

    G. S. Fishman. Achieving specific accuracy in simulation output analysis.Communications of the ACM, 20(5):310–315, 1977

  32. [32]

    S. C. Fletcher. The stopping rule principle and confirmational reliability.Journal for General Philosophy of Science, 55(1):1–28, 2024

  33. [33]

    R. W. Frick. A better stopping rule for conventional statistical tests.Behavior Research Methods, Instruments, & Computers, 30(4):690–697, 1998

  34. [34]

    Gajek, W

    L. Gajek, W. Niemiro, and P. Pokarowski. Optimal Monte Carlo integration with fixed relative precision. Journal of Complexity, 29(1):4–26, 2013

  35. [35]

    B. K. Ghosh and P. K. Sen.Handbook of Sequential Analysis. Marcel Dekkerr, New York, 1-19, 1991

  36. [36]

    M. J. Gilman. A brief survey of stopping rules in Monte Carlo simulations. InProceedings of the Second Conference on Applications of Simulations, page 16–20. Winter Simulation Conference, 1968

  37. [37]

    L. J. Gleser. On the asymptotic theory of fixed-size sequential confidence bounds for linear regression param- eters.The Annals of Mathematical Statistics, 36(2):463–467, 1965

  38. [38]

    P. W. Glynn and W. Whitt. The asymptotic validity of sequential stopping rules for stochastic simulations. The Annals of Applied Probability, 2(1):180–198, 1992

  39. [39]

    Govindarajulu.The Sequential Statistical Analysis of Hypothesis Testing, Point and Interval Estimation, and Decision Theory

    Z. Govindarajulu.The Sequential Statistical Analysis of Hypothesis Testing, Point and Interval Estimation, and Decision Theory. 2nd ed. American Science Press, Columbus, OH, 1987

  40. [40]

    Gupta, S

    V . Gupta, S. Andrad ´ottir, and D. Goldsman. Variance estimation and sequential stopping in steady-state simulations using linear regression.ACM Transactions on Modeling and Computer Simulation, 24(2), 2014

  41. [41]

    J. B. S. Haldane. On a method of estimating frequencies.Biometrika, 33(3):222–225, 11 1945

  42. [42]

    P. Hall. Asymptotic theory of triple sampling for sequential estimation of a mean.The Annals of Statistics, 9(6):1229–1238, 1981

  43. [43]

    P. Hall. Sequential estimation saving sampling operations.Journal of the Royal Statistical Society: Series B (Methodological), 45(2):219–223, 12 1983

  44. [44]

    Y . He, R. Kawai, Y . Shimizu, and K. Yamazaki. The Gerber-Shiu discounted penalty function: A review from practical perspectives.Insurance: Mathematics and Economics, 109:1–28, 2023. 21

  45. [45]

    Heidelberger and P

    P. Heidelberger and P. D. Welch. Adaptive spectral methods for simulation output analysis.IBM Journal of Research and Development, 25(6):860–876, 1981

  46. [46]

    Heidelberger and P

    P. Heidelberger and P. D. Welch. A spectral method for confidence interval generation and run length control in simulations.Communications of the ACM, 24(4):233–245, Apr. 1981

  47. [47]

    Heidelberger and P

    P. Heidelberger and P. D. Welch. Simulation run length control in the presence of an initial transient.Opera- tions Research, 31(6):1109–1144, 1983

  48. [48]

    F. J. Hickernell, S.-C. T. Choi, L. Jiang, and L. A. Jim ´enez Rugama. Monte Carlo simulation, automatic stopping criteria for. InWiley StatsRef: Statistics Reference Online, pages 1–7. American Cancer Society, 2018

  49. [49]

    F. J. Hickernell, L. Jiang, Y . Liu, and A. B. Owen. Guaranteed conservative fixed width confidence intervals via Monte Carlo sampling. In J. Dick, F. Y . Kuo, G. W. Peters, and I. H. Sloan, editors,Monte Carlo and Quasi-Monte Carlo Methods 2012, pages 105–128. Springer Berlin Heidelberg, 2013

  50. [50]

    Hirose, E

    K. Hirose, E. Isogai, and C. Uno. The convergence rate of fixed-width sequential confidence intervals for a parameter of an exponential distribution.Annals of the Institute of Statistical Mathematics, 49(2):199–209, 1997

  51. [51]

    M. Huber. A Bernoulli mean estimate with known relative error distribution.Random Structures & Algo- rithms, 50(2):173–182, 2017

  52. [52]

    M. Huber. An optimal(ε,δ)-randomized approximation scheme for the mean of random variables with bounded relative variance.Random Structures & Algorithms, 55(2):356–370, 2019

  53. [53]

    Jennison and B

    C. Jennison and B. Turnbull.Group Sequential Methods with Applications to Clinical Trials. Chapman & Hall/CRC Interdisciplinary Statistics. CRC Press, 1999

  54. [54]

    Jiang and F

    L. Jiang and F. J. Hickernell. Guaranteed Monte Carlo methods for Bernoulli random variables. arXiv:1411.1151, 2014

  55. [55]

    M. C. Y . John G. Saw and T. C. Mo. Chebyshev inequality with estimated mean and variance.The American Statistician, 38(2):130–132, 1984

  56. [56]

    I. W. Kabak. Stopping rules for queuing simulations.Operations Research, 16(2):431–437, 1968

  57. [57]

    Kang and B

    K. Kang and B. Schmeiser. Graphical methods for evaluating and comparing confidence-interval procedures. Operations Research, 38(3):546–553, 1990

  58. [58]

    R. Kawai. Monte Carlo methods with infinite variances, 2025. preprint available here

  59. [59]

    R. Kawai. Sequential stopping rules malfunctioning, 2025. preprint available here

  60. [60]

    Koopmans and C

    L. Koopmans and C. Qualls. Fixed length confidence intervals for parameters of the normal distribution based on two-stage sampling procedures.The Rocky Mountain Journal of Mathematics, 1(4):587–602, 1971

  61. [61]

    R. J. Kunsch, E. Novak, and D. Rudolf. Solvable integration problems and optimal sample size selection. Journal of Complexity, 53:40–67, 2019. 22

  62. [62]

    T. L. Lai. Sequential analysis: Some classical problems and new challenges.Statistica Sinica, 11(2):303–351, 2001

  63. [63]

    Landers and L

    D. Landers and L. Rogge. The exact approximation order in the central-limit-theorem for random summation. Zeitschrift f¨ur Wahrscheinlichkeitstheorie und Verwandte Gebiete, 36(4):269–283, 1976

  64. [64]

    S. S. Lavenberg and C. H. Sauer. Sequential stopping rules for the regenerative method of simulation.IBM Journal of Research and Development, 21(6):545–558, 1977

  65. [65]

    A. M. Law and J. S. Carson. A sequential procedure for determining the length of a steady-state simulation. Operations Research, 27(5):1011–1025, 1979

  66. [66]

    A. M. Law and D. M. Kelton.Simulation Modeling and Analysis. McGraw-Hill Higher Education, 3rd edition, 1999

  67. [67]

    A. M. Law and W. D. Kelton. Confidence intervals for steady-state simulations, II: A survey of sequential procedures.Management Science, 28(5):550–562, 1982

  68. [68]

    A. M. Law and W. D. Kelton. Confidence intervals for steady-state simulations: I. A survey of fixed sample size procedures.Operations Research, 32(6):1221–1239, 1984

  69. [69]

    A. M. Law, W. D. Kelton, and L. W. Koenig. Relative width sequential confidence intervals for the mean. Communications in Statistics - Simulation and Computation, 10(1):29–39, 1981

  70. [70]

    Mendo and J

    L. Mendo and J. Hernando. A simple sequential stopping rule for Monte Carlo simulation.IEEE Transactions on Communications, 54(2):231–241, 2006

  71. [71]

    Mukhopadhyay and S

    N. Mukhopadhyay and S. Datta. On sequential fixed-width confidence intervals for the mean and second- order expansions of the associated coverage probabilities.Annals of the Institute of Statistical Mathematics, 48(3):497–507, 1996

  72. [72]

    Mukhopadhyay and B

    N. Mukhopadhyay and B. M. de Silva.Sequential Methods and Their Applications. Chapman and Hall/CRC, New York, 1st edition, 2008

  73. [73]

    Mukhopadhyay, P

    N. Mukhopadhyay, P. K. Sen, and B. K. Sinha. Stopping rules, permutation invariance and sufficiency princi- ple.Annals of the Institute of Statistical Mathematics, 41(1):121–138, 1989

  74. [74]

    Mukhopadhyay and T

    N. Mukhopadhyay and T. Solanky. Second order properties of accelerated stopping times with applications in sequential estimation.Sequential Analysis, 10(1-2):99–123, 1991

  75. [75]

    A. Nadas. An extension of a theorem of Chow and Robbins on sequential confidence intervals for the mean. The Annals of Mathematical Statistics, 40(2):667–671, 1969

  76. [76]

    Nightingale and C

    M. Nightingale and C. Umrigar.Quantum Monte Carlo Methods in Physics and Chemistry. Nato Science Series C:. Springer Netherlands, 1998

  77. [77]

    Y . Ohkubo. Revisiting the two predominant statistical problems: The stopping-rule problem and the catch-all hypothesis problem.Annals of the Japan Association for Philosophy of Science, 30:23–41, 2021. 23

  78. [78]

    K. E. E. Raatikainen. A sequential procedure for simultaneous estimation of several means.ACM Transactions on Modeling and Computer Simulation, 3(2):108–133, 1993

  79. [79]

    P. H. Randolph, G. Swinson, and C. Ellingsen. Technical note—stopping rules for sequencing problems. Operations Research, 21(6):1309–1315, 1973

  80. [80]

    W. D. Ray. Sequential confidence intervals for the mean of a normal population with unknown variance. Journal of the Royal Statistical Society. Series B (Methodological), 19(1):133–143, 1957

Showing first 80 references.