REVIEW 2 major objections 2 minor 34 references
Confounding analysis of s-level designs with multi-block variables
T0 review · 2 major / 2 minor · reviewed 2026-06-25 · grok-4.3
Pith's one-line read The blocked aliased component-number pattern organizes confounding analysis for s-level designs that have several block variables at once.
desk verdict The paper introduces B²-ACNP computed from a blocked wordlength matrix as a way to unify prior confounding criteria for s-level designs with multiple blocks, but the abstract leaves the matrix definition and unification proof unshown. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The blocked aliased component-number pattern (B²-ACNP), a summary count of aliased components at successive lengths that encodes the full confounding structure induced by the blocks.
What would settle it
An s-level design example in which two distinct confounding structures produce the same B²-ACNP values, or in which at least one prior criterion cannot be expressed as a function of the B²-ACNP entries.
Extended reading notes
Core claim
The B²-ACNP, derived via the blocked wordlength distribution matrix, characterizes the confounding properties of s-level designs with multi-block variables, and the classification patterns of existing criteria can be recovered as functions of particular elements of the B²-ACNP, thereby connecting them inside a single framework.
Load-bearing premise
The blocked wordlength distribution matrix contains every piece of information about confounding that arises from the multiple block variables, so the B²-ACNP entries alone are enough to recover all earlier classification patterns.
Editorial extensions
If this is right
- Prior classification patterns become recoverable as explicit functions of chosen B²-ACNP entries.
- Confounding algorithms can be built directly on the blocked wordlength distribution matrix.
- Visualization routines can display the aliasing information stored in the B²-ACNP.
- Case studies can demonstrate how the pattern distinguishes confounding roles that earlier separate criteria left unclear.
Reading between the lines
- A designer could compare candidate plans across different numbers of block sources using one consistent index rather than switching criteria.
- Search routines for good designs might become simpler when the single pattern replaces several older measures.
- The matrix approach could be tested on designs that include continuous factors or more than two levels to see whether the same unification holds.
- Empirical checks could compare predictions from the B²-ACNP against actual run outcomes in blocked experiments to see whether the pattern improves effect estimation.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript proposes a blocked aliased component-number pattern (B²-ACNP) to analyze confounding properties of s-level designs with multi-block variables. B²-ACNP values are obtained from a blocked wordlength distribution matrix, and the classification patterns of existing criteria are claimed to be recoverable as functions of specific elements of this pattern. The paper also supplies confounding algorithms, visualization methods, case analyses, and Python code.
Significance. If the blocked wordlength distribution matrix fully encodes the confounding induced by multiple block factors and the B²-ACNP entries recover prior criteria without information loss, the work would supply a unified framework for evaluating blocked s-level designs. The provision of reproducible Python code is a positive feature.
major comments (2)
- [Abstract / §1] Abstract and introduction: no explicit definition of the blocked wordlength distribution matrix is supplied, nor is the mapping from this matrix to the B²-ACNP entries derived. Without these steps the central claim that existing criteria are functions of B²-ACNP elements cannot be verified.
- [Abstract] The assertion that the B²-ACNP captures the full confounding structure induced by multiple block variables rests on the completeness of the blocked wordlength distribution matrix; no proof or counter-example check is referenced to support this completeness.
minor comments (2)
- [Abstract] Abstract: 'stablishing' should be 'establishing'.
- [Abstract] Notation for B²-ACNP is inconsistent (sometimes parenthesized, sometimes not).
Simulated Author's Rebuttal
We thank the referee for the constructive comments on our manuscript proposing the B²-ACNP. We respond to each major comment below and indicate planned revisions.
read point-by-point responses
-
Referee: [Abstract / §1] Abstract and introduction: no explicit definition of the blocked wordlength distribution matrix is supplied, nor is the mapping from this matrix to the B²-ACNP entries derived. Without these steps the central claim that existing criteria are functions of B²-ACNP elements cannot be verified.
Authors: We agree that the abstract and introduction would benefit from greater explicitness. In the revised manuscript we will insert a concise definition of the blocked wordlength distribution matrix at the start of §1 and derive the explicit mapping from its entries to the components of the B²-ACNP. This addition will allow direct verification that existing criteria arise as functions of selected B²-ACNP elements. revision: yes
-
Referee: [Abstract] The assertion that the B²-ACNP captures the full confounding structure induced by multiple block variables rests on the completeness of the blocked wordlength distribution matrix; no proof or counter-example check is referenced to support this completeness.
Authors: The matrix is defined by exhaustive enumeration of all alias sets generated by the multi-block factors, so completeness holds by construction. We nevertheless accept that an explicit justification is desirable. The revised version will include a short paragraph in §2 explaining this construction together with a minimal worked example that confirms no confounding relations are omitted. revision: yes
Circularity Check
No significant circularity
full rationale
The paper introduces B²-ACNP as a new summary statistic computed from the blocked wordlength distribution matrix and demonstrates that existing classification patterns are recoverable as functions of its entries. This is a standard definitional unification with no equations shown to reduce to their own inputs by construction, no fitted parameters renamed as predictions, and no load-bearing self-citations or uniqueness theorems invoked. The derivation chain remains self-contained against external benchmarks; the abstract and description contain no self-referential loops or renamings of known results as novel derivations.
Assumptions & free parameters
Cite this review
Pith. "Pith review of Confounding analysis of s-level designs with multi-block variables." pith.science (2026). https://pith.science/paper/A4IVMCLM
@misc{pith2026260624116,
author = {Pith},
title = {Pith review of: Confounding analysis of s-level designs with multi-block variables},
year = {2026},
howpublished = {\url{https://pith.science/paper/A4IVMCLM}},
note = {Machine review of arXiv:2606.24116}
}
abstract
In practical experiments, block variables often arise from multiple sources of heterogeneity. To address the confounding problem, this paper proposes a blocked aliased component-number pattern (B$^2$-ACNP) to analyze the confounding properties of s-level designs with multi-block variables. We calculate the values of (B$^2$-ACNP) via a blocked wordlength distribution matrix. The classification patterns of existing criteria can be expressed as functions of specific elements within the B$^2$-ACNP, thereby stablishing connections within a unified framework. Further, we provide confounding algorithms and visualization methods of the B$^2$-ACNP. Finally, case analysis clarifies the significant role of the B$^2$-ACNP. The Python code is available in the Appendix.
Figures
Reference graph
Works this paper leans on
-
[1]
Wu, CF Jeff and Hamada, Michael S , title =
-
[2]
A note on the definition of resolution for blocked 2^
Bisgaard, S. A note on the definition of resolution for blocked 2^. Technometrics , volume =
-
[3]
and Chen, Jiahua and Feder, Moshe , title =
Sitter, Randy R. and Chen, Jiahua and Feder, Moshe , title =. Technometrics , volume =
-
[4]
The Annals of Statistics , volume =
Chen, Hegang and Cheng, Ching-Shui , title =. The Annals of Statistics , volume =
-
[5]
Journal of Statistical Planning and Inference , volume =
Zhang, Runchu and Park, DongKwon , title =. Journal of Statistical Planning and Inference , volume =
-
[6]
Technometrics , volume =
Cheng, Shao Wei and Wu, CF J , title =. Technometrics , volume =
-
[7]
Journal of Statistical Planning and Inference , volume =
Chen, Bao-Jiang and Li, Peng-Fei and Liu, Min-Qian and Zhang, Run-Chu , title =. Journal of Statistical Planning and Inference , volume =
-
[8]
Statistics & Probability Letters , volume =
Ai, Mingyao and He, Shuyuan , title =. Statistics & Probability Letters , volume =
Show all 34 references
-
[9]
The Annals of Statistics , volume =
Mukerjee, Rahul and Cheng, Ching-Shui , title =. The Annals of Statistics , volume =
-
[10]
Journal of Statistical Planning and Inference , volume =
Cheng, Ching-Shui and Mukerjee, Rahul , title =. Journal of Statistical Planning and Inference , volume =
-
[11]
Statistica Sinica , pages =
Zhang, Runchu and Mukerjee, Rahul , title =. Statistica Sinica , pages =
-
[12]
Pakistan Journal of Statistics , volume =
Tan, Yili and Zhang, Runchu , title =. Pakistan Journal of Statistics , volume =
-
[13]
and Li, Pengfei , title =
Zhao, Shengli and Lin, Dennis K.J. and Li, Pengfei , title =. Journal of Statistical Planning and Inference , volume =
-
[14]
Communications in Statistics-Theory and Methods , volume =
Zhao, Sheng-Li and Zhao, Qian-Qian , title =. Communications in Statistics-Theory and Methods , volume =
-
[15]
Journal of Statistical Theory and Practice , volume =
Wei, Jialin and Li, Peng and Zhang, Runchu , title =. Journal of Statistical Theory and Practice , volume =
-
[16]
Journal of Statistical Planning and Inference , volume =
Zhao, Shengli and Li, Pengfei and Zhang, Runchu and Karunamuni, Rohana , title =. Journal of Statistical Planning and Inference , volume =
-
[17]
Journal of Complexity , volume =
Bing Guo and Qi Zhou and Runchu Zhang , title =. Journal of Complexity , volume =
-
[18]
Frontiers of Mathematics in China , volume =
Zhao, Yuna and Zhao, Shengli and Liu, Min-Qian , title =. Frontiers of Mathematics in China , volume =
-
[19]
Communications in Statistics-Theory and Methods , volume =
Zhao, Sheng-Li and Sun, Qing , title =. Communications in Statistics-Theory and Methods , volume =
-
[20]
Metrika , volume =
Wang, Dongying and Ye, Shili and Zhou, Qi and Zhang, Runchu , title =. Metrika , volume =
-
[21]
Communications in Statistics-Theory and Methods , volume =
Wang, Yanfei and Li, Zhiming and Zhang, Runchu , title =. Communications in Statistics-Theory and Methods , volume =
-
[22]
Communications in Statistics-Theory and Methods , volume =
Li, Zhi and Li, Zhiming and Tian, Rui and Li, Zhengqi , title =. Communications in Statistics-Theory and Methods , volume =
-
[23]
Communications in Statistics-Theory and Methods , volume =
Li, Zhi and Li, Zhi-Ming , title =. Communications in Statistics-Theory and Methods , volume =
-
[24]
Australian & New Zealand Journal of Statistics , volume =
Williams, ER and Forde, CG and Imaki, J and Oelkers, K , title =. Australian & New Zealand Journal of Statistics , volume =
-
[25]
Journal of Statistical Theory and Practice , volume =
Zhang, Runchu and Li, Peng and Wei, Jialin , title =. Journal of Statistical Theory and Practice , volume =
-
[26]
Journal of Systems Science and Complexity , volume =
Zhao, Yuna and Zhao, Shengli and Liu, Minqian , title =. Journal of Systems Science and Complexity , volume =
-
[27]
Communications in Statistics-Theory and Methods , volume =
Zhao, Qian-Qian and Zhao, Sheng-Li , title =. Communications in Statistics-Theory and Methods , volume =
-
[28]
Statistical Papers , volume =
Zhao, Qianqian and Zhao, Shengli , title =. Statistical Papers , volume =
-
[29]
Metrika , volume =
Zhao, Shengli and Zhao, Qianqian , title =. Metrika , volume =
-
[30]
Mathematical Problems in Engineering , volume =
Zhao, Yuna , title =. Mathematical Problems in Engineering , volume =
-
[31]
Metrika , volume =
Huang, Zhiyun and Li, Zhiming and Zhang, Ge and Chen, Tao , title =. Metrika , volume =
-
[32]
Journal of Computational and Applied Mathematics , volume =
Chongya Yan and Zhi Li and Zhiming Li , title =. Journal of Computational and Applied Mathematics , volume =
-
[33]
Statistics in Medicine , volume =
Jaynes, Jessica and Ding, Xianting and Xu, Hongquan and Wong, Weng Kee and Ho, Chih-Ming , title =. Statistics in Medicine , volume =
-
[34]
AStA Advances in Statistical Analysis , volume =
Li, Zhiming and Teng, Zhidong and Zhang, Tianfang and Zhang, Runchu , title =. AStA Advances in Statistical Analysis , volume =
Reviewed June 25, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.