Pith. sign in

REVIEW 4 major objections 5 minor 8 references

Mediation Analysis for Sparse and Irregularly Spaced Longitudinal Outcomes with Application to the MrOS Sleep Study

T0 review · 4 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash

Pith's one-line read A permutation test plus a three-component mixture FDR controls mediation discoveries in sparse longitudinal outcomes and identifies five lipid mediators linking sleep-wake timing to cognitive decline.

desk verdict Genuinely new combination of high-dimensional mediation with sparse irregular longitudinal outcomes, but the FDR control claim is unverified and the permutation test targets a different null. read the letter →

arxiv 2506.07953 v1 pith:LIQZHLTI submitted 2025-06-09 stat.ME stat.AP

classification stat.MEstat.AP
keywords mediationanalysishigh-dimensionalsparselongitudinaldatatime-varyingcoefficientmodelspermutationtestfalsediscoveryraterest-activityrhythmscognitivedecline
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Mediation studies usually break down when the outcome is measured only a few times per person at uneven intervals and hundreds of candidate mediators are tested at once. This paper proposes a pipeline that models each person's outcome trajectory with splines, accounts for within-subject correlation through a weighted least squares fit, tests each mediator's time-varying effect with a permutation F-test, and then feeds the two per-mediator p-values into a three-component mixture false discovery rate procedure. The claim is that this pipeline controls the FDR asymptotically even when the longitudinal data are sparse, and that it outperforms a pointwise functional-regression alternative in simulations. In the MrOS Sleep Study, the pipeline consistently selects five lipid metabolites at an FDR of 0.05 as mediators of the relationship between acrophase—the time of daily peak activity—and cognitive decline, whereas the comparison method selects none. A sympathetic reader would take this as evidence that careful trajectory modeling plus a mixture FDR formula can turn sparse follow-up data into usable mediation discoveries.

What carries the argument

The load-bearing object is the three-component mixture FDR estimator for the overall mediation p-value. Each mediator's overall p-value is $P_k = \max(P_{\alpha_k}, P_{\beta_k(t)})$, so under the composite null ($\alpha_k = 0$ or $\beta_k(t) = 0$) it falls into one of three components; the FDR numerator is $\hat{\pi}_{01}\lambda + \hat{\pi}_{10}\lambda + \hat{\pi}_{00}\lambda^2$, and the threshold is the largest $\lambda$ with estimated FDR below the target. The other half of the machinery is the permutation test for $\beta_k(t)$: the outcome is projected onto a B-spline basis, the model is fit by weighted least squares with an estimated within-subject correlation matrix, and the mediator's importance is scored by the F-statistic comparing weighted residual sums of squares with and without the mediator. This test is what supplies a valid $P_{\beta_k(t)}$ under sparse and irregular sampling, and the mixture formula is what converts 476 candidate p-values into a controlled discovery set.

What would settle it

Simulate null data with no true mediation but with shared subject-level random effects that couple the mediator and outcome equations, so $P_{\alpha_k}$ and $P_{\beta_k(t)}$ are dependent, and run the proposed permutation and mixture-FDR procedure with growing $p$; if the empirical FDR exceeds the target level as $p$ grows, the independence assumption behind Theorem 1 is violated.

Watch

Extended reading notes

Core claim

On its own terms, the paper's central discovery is that high-dimensional mediation testing can be made to work when the outcome is a sparse, irregularly sampled longitudinal process. For each candidate mediator $k$, the exposure-to-mediator effect $\alpha_k$ is tested by ordinary least squares, and the mediator-to-outcome time-varying effect $\beta_k(t)$ is tested by permuting the mediator values and comparing weighted residual sums of squares from a B-spline expansion of the marginal model; the overall mediation p-value is $P_k = \max(P_{\alpha_k}, P_{\beta_k(t)})$. Under the null, $P_k$ is modeled as a three-component mixture, and the estimated FDR at threshold $\lambda$ is $(\hat{\pi}_{01}\lambda + \hat{\pi}_{10}\lambda + \hat{\pi}_{00}\lambda^2) / (\max\{1, R(\lambda)\}/p)$. Theorem 1 states that, for a correctly specified time-varying model with asymptotically independent $P_{\alpha_k}$ and $P_{\beta_k(t)}$, sufficiently many permutations, and $p$ growing at most polynomially in the number of basis functions, the estimated FDR controls the target level asymptotically: $\limsup_{p\to\infty} \widehat{\mathrm{FDR}}(\lambda) \le b$. Applied at FDR 0.05 to 476 lipid mediators in 490 older men, the procedure consistently selects five metabolites—3-hydroxymyristate, 3-hydroxylaurate, tetradecadienoate (14:2), dodecadienoate (12:2), and 3-hydroxyoctanoyl-carnitine—as mediators linking acrophase (the time of daily peak activity) to cognitive decline, while the pointwise function-on-scalar regression comparator identifies none.

Load-bearing premise

The FDR guarantee rests on the assumption that, for each mediator, the p-value for the exposure-to-mediator effect and the p-value for the time-varying mediator-to-outcome effect are asymptotically independent; the paper states this in Theorem 1 but gives no proof or sensitivity analysis for it.

Editorial extensions

If this is right

  • If the FDR control holds, the same spline-plus-permutation pipeline can be used for any scalar exposure, high-dimensional mediator panel, and sparse longitudinal outcome, not just cognition and lipids.
  • The MrOS finding implies that fatty-acid and acylcarnitine metabolism deserves closer study as a pathway from rest-activity rhythm disruption to cognitive decline in older men.
  • The permutation test for time-varying coefficients is itself portable and can be used to test functional predictors in longitudinal regression outside the mediation setting.
  • Because the five mediators are selected consistently across all four user-specified correlation structures at FDR 0.05, the authors show the discovery does not depend on the chosen covariance model, although the larger set at FDR 0.10 does vary with it.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • One testable extension is to check robustness of the MrOS list to the stated independence assumption: generate null data with shared subject-level random effects that induce dependence between $\hat{\alpha}_k$ and the permutation statistic for $\beta_k(t)$, and compare the empirical FDR with the nominal level.
  • The procedure could be adapted to other actigraphy summary measures, such as amplitude or relative amplitude, since the mediation model itself is exposure-agnostic.
  • If the five lipids replicate in an independent cohort, the estimated time-varying indirect effects shown in the paper could be used to identify the follow-up window in which the lipid pathway matters most for cognitive decline.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. The manuscript proposes a mediation analysis method for scalar exposures, high-dimensional mediators, and sparse, irregularly spaced longitudinal outcomes. The exposure-to-mediator effects are tested with OLS p-values, and the mediator-to-outcome time-varying effects are tested with a permutation test applied to a marginal functional regression model. The two p-values are combined through the HDMT JS-mixture procedure, with a theorem claiming asymptotic control of the estimated FDR. The method is evaluated in simulations under four correlation structures and three sampling designs, and applied to the MrOS Sleep Study to identify lipid metabolites mediating the association between acrophase and cognitive decline, with five metabolites consistently selected.

Significance. If the central FDR-control claim is valid, the paper would fill a genuine gap: high-dimensional mediation analysis with functional or longitudinal outcomes that are measured sparsely and irregularly. The application to a real cohort with 476 lipid metabolites is timely and substantively interesting, and the idea of combining a permutation test with the HDMT mixture FDR is a sensible starting point. The paper also gives explicit credit to existing work on functional regression and high-dimensional mediation. However, the central theoretical guarantee is currently unverified: the theorem relies on an unproved independence assumption and on a supplement that is not available, and the simulation study does not report empirical FDR. These issues are load-bearing for the paper's main claim.

major comments (4)
  1. [Section 4.1, Eq. (5) vs. Eq. (2)] The permutation p-value P_βk(t) is computed from the marginal model (5), which omits all other mediators, whereas the null H0 in Eq. (4) is stated in terms of β_k(t) from the full model (2). When mediators are correlated—as in the simulation's Σ_ϵ = 0.1^{|k1−k2|} and in the MrOS lipid panel—the marginal coefficient β_k^*(t) can be nonzero even when the full-model β_k(t) is zero. The paper provides no theorem showing that marginal and full-model coefficients coincide, nor any simulation demonstrating FDR control under this mismatch. This is a direct threat to the validity of the screening procedure for the stated mediation null.
  2. [Theorem 1, Section 4.1] Theorem 1 assumes that P_αk and P_βk(t) are asymptotically independent for each k, but this assumption is asserted without proof, reference, or sensitivity analysis. The proof is said to be in Section S1 of a supplementary file that is not available to the reader. Moreover, the theorem only bounds the estimated quantity FDR-hat(λ), not the true FDR, so even if the theorem is correct it does not establish control of the actual false discovery rate. The authors should either provide the proof and a justification of independence, or add simulation evidence on empirical FDR under correlated mediators.
  3. [Section 5.3–5.4] No simulation result reports an empirical FDR or false-positive count for the proposed screening procedure. Section 5.4 reports screening frequencies for the true mediators only, and Section 5.3 reports power for one mediator. Without a direct report of FDR or type I error, the paper's central claim of false discovery control is not supported by the numerical study. I request an explicit FDR table or figure under the null and under the full simulation design.
  4. [Section 5.5 and Table 1] The mediation effect estimation is evaluated only under oracle knowledge of the true mediators: the text states that 'the first p0 = 4 mediators were correctly identified in each simulation replicate.' This does not reflect the actual pipeline, where screening errors propagate into the estimation of direct and indirect effects. Furthermore, within each case in Table 1, the reported bias and standard deviation are identical across Scenarios 1, 2, and 3, which is surprising given that the sampling design changes the number of repeated measurements per subject; this needs clarification or correction.
minor comments (5)
  1. [Section 2] The phrase '5 consequtive 24-hour periods' contains a typo; it should be 'consecutive.'
  2. [Section 4.1, Eq. (4)] The definition of the overall p-value P_k = max(P_αk, P_βk(t)) should be reconciled with the three-component mixture decomposition; the authors should state explicitly how the mixture proportions are identifiable under the asymptotic independence assumption.
  3. [Section 4.1] The notation is inconsistent: the text uses bλb for the threshold and then writes FDR-hat(λ); please define all symbols clearly and use a uniform notation for the estimated FDR and the threshold.
  4. [Section 4.1] The condition that 'p is bounded by a polynomial function of L_n' in Theorem 1 is vague; since the theorem takes p → ∞, the relationship between p and L_n should be specified.
  5. [Section 4.1] The proof of Theorem 1 is deferred to a supplementary file that is not included with the arXiv version; for a journal submission, the supplement should be made available to reviewers.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the estimation, testing, and application chain is self-contained, and the only self-citations are contextual.

full rationale

The paper's derivation is a standard chain: structural equations (1) and (2) define the mediation parameters; these are estimated by OLS/WLS; P_alpha_k is a Wald-type p-value from equation (1), and P_beta_k(t) is a permutation p-value from the marginal time-varying model (5). The overall p-value P_k = max(P_alpha_k, P_beta_k(t)) is then fed into the external JS-mixture FDR procedure of Dai et al. (2022), not into a procedure invented to reproduce the paper's own conclusions. Theorem 1 claims asymptotic FDR control under explicit conditions (correctly specified model, asymptotic independence of the two component p-values, assumptions S1.1-S1.8), so the claim is conditional on stated assumptions rather than being true by construction. Whether those assumptions hold, and whether the marginal model (5) tests the same null as the full model (2), are statistical validity questions, not circularity: the test statistic would remain meaningful even if the FDR bound is not proven. Simulation studies generate data from known alpha_k and beta_k(t), so screening frequencies and estimation errors are evaluated against ground truth rather than against the fitting procedure's own targets. The MrOS application applies the fitted threshold to identify mediators; the five selected lipids are not quantities defined by the procedure itself. Self-citations (Xiao et al. 2022; Wang and Huang 2024) are contextual and not load-bearing for the FDR claim or for the MrOS conclusion. The proof of Theorem 1 is deferred to the supplementary file, but omission of a proof is not circularity. No equation in the paper is shown to reduce to its own inputs by construction, and no fitted parameter is renamed as a prediction.

Assumptions & free parameters 3 free parameters · 5 assumptions · 0 invented entities

The method does not introduce new physical or conceptual entities. Its load-bearing inputs are modeling assumptions: no unmeasured confounding, correct model specification, spline truncation, and an independence assumption that is explicitly stated but not derived. The tuning choices, including the number of basis functions and the correlation structure, are fitted to the data and affect the empirical results.

free parameters (3)
  • Number of B-spline basis functions L_n = Chosen by 10-fold CV over 1-8 interior knots, yielding L_n in {5,...,12}
    Tuning parameter for the time-varying coefficient model; the paper states that results are robust within this range, but the value is selected on the data.
  • Within-subject correlation structure R_i(rho) = One of Diagonal, AR(1), Uniform, or Power, depending on method variant
    The user must specify the correlation structure. In the application, results vary at FDR 0.1 across structures, so this choice affects conclusions.
  • Correlation parameter rho = Estimated from residuals (Section S2)
    The correlation parameter inside R_i(rho) is estimated from the data and used in the WLS weight matrix; it is not a fixed external input.
assumptions (5)
  • domain assumption Assumptions 3.1-3.4: no unmeasured confounding between exposure and mediator, exposure and outcome, mediator and outcome, and no exposure-induced confounding
    Required for identifying natural direct and indirect effects under the counterfactual framework. These are untestable in observational MrOS data.
  • domain assumption Structural models (1) and (2) are correctly specified, including linear mediator models and the time-varying coefficient outcome model
    If the true mediator or outcome processes are misspecified, the estimated indirect effect alpha_k beta_k(t) is biased.
  • domain assumption The outcome process Y_i(t) is smooth and admits a truncated Karhunen-Loeve expansion with L_n basis functions
    Used in Sections 4.1 and 4.2 to represent time-varying coefficients; truncation error is ignored in the main text.
  • ad hoc to paper P_alpha_k and P_beta_k(t) are asymptotically independent for each mediator k
    Assumed in Theorem 1 without justification. This assumption is load-bearing for the three-component FDR mixture formula.
  • standard math Regularity conditions S1.1-S1.8 in the supplementary file
    Conditions for asymptotic FDR control are stated only in the supplement and cannot be verified from the main text.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Mediation Analysis for Sparse and Irregularly Spaced Longitudinal Outcomes with Application to the MrOS Sleep Study." pith.science (2026). https://pith.science/paper/LIQZHLTI

@misc{pith2026250607953,
  author       = {Pith},
  title        = {Pith review of: Mediation Analysis for Sparse and Irregularly Spaced Longitudinal Outcomes with Application to the MrOS Sleep Study},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/LIQZHLTI}},
  note         = {Machine review of arXiv:2506.07953}
}
read the original abstract

Mediation analysis has become a widely used method for identifying the pathways through which an independent variable influences a dependent variable via intermediate mediators. However, limited research addresses the case where mediators are high-dimensional and the outcome is represented by sparse, irregularly spaced longitudinal data. To address these challenges, we propose a mediation analysis approach for scalar exposures, high-dimensional mediators, and sparse longitudinal outcomes. This approach effectively identifies significant mediators by addressing two key issues: (i) the underlying correlation structure within the sparse and irregular cognitive measurements, and (ii) adjusting mediation effects to handle the high-dimensional set of candidate mediators. In the MrOS Sleep study, our primary objective is to explore lipid pathways that may mediate the relationship between rest-activity rhythms and longitudinal cognitive decline in older men. Our findings suggest a potential mechanism involving rest-activity rhythms, lipid metabolites, and cognitive decline, and highlight significant mediators identified through multiple testing procedures.

Figures

Figures reproduced from arXiv: 2506.07953 by the authors.

Figure 1
Figure 1. Longitudinal trajectories of cognition assessments for two randomly selected [PITH_FULL_IMAGE:figures/full_fig_p004_1.png] view at source ↗
Figure 2
Figure 2. A scenario with high-dimensional mediators between exposure and outcome [PITH_FULL_IMAGE:figures/full_fig_p006_2.png] view at source ↗
Figure 3
Figure 3. Estimated power curves under four different correlation structures of disturbance [PITH_FULL_IMAGE:figures/full_fig_p013_3.png] view at source ↗
Figures from the paper (3 more)
Figure 4
Figure 4. Figure 4: Results of estimated frequencies for different mediators (No.1 to No.50) under [PITH_FULL_IMAGE:figures/full_fig_p015_4.png]
Figure 5
Figure 5. Figure 5: Individual-level cognitive scores over time. [PITH_FULL_IMAGE:figures/full_fig_p017_5.png]
Figure 6
Figure 6. Figure 6: Plots of estimated time-varying direct effect [PITH_FULL_IMAGE:figures/full_fig_p019_6.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

8 extracted references · 8 canonical work pages

  1. [1]

    and Bennett, S

    Alecu, I. and Bennett, S. A. (2019), ‘Dysregulated lipid metabolism and its role inα- synucleinopathy in parkinson’s disease’,Frontiers in Neuroscience13,

  2. [3]

    and Liu, L

    Perera, C., Zhang, H., Zheng, Y., Hou, L., Qu, A., Zheng, C., Xie, K. and Liu, L. (2022), ‘Hima2: high-dimensional mediation analysis and its application in epigenome-wide dna methylation data’,BMC Bioinformatics23(1),

  3. [39]

    Functional Mediation Analysis with an Application to Functional Magnetic Resonance Imaging Data

    Zhao, Y., Luo, X., Lindquist, M. and Caffo, B. (2018), ‘Functional mediation analysis with an application to functional magnetic resonance imaging data’,arXiv preprint arXiv:1805.06923. Zhao, Z., Chen, C., Adhikari, B. M., Hong, L. E., Kochunov, P. and Chen, S. (2023), ‘Mediation analysis for high-dimensional mediators and outcomes with an application to ...

  4. [54]

    and Zhao, Y

    Xu, Y. and Zhao, Y. (2025), ‘Mediation analysis with graph mediator’,Biostatistics 26(1), kxaf004. Zeng, S., Rosenbaum, S., Archie, E., Alberts, S. and Li, F. (2021), ‘Causal mediation analysis for sparse and irregular longitudinal data’,The Annals of Applied Statistics 15(2), 747–767. Zhang, H., Zheng, Y., Hou, L., Zheng, C. and Liu, L. (2021), ‘Mediatio...

  5. [212]

    (2024), ‘Mediation analysis with multiple exposures and multiple mediators’, Statistics in Medicine43(25), 4887–4898

    Zhao, Y. (2024), ‘Mediation analysis with multiple exposures and multiple mediators’, Statistics in Medicine43(25), 4887–4898. Zhao, Y., Li, L. and Initiative, A. D. N. (2022), ‘Multimodal data integration via media- tion analysis with high-dimensional exposures and mediators’,Human Brain Mapping 43(8), 2519–2533. Zhao, Y., Lindquist, M. A. and Caffo, B. ...

  6. [296]

    T., Huang, L

    Reiss, P. T., Huang, L. and Mennes, M. (2010), ‘Fast function-on-scalar regression with penalized basis expansions’,International Journal of Biostatistics6(1). 21 Reiss, P. T., Mennes, M., Petkova, E., Huang, L., Hoptman, M. J., Biswal, B. B., Colcombe, S. J., Zuo, X.-N. and Milham, M. P. (2011), ‘Extracting information from functional connectivity maps v...

  7. [328]

    Baron, R. M. and Kenny, D. A. (1986), ‘The moderator–mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations’, Journal of Personality and Social Psychology51(6), 1173–1182. Bind, M.-A., Vanderweele, T., Coull, B. and Schwartz, J. (2016), ‘Causal mediation analysis for longitudinal data with exo...

  8. [596]

    L., Dziak, J

    20 Coffman, D. L., Dziak, J. J., Litson, K., Chakraborti, Y., Piper, M. E. and Li, R. (2023), ‘A causal approach to functional mediation analysis with application to a smoking cessation intervention’,Multivariate Behavioral Research58(5), 859–876. Dai, J. Y., Stanford, J. L. and LeBlanc, M. (2022), ‘A multiple-testing procedure for high-dimensional mediat...

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.