REVIEW 4 major objections 6 minor 31 references
Overcoming Standardization: Revealing Hidden Age Patterns of Suicide with Spatiotemporal Models
T0 review · 4 major / 6 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read The paper claims that indirect standardization hides a post-2020 rise in suicide-related emergency calls among younger people, which an age-structured Bayesian spatiotemporal model reveals.
desk verdict A competent, extensive age-space-time CAR model comparison applied to suicide calls; the youth post-2020 finding is plausible but needs uncertainty intervals and a frank handling of the calls-as-proxy assumption. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the age-structured hierarchical Bayesian spatiotemporal model with log-linear predictor, where the risk $\Theta_{ijk}$ in area $i$, year $j$, and age group $k$ is decomposed into an intercept, spatial $\phi$, temporal $\delta$, and age $\gamma$ main effects, plus additive pairwise interactions $\zeta^1$ (space-time), $\zeta^2$ (space-age), and $\zeta^3$ (time-age). The interaction terms are built by Kronecker products of the precision matrices of the corresponding main effects, following the Type I-IV typology of Knorr-Held (2000), with identifiability constraints from Goicoa et al. (2018). This machinery lets the age pattern vary across space and time rather than forcing a common multiplicative age schedule, which is exactly the assumption that indirect standardization imposes and that the paper argues biases conventional estimates. INLA makes fitting 520 candidate models computationally feasible, and WAIC selects the final model.
What would settle it
Re-run the best model on suicide mortality records for the same region and years: if the post-2020 increase in younger age groups disappears or reverses while the model structure is unchanged, the paper's central pattern is an artifact of emergency-call reporting rather than a property of suicide risk.
Extended reading notes
Core claim
On the paper's own terms, the discovery is that the proportionality assumption behind indirect standardization, $E(O_{ijk}/N_{ijk}) = \theta_{ij} q_k$, is violated in this setting, and that a hierarchical Bayesian model with age in the linear predictor captures what standardization misses. The best-fitting model takes $\log(\Theta_{ijk}) = \alpha + \phi_i + \delta_j + \gamma_k + \zeta^1_{ij} + \zeta^2_{ik} + \zeta^3_{jk}$, with a Leroux conditional autoregressive spatial effect, an unstructured time effect, a first-order random walk age effect, and Type II space-time, Type I space-age, and Type IV time-age interactions. Its posterior shows a temporal trend that rises from 2017 through 2022 and then stabilizes, a nonlinear age profile with elevated contributions from the 15-55 age range and declines in the oldest groups, and a time-age interaction in which the youngest groups shift from below-average to above-average contribution around 2021 while middle and older age groups move the opposite way. The paper reads this as evidence that the age-specific post-2020 increase would have been invisible under indirect standardization.
Load-bearing premise
The load-bearing premise is that emergency calls related to suicide measure suicide risk the same way across age groups, regions, and years; if help-seeking or call behavior changed over time or differed by age, the estimated age-time patterns would describe reporting rather than risk.
Editorial extensions
If this is right
- If the proportionality assumption is violated, indirect standardization can misreport both the level and the direction of spatiotemporal risk trends, so age-disaggregated modeling should replace it in disease mapping.
- The post-2020 increase in suicide-related emergency calls is not uniform across age: younger groups carry the increase, so prevention resources directed only at historically high-risk older groups would miss the emerging pattern.
- Adding age effects improves model fit by thousands of WAIC units relative to models without age, meaning age is not a nuisance to standardize out but an informative dimension of risk.
- The time-age interaction shows a reversal around 2020-2021, with younger groups increasing and older groups decreasing, a divergence that a summary standardized rate would smooth away.
- The computational approach scales to large space-time-age datasets because INLA avoids expensive MCMC simulation.
Reading between the lines
- The same modeling template could be applied to suicide mortality or to other rare outcomes such as substance abuse or gender-based violence, where age patterns plausibly vary by place and time; the authors gesture at these applications but do not test them.
- A direct comparison of municipality rankings from standardized ratios versus posterior risk from the full model would quantify how often policy prioritization changes when the proportionality assumption is dropped.
- The post-2020 youth increase is an observational pattern in emergency-call data; without adjusting for changes in help-seeking or reporting behavior, it should not be read as direct evidence about the pandemic's causal effect on suicide risk.
- Repeating the analysis separately by sex or by call outcome, such as attempt versus ideation, would show whether the time-age pattern is driven by a particular subgroup or severity category.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper argues that indirect standardization in disease mapping relies on a proportionality assumption that is often violated, and proposes age-structured hierarchical Bayesian spatiotemporal models as an alternative. Using suicide-related emergency calls in the Valencian Community for 2017–2023, the authors fit 520 model variants with INLA, including space-time, space-age, and time-age interactions, and select the best model by WAIC. The best model (Model 8) has an unstructured time effect, an RW1 age effect, and Type II, I, and IV interactions; it reportedly reveals a rising temporal trend, a nonlinear age pattern, and a post-2020 increase in the time-age effect for younger age groups. The methodological claim is that such age-specific temporal patterns would be missed under indirect standardization.
Significance. If the empirical results were supported by uncertainty quantification and validation, the paper would make a useful applied contribution by demonstrating the practical consequences of the proportionality assumption and by providing a transparent comparison of 520 interaction structures. The manuscript has notable strengths: the supplementary table reports all 520 WAIC values, the identifiability constraints for the interaction models are explicitly tabulated, and prior sensitivity is examined with non-informative priors. However, the central empirical claims—especially the youth-specific post-2020 increase—are currently based on posterior means of random effects without credible intervals, and the outcome variable (emergency calls) is treated as a direct proxy for suicide risk without discussion of ascertainment. These gaps make the headline findings not yet convincing.
major comments (4)
- [Section 4, Figures 2 and 5, Table 4] The plotted posterior means of exp(δ), exp(γ), and exp(ζ3) in Figures 2 and 5 are presented without credible intervals, and Table 4 reports posterior intervals only for hyperparameters. Because the abstract's claims of a rising temporal trend and stronger risk increases among younger individuals are statements about these random effects, the absence of uncertainty bands means the reader cannot judge whether the 2020–2023 increase in the time-age interaction for ages 10–35 is distinguishable from noise. I request pointwise credible intervals or posterior probability statements for the differences that define the conclusion.
- [Section 4, data description] The outcome is suicide-related emergency calls, not verified suicide deaths or attempts. The paper explicitly uses these calls as a proxy for suicide risk but does not discuss ascertainment bias: if younger people became more likely to call after 2020 (e.g., due to awareness campaigns) or if call rates are influenced by neighborhood and social factors (as cited from Marco et al. 2024), the estimated time-age interaction would reflect reporting behavior rather than underlying risk. This is load-bearing for the empirical conclusion and should be addressed, ideally by validating against mortality data or by discussing the direction and possible magnitude of the bias.
- [Section 3.2 and Table 3] Model selection relies solely on WAIC over the 520 fitted models, with no hold-out validation or cross-validation checks. The WAIC improvement of Model 8 over Model 7 is only 174.87 units on a scale where differences between some models exceed 1,000 units; without validation, the superiority of Model 8 and the robustness of its interaction structure are not established. A small simulation study, a temporal hold-out, or bootstrap-based model selection would strengthen the claim.
- [Section 2 and Figure 1] The proportionality assumption is tested only through Loess-smoothed scatterplots for a selected set of municipality-years, which is a subjective graphical procedure. Since the motivation for the modeling approach rests on the claim that proportionality is violated in these data, I recommend a formal statistical test or a quantitative summary of the deviations across all S×T units.
minor comments (6)
- [Section 3, after Eq. (3)] The age effect is defined as γ = (γ1, . . . , γT)′ but should be indexed by K age groups, not T time periods.
- [Section 4, paragraph on Figure 7] 'the reduction in the reduction of the suicide-related emergency calls rate' appears to be a typo and should read 'a reduction in the suicide-related emergency calls rate'.
- [References] The text cites 'Morris, 2017' and 'Wakefield et al., 2017', but the reference list contains Morris (2001) and Wakefield et al. (2001); the citations and the reference list need to be reconciled.
- [Figure numbering] The text refers to 'Figure 7 shows the spatio-temporal effect' immediately after Figure 2, but Figure 7 in the supplementary material is the full space-age effect; the in-text figure cross-references are inconsistent.
- [Abstract and Section 4] The abstract states the temporal trend rises over 2017–2022, while the text of Section 4 describes a stabilization between 2022 and 2023; please reconcile these statements.
- [Section 2] The statement that indirect standardization assumes 'age-specific risks are homogeneous across regions and time periods' is imprecise; the assumption in Eq. (2) is that the age-specific rates qk are common up to a multiplicative spatiotemporal risk θij, so proportionality, not homogeneity, is the issue.
Circularity Check
No significant circularity: the empirical age-time findings are estimated from data rather than derived from model inputs, and self-citations are not load-bearing.
full rationale
The paper's central claims, namely a rising temporal trend, a nonlinear age pattern, and stronger risk increases among younger age groups after 2020, are posterior summaries of random effects estimated from the suicide-call data. They are not quantities derived from the model assumptions or from the standardization offsets. The only self-referential construction is the internal standardization of expected counts Eijk, which is standard practice: the age effect gamma_k is estimated relative to that baseline, and the time-age interaction zeta3_jk is a separate random effect whose posterior pattern is data-driven. No equation in the paper sets the claimed result equal to an input or to a fitted parameter renamed as a prediction. The self-citations to prior Marco et al. studies are used only to motivate the relevance of suicide-related emergency calls and are not load-bearing for the WAIC-based model comparison or for the specific age-time pattern. The paper is therefore self-contained with respect to its empirical findings; concerns about uncertainty intervals or the call-data proxy for suicide risk are correctness and validity issues, not circularity.
Assumptions & free parameters
free parameters (2)
- PC prior scale for standard deviation hyperparameters =
P(sigma > 1) = 0.01
- PC prior for Leroux mixing parameter lambda =
P(lambda < 0.5) = 0.5
assumptions (5)
- domain assumption Suicide-related emergency call counts follow a Poisson distribution given the latent relative risk.
- domain assumption The spatial effect follows a Leroux conditional autoregressive prior.
- domain assumption The time and age effects are either independent or first-order random walks.
- domain assumption Knorr-Held interaction types and sum-to-zero constraints guarantee identifiability of the linear predictor.
- domain assumption The Wakefield et al. graphical test (Loess scatterplot of stratum rates against reference rates) is a valid indicator that indirect standardization is biased.
Cite this review
Pith. "Pith review of Overcoming Standardization: Revealing Hidden Age Patterns of Suicide with Spatiotemporal Models." pith.science (2026). https://pith.science/paper/HZ7BQW6G
@misc{pith2026250712033,
author = {Pith},
title = {Pith review of: Overcoming Standardization: Revealing Hidden Age Patterns of Suicide with Spatiotemporal Models},
year = {2026},
howpublished = {\url{https://pith.science/paper/HZ7BQW6G}},
note = {Machine review of arXiv:2507.12033}
}
read the original abstract
Indirect standardization is widely used in disease mapping to control for confounding, but relies on restrictive assumptions that may bias estimates if violated. Using data on suicide-related emergency calls, this study highlights such limitations and proposes age-structured hierarchical Bayesian models as an alternative. These models incorporate space-time, space-age, and time-age interactions, allowing for more accurate estimation without strong assumptions. The results show improved model fit, especially when including age effects. The best model reveals a rising temporal trend (2017--2022), a nonlinear age pattern, and stronger risk increases among younger individuals compared to older ones.
Figures
Figures from the paper (4 more)
Reference graph
Works this paper leans on
-
[1]
Abdul-Fattah, E., Van-Niekerk, J. and Rue, H. (2023). INLA ^+ : approximate Bayesian inference for non-sparse models using HPC. Statistics and Computing , 35(17), 1--23
work page 2023
-
[2]
Besag, J. (1974). Spatial Interaction and the Statistical Analysis of Lattice Systems. Journal of the Royal Statistical Society , 36(2), 192--225
work page 1974
-
[3]
Botella, P. and Mart\'inez-Beneito, M. A. (2015). A unifying modeling framework for highly multivariate disease mapping. Statistics in Medicine , 34(9), 1548--1559
work page 2015
-
[4]
Ca\ non-Ayala, M. J., Perdomo-Jurado, Y. E. and Caro-Delgado, A. G. (2024). Spatiotemporal analysis of suicide attempts in Colombia from 2018 to 2020. Cadernos de Sa\'ude P\'ublica , 40(8), 1--16
work page 2024
-
[5]
Congdon, P. (2006). A model for geographical variation in health and total life expectancy. Demographic Research , 14(9), 157--178
work page 2006
-
[6]
Gayosa, E. and Rea\ no, C. (2024). Spatio-temporal Modelling of Measles Risk in the Provinces of Central Luzon, CALABARZON, and MIMAROPA Linking the Impact of Climate-based Factors. Philippine Journal of Science , 153(6A), 2079--2086
work page 2024
-
[7]
Gelman, A., Carlin, J. B., Stern, H. S., Dunson, D. B., Vehtari, A. and Rubin, D. B. (2013). Bayesian Data Analysis. 3rd Ed. Chapman & Hall / CRC , New York
work page 2013
-
[8]
Gneiting, T. and Raftery, A. E. (2007). Strictly Proper Scoring Rules, Prediction, and Estimation. Journal of the american Statistical Association , 102(477), 359--378
work page 2007
Show all 31 references
-
[9]
D., Etxeberria, A
Goicoa, T., Ugarte, M. D., Etxeberria, A. F. and Militino, A. F. (2016). Age-space-time CAR models in Bayesian disease mapping. Statistics in Medicine , 35(14), 2391--2405
2016
-
[10]
Goicoa, T., Adin, A., Ugarte, M. D. and Hodges, J. S. (2018). In spatio-temporal disease mapping models, identifiability constraints affect PQL and INLA results. Stochastic Environmental Research and Risk Assessment , 32, 749--770
2018
-
[11]
Knorr-Held, L. (2000). Bayesian modelling of inseparable space-time variation in disease risk. Statistics in Medicine , 19(17-18), 2555--2567
2000
-
[12]
G., Lei, X
Leroux, B. G., Lei, X. and Breslow, N. (2000). Estimation of Disease Rates in Small Areas: A new Mixed Model for Spatial Dependence. Statistical Models in Epidemiology, the Environment, and Clinical Trials , 116, 179--191
2000
-
[13]
H., Rue, H
Lindgren, F., Bachl, F., Illian, J., Suen, M. H., Rue, H. and Seaton, A. E. (2024). inlabru: software for fitting latent Gaussian models with non-linear predictors. arXiv preprint arXiv:2407.00791
2024 arXiv
-
[14]
and Ghaem, H
Maleki, Z., Hassanzadeh, J. and Ghaem, H. (2025). Relationship of modifiable risk factors with the incidence of thyroid cancer: a worldwide study. BMC Research Notes , 18(22), 1--9
2025
-
[15]
and Gracia, E
Marco, M., L\'opez-Qu\'ilez, A., S\'anchez-S\'aez, F., Escobar-hern\'andez, P., Montagud-Andr\'es, M., Lila, M. and Gracia, E. (2024). The Spatio-Temporal Distribution of Suicide-related Emergency Calls in a European City: Age and Gender Patterns, and Neighborhood Influences. ...
2024
-
[16]
and Lila, M
Marco, M., Gracia, E., L\'opez-Qu\'ilez, A. and Lila, M. (2018). What calls for service tell us about suicide: A 7-year spatio-temporal analysis of neighborhood correlates of suicide-related calls. Scientific Reports , 8(6746), 1--8
2018
-
[17]
and Lila, M
Marco, M., L\'opez-Qu\'ilez, A., Conesa, D., Gracia, E. and Lila, M. (2017). Spatio-Temporal Analysis of Suicide-Related Emergency Calls. International Journal of Environmental Research Public Health , 17(7), 1--13
2017
-
[18]
Morris, S. E. (2001). Assessment of disease risk in relation to a pre-specified source. In: Elliott, P., Wakefield, J. C., Best, N. G. and Briggs, J. D. (eds), Spatial Epidemiology: Methos and Applications Oxford University Press : Oxford
2001
-
[19]
and Ugarte, M
Orozco-Acosta, E., Adin, A. and Ugarte, M. D. (2023). Big problems in spatio-temporal disease mapping: Methods and software. Computer Methods and Programs in Biomedicine , 231, 1--15
2023
-
[20]
and Mart\'inez-Beneito, M
Perez-Panades, J., Botella-Rocamora, P. and Mart\'inez-Beneito, M. A. (2020). Beyond standardized mortality ratios; some uses of smoothed age-specific mortality rates on small areas studies. International Journal of Health Geographics , 19(54), 1--14
2020
-
[21]
and Ugarte, M
Retegui, G., Etxeberria, J. and Ugarte, M. D. (2024). Multivariate Bayesian models with flexible shared interactions for analyzing spatio-temporal patterns of rare cancers. Environmental and Ecological Statistics , 31, 977--1007
2024
-
[22]
and Bugiardini, R
Romeo, B., Bergami, M., Cenko, E., Manfrini, O. and Bugiardini, R. (2024). Sex Disparities in Ischemic Heart Disease Mortality in Europe. JACC: Advances , 3(12), 1--17
2024
-
[23]
and Held, L
Rue, H. and Held, L. (2005). Gaussian Markov Random Fields: Theory and Applications. Chapman & Hall / CRC , New York
2005
-
[24]
and Chopin, N
Rue, H., Martino, S. and Chopin, N. (2009). Approximate Bayesian Inference for Latent Gaussian models by using Integrated Nested Laplace Approximations. Journal of the Royal Statistical Society Series B: Statistical Methodology , 71(2), 319--392
2009
-
[25]
Simpson, D., Rue, H., Riebler, A., Martins, T. G. and S rbye, S. H. (2017). Penalising Model Component Complexity: A Principled, Practical Approach to Constructing Priors. Statistical Science , 32(1), 1--28
2017
-
[26]
J., Best, N
Spiegelhalter, D. J., Best, N. G., Carlin, B. P. and Van der Linde, A. (2002). Bayesian Measures of Model Complexity and Fit. Journal of the Royal Statistical Society Series B: Statistical Methodology , 64(4), 583--639
2002
-
[27]
and Ugarte, M
Urdangarin, A., Goicoa, T., Congdon, P. and Ugarte, M. D. (2025). A fast approach for analyzing spatio-temporal patterns in ischemic heart disease mortality across US counties (1999-2021). Spatial and Spatio-temporal Epidemiology , 52, 1--11
2025
-
[28]
and Gabry, J
Vehtari, A., Gelman, A. and Gabry, J. (2017). Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC. Statistics and Computing , 27, 1413--1432
2017
-
[29]
and Rohrmann, S
Vinci, L., Wanner, M., Karavasiloglou, N., Dressel, H., Barresi, F., Korl, D. and Rohrmann, S. (2024). Incidence, mortality and survival of pleural mesothelioma in Zurich between 1981 and 2019, Switzerland. Journal of Thoracic Disease , 16(12), 8240--8251
2024
-
[30]
Wakefield, J. C. Best, N. G. and Waller, L. (2001). Bayesian approaches to dsease mapping. In: Elliott, P., Wakefield, J. C., Best, N. G. and Briggs, J. D. (eds), Spatial Epidemiology: Methos and Applications Oxford University Press : Oxford
2001
-
[31]
Watanabe, S. (2010). Asymptotic Equivalence of Bayes Cross Validation and Widely Applicable Information Criterion in Singular Learning Theory. Journal of Machine Learning Research , 1(1), 3571--3594
2010
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.