REVIEW 2 major objections 5 minor 52 references
Spatial weights matrix selection and model averaging for multivariate spatial autoregressive models
T0 review · 2 major / 5 minor · reviewed 2026-08-05 · deepseek-v4-flash
Pith's one-line read A Mallows-type criterion for multivariate spatial autoregressive models selects the true spatial weights matrix when present, and otherwise matches the best misspecified candidate's prediction loss.
desk verdict A legitimate extension of Mallows-type weights-matrix selection to multivariate SAR, but the headline theorems rest on an unverified rate condition for an approximate derivative, so the central claims are conditional; worth a serious referee. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the criterion C_hat(k) = ||P_hat(k) y - y||^2 + 2(tr(P_hat(k) Omega_hat) + tr(partial vec(D_hat(k))/partial y^T (y^T ⊗ Omega_hat) partial vec(P_hat(k))/partial vec(D_hat(k))^T)), and its model-averaging analogue C_hat(w) = w^T H^T H w + 2 w^T h. C_hat(k) estimates R_k + tr(Omega); the first term is the in-sample fit and the second is twice the effective degrees of freedom, so minimizing it balances fit against model complexity. The same penalty structure is applied to the convex combination of candidate models, turning weight choice into a constrained quadratic program.
What would settle it
Simulate an MSAR model with known D and W*, and with at least one misspecified candidate W_k. Estimate the true degrees of freedom df_k by Monte Carlo covariance between fitted values and responses, and compare it with the penalty term computed from the Appendix A approximation. If the difference, scaled by n or by the risk R_k, does not vanish as n grows, then the criterion is not an unbiased risk estimator and the optimality theorems cannot hold in that setting.
Extended reading notes
Core claim
The central discovery is that the prediction risk of a fitted MSAR model can be estimated unbiasedly up to an additive constant by a Mallows-type statistic, and that minimizing that statistic over candidate spatial weights matrices is asymptotically optimal. Specifically, if all candidates are misspecified, the selected model satisfies L_hat(k)/inf_k L_k →_p 1; if the true weights matrix is in the candidate set, P(W_hat(k) = W*) →_p 1. For averaging, the chosen weight vector satisfies L(hat(w))/inf_w L(w) →_p 1. The proof requires the penalty term to track the effective degrees of freedom, which the paper obtains through Stein's lemma and an approximated derivative of the estimated spatial d
Load-bearing premise
The theory assumes that the approximate derivative of the estimated spatial dependence matrix, obtained by ignoring randomness in the estimated covariance, converges fast enough; the paper does not derive the exact derivative or prove that the approximation meets this rate.
Editorial extensions
If this is right
- When the true spatial weights matrix is in the candidate set, the selected model recovers it with probability tending to one, so the selection result can be read as evidence about the true connectivity mechanism.
- When the true matrix is not in the candidate set, the selected predictor's squared loss is asymptotically the same as the loss of the candidate that would have been best if we had known the truth.
- The model averaging estimator is asymptotically optimal over all convex combinations of candidates and can beat every single candidate model in squared prediction loss.
- The covariance estimator used in the penalty does not need to be consistent, so a single dense candidate matrix can be used for the correction term without breaking the theory.
- On the Sina Weibo data, the bivariate MSAR selection and averaging are more stable and predict finance and economics posting behavior better than univariate SAR, with averaging weights pointing toward uniform followee influence or influence proportional to the followee's follower count.
Reading between the lines
- Inference: the approximate derivative in Appendix A is the spot to attack—if a data-generating process violates the convergence-rate conditions (C7), (C10), or (C13), selection consistency and optimality could fail even though the large-sample theorems look general. A Monte Carlo comparison of the penalty with the true degrees of freedom would expose this.
- Inference: the averaged weights matrix sum_k w_hat(k) W_k gives a fitted convex combination of connectivity mechanisms, inviting interpretation of the weights as an estimate of mixture proportions, although the paper does not provide standard errors for these weights.
- Inference: the quadratic form of the averaging criterion makes model screening natural when the number of candidate matrices is large; the paper notes screening as future work, but the structure of C_hat(w) suggests a tractable route.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper studies model selection and model averaging over a finite set of candidate spatial weights matrices for the multivariate spatial autoregressive model Y = WYD + XB + E. It proposes a Mallows-type criterion (eq. 8) whose penalty contains a derivative term ∂vec(D̂_k)/∂y^T, establishes asymptotic optimality of the selected model when the true weights matrix is not among the candidates (Theorem 3.1), selection consistency when it is (Theorem 3.2), and asymptotic optimality of a model averaging estimator (Theorem 4.1). The theorems are conditioned on high-level rate conditions, notably (C7), (C10), and (C13), involving the derivative penalty. The paper also contains extensive simulations, including non-normal errors and geographically constructed weights, a comparison with high-order MSAR, and an application to Sina Weibo data.
Significance. If the theoretical claims are fully supported, the paper is a useful extension of the univariate SAR model-selection literature (Zhang and Yu 2018) to multivariate responses. The allowance for a growing number of candidate matrices, the treatment of the case where the true weights matrix is not in the candidate set, and the practical application to social-network data are all valuable. The paper also ships code and data, and the simulation study is unusually thorough, covering normal and t-distributed errors, several candidate sets, and a comparison with high-order MSAR. The main weakness is that the central theorems rest on rate conditions for an approximated derivative whose required rates are asserted but not verified.
major comments (2)
- [Section 2, Condition (C5)] The load-bearing gap is the penalty term in the feasible criterion, eq. (8): 2 tr(∂vec(D̂_k)/∂y^T (y^T⊗Ω̂) ∂vec(P̃_k)/∂vec(D̂_k)^T). The proofs of Theorems 3.1, 3.2, and 4.1 use Conditions (C7), (C10), and (C13) to control this term (e.g., (C7) gives (B2a) in Appendix B). However, Remark 3 states that the exact derivative ∂vec(D̂_k)/∂y^T is 'very difficult to derive', and Appendix A derives instead an approximation that ignores the randomness of the covariance estimator Σ̂_k. No formal result shows that this approximation satisfies the required o_p(ξ_n), o_p(ξ*_n), or o_p(ξ̃_n) rates uniformly over k, nor that the difference between the exact and approximated penalty is asymptotically negligible. If the omitted ∂Σ̂_k/∂y^T contributions are not o_p of the relevant rates, the uniform comparison in (B2a) fails and the optimality/consistency conclusions are unsupported. The statement in Rema
- [Section 3, Appendix C] Condition (C5) as printed is not dimensionally coherent. Since fX = I_q⊗X ∈ R^{nq×pq}, the expression fX^T W_k (I_{nq} − D^T⊗W*)^{-1} fX/n is not well-defined as written because fX^T is pq×nq while W_k is n×n. Presumably the intended expression involves (I_q⊗W_k) or an equivalent block-diagonal embedding. Because (C5) is used in the theoretical framework and in verifying other conditions, this needs to be corrected before the assumptions can be checked.
minor comments (5)
- [Throughout] There are several typos and nonstandard encodings: 'Purcha' for 'Prucha' (Introduction), 'misspecificaitions' (Concluding Remarks), 'Techincal' (Introduction), and 'user¡¯s' in the abstract.
- [Section 5.1, Table 1] In Case 2 of Table 1, the row label 'SAR BasedY2' for the first SAR block appears to be a typo for 'BasedY1'; the subsequent block is labeled BasedY2.
- [Section 3, after eq. (9)] The notation n_pq for the number of parameters (q² + pq + q(q+1)/2) is easily confused with the sample-size/product dimensions n×pq. Please use a different symbol or clarify.
- [Appendix A] The derivation in Appendix A is very dense and some expressions are difficult to parse (e.g., the definitions of F_k^{ij}, the derivative ∂M_k/∂d_{st}, and the final assembling of ∂Q/∂d). A short explanation of the matrix layout and the notational conventions would improve reproducibility.
- [End of paper] The text says code and data are openly available in an online supplementary material, but the arXiv version contains no link or repository identifier. Please provide a working link.
Circularity Check
No significant circularity: the criterion is an unbiased loss estimator and the theorems rest on explicit high-level rate conditions, not on a fitted/prediction identity.
full rationale
The derivation chain is self-contained in the relevant sense. The proposed criterion C_k (eq. 8) is constructed so that E(C_k)=R_k+tr(Omega) via Stein's lemma (eqs. 5-7), and the selected model b_k=argmin C_k is then shown, under conditions (C1)-(C8), to satisfy L_{b_k}/inf_k L_k ->p 1 through a standard Mallows-type uniform comparison (Appendix B). No fitted parameter is renamed as a prediction: the penalty term is an unbiased degrees-of-freedom correction, not a quantity estimated from the data being predicted. The model averaging criterion is the convex analogue and has the same unbiasedness property. The main caveat is explicit in Remark 3 and Appendix A: the exact derivative ∂vec(D̂_k)/∂y^T is acknowledged to be 'very difficult to derive', and an approximation that ignores the randomness of Σ̂_k is used instead, with conditions (C7), (C10), and (C13) merely assuming the required convergence rates rather than proving them from the approximation. This is a genuine technical gap and a correctness risk, but it is not circularity: the theorems are conditional on high-level conditions, and the conditions are not equivalent to the conclusions by construction. The reliance on Zhu et al. (2020) through Condition (C2) is a self-citation (two of the present authors are co-authors), and it is load-bearing for the consistency of the preliminary estimator D̂_k; however, it cites a published, externally refereed estimation theory and does not itself assert the optimality or selection-consistency results of this paper. Under the stated rules, this is legitimate independent support rather than a circular self-citation chain. No equation in the paper reduces to its own input by definition, and no fitted quantity is presented as a prediction.
Assumptions & free parameters
assumptions (5)
- domain assumption Conditions (C1)-(C6) of Zhu et al. (2020) hold for the least-squares MSAR estimator.
- domain assumption The standardized disturbances Σ^{-1/2}ε have independent elements.
- domain assumption All candidate models are misspecified so that ∑_k (R*_k)^{-G}=o(1).
- ad hoc to paper The approximated derivative ∂vec(D̂_k)/∂y^T from Appendix A satisfies rate conditions (C7), (C10), (C13).
- domain assumption W_k is row-normalized and the maximum absolute eigenvalue of D is less than 1.
Cite this review
Pith. "Pith review of Spatial weights matrix selection and model averaging for multivariate spatial autoregressive models." pith.science (2026). https://pith.science/paper/TNFSTC5T
@misc{pith2026250906005,
author = {Pith},
title = {Pith review of: Spatial weights matrix selection and model averaging for multivariate spatial autoregressive models},
year = {2026},
howpublished = {\url{https://pith.science/paper/TNFSTC5T}},
note = {Machine review of arXiv:2509.06005}
}
read the original abstract
In this paper, we focus on the model specification problem in multivariate spatial econometric models when a candidate set for the spatial weights matrix is available. We propose a model selection method for the multivariate spatial autoregressive model, when the true spatial weights matrix may not be in the candidates. We show that the selected estimator is asymptotically optimal in the sense of minimizing the squared loss. If the candidate set contains the true spatial weights matrix, the method has selection consistency. We further propose a model averaging estimator that combines a set of candidate models and show its asymptotic optimality. Monte Carlo simulation results indicate that the proposed model selection and model averaging estimators perform quite well in finite samples. The proposed methods are applied to a Sina Weibo data to reveal how the user's posting behavior is influenced by the users that he follows. The analysis results indicate that the influence tends to be uniformly distributed among the user's followee, or linearly correlated with the number of followers of the followee.
Reference graph
Works this paper leans on
-
[1]
, author Li, K.C
author Ando, T. , author Li, K.C. , year 2014 . title A model-averaging approach for high-dimensional regression . journal Journal of the American Statistical Association volume 109 , pages 254--265
2014
-
[2]
author Anselin, L. , year 1988 . title Spatial Econometrics: Methods and Models . publisher Springer Science & Business Media
work page 1988
-
[3]
author Baltagi, B. , author Bresson, G. , year 2011 . title Maximum likelihood estimation and lagrange multiplier tests for panel seemingly unrelated regressions with spatial lag and spatial errors: A n application to hedonic housing prices in paris . journal Journal of Urban Economics volume 69 , pages 24--42
work page 2011
-
[4]
author Banerjee, S. , author Carlin, B. , author Gelfand, A. , year 2014 . title Hierarchical Modeling and Analysis for Spatial Data . publisher CRC Press
work page 2014
-
[5]
author Burridge, P. , author Fingleton, B. , year 2010 . title Bootstrap inference in spatial econometrics: the J -test . journal Spatial Economic Analysis volume 5 , pages 93--119
work page 2010
-
[6]
author Chen, X. , author Chen, Y. , author Xiao, P. , year 2013 . title The impact of sampling and network topology on the estimation of social intercorrelations . journal Journal of Marketing Research volume 50 , pages 95--110
work page 2013
-
[7]
author Cliff, A. , author Ord, J. , year 1973 . title Spatial Autocorrelation . publisher Pion Ltd., London
work page 1973
-
[8]
author Cohen-Cole, E. , author Liu, X. , author Zenou, Y. , year 2018 . title Multivariate choices and identification of social interactions . journal Journal of Applied Econometrics volume 33 , pages 165--178
work page 2018
Show all 52 references
-
[9]
, author Van Oort, F
author De Graaff, T. , author Van Oort, F. , author Florax, R. , year 2012 . title Regional population–employment dynamics across different sectors of the economy . journal Journal of Regional Science volume 52 , pages 60--84
2012
-
[10]
, author Rasul, I
author De Paula, A. , author Rasul, I. , author Souza, P.C. , year 2025 . title Identifying network ties from panel data: Theory and an application to tax competition . journal The Review of Economic Studies volume 92 , pages 2691--2729
2025
-
[11]
, author LeSage, J.P
author Debarsy, N. , author LeSage, J.P. , year 2022 . title Bayesian model averaging for spatial autoregressive models based on convex combinations of different types of connectivity matrices . journal Journal of Business & Economic Statistics volume 40 , pages 547--558
2022
-
[12]
, author Parrella, M.L
author Dou, B. , author Parrella, M.L. , author Yao, Q. , year 2016 . title Generalized yule–walker estimation for spatio-temporal models with unknown diagonal coefficients . journal Journal of Econometrics volume 194 , pages 369--382
2016
-
[13]
, year 2004
author Efron, B. , year 2004 . title The estimation of prediction error: covariance penalties and cross-validation . journal Journal of the American Statistical Association volume 99 , pages 619--632
2004
-
[14]
, author Yuan, C
author Fang, F. , author Yuan, C. , author Tian, W. , year 2023 . title An asymptotic theory for least squares model averaging with nested models . journal Econometric Theory volume 39 , pages 412--441
2023
-
[15]
, author Robinson, P.M
author Gupta, A. , author Robinson, P.M. , year 2015 . title Inference on higher-order spatial autoregressive models with increasingly many parameters . journal Journal of Econometrics volume 186 , pages 19--31
2015
-
[16]
, year 2007
author Hansen, B. , year 2007 . title Least squares model averaging . journal Econometrica volume 75 , pages 1175–1189
2007
-
[17]
, author Partridge, M
author Jeanty, P.W. , author Partridge, M. , author Irwin, E. , year 2010 . title Estimation of a spatial simultaneous equation model of population migration and housing price dynamics . journal Regional Science and Urban Economics volume 40 , pages 343--352
2010
-
[18]
, year 2008
author Kelejian, H.H. , year 2008 . title A spatial J -test for model specification against a single or a set of non-nested alternatives . journal Letters in Spatial and Resource Sciences volume 1 , pages 3--11
2008
-
[19]
, author Piras, G
author Kelejian, H.H. , author Piras, G. , year 2011 . title An extension of K elejian's J -test for non-nested spatial models . journal Regional Science and Urban Economics volume 41 , pages 281--292
2011
-
[20]
, author Prucha, I
author Kelejian, H.H. , author Prucha, I. , year 2004 . title Estimation of simultaneous systems of spatially interrelated cross sectional equations . journal Journal of Econometrics volume 118 , pages 27--50
2004
-
[21]
, author Purcha, I.R
author Kelejian, H.H. , author Purcha, I.R. , year 1998 . title A generalized spatial two-stage least squares procedure for estimating a spatial autoregressive model with autoregressive disturbances . journal Journal of Real Estate Finance and Economics volume 17 , pages 99--121
1998
-
[22]
, year 2004
author Lee, L.F. , year 2004 . title Asymptotic distributions of quasi-maximum likelihood estimators for spatial autoregressive models . journal Econometrica volume 72 , pages 1899--1925
2004
-
[23]
, year 2007
author Lee, L.F. , year 2007 . title GMM and 2 SLS estimation of mixed regressive, spatial autoregressive models . journal Journal of Econometrics volume 137 , pages 489--514
2007
-
[24]
, author Liu, X
author Lee, L.F. , author Liu, X. , year 2010 . title Efficient GMM estimation of high order spatial autoregressive models with autoregressive disturbances . journal Econometric Theory volume 26 , pages 187--230
2010
-
[25]
, author Yu, J
author Lee, L.F. , author Yu, J. , year 2009 . title Spatial nonstationarity and spurious regression: the case with a row-normalized spatial weights matrix . journal Spatial Economic Analysis volume 4 , pages 301--327
2009
-
[26]
, author Pace, R.K
author LeSage, J.P. , author Pace, R.K. , year 2007 . title A matrix exponential spatial specification . journal Journal of Econometrics volume 140 , pages 190--214
2007
-
[27]
, author Qu, X
author Lewbel, A. , author Qu, X. , author Tang, X. , year 2023 . title Social networks with unobserved links . journal Journal of Political Economy volume 131 , pages 898--946
2023
-
[28]
, year 1987
author Li, K.C. , year 1987 . title Asymptotic optimality for C p, C l, cross-validation and generalized cross-validation: D iscrete index set . journal The Annals of Statistics volume 15 , pages 958--975
1987
-
[29]
, author Zou, G
author Liang, H. , author Zou, G. , author Wan, A.T. , author Zhang, X. , year 2011 . title Optimal weight choice for frequentist model average estimators . journal Journal of the American Statistical Association volume 106 , pages 1053--1066
2011
-
[30]
, author Okui, R
author Liu, Q. , author Okui, R. , year 2013 . title Heteroscedasticity-robust C p model averaging . journal The Econometrics Journal volume 16 , pages 463--472
2013
-
[31]
, year 2014
author Liu, X. , year 2014 . title Identification and efficient estimation of simultaneous equations network models . journal Journal of Business & Economic Statistics volume 32 , pages 516--536
2014
-
[32]
, author Patacchini, E
author Liu, X. , author Patacchini, E. , author Zenou, Y. , year 2014 . title Endogenous peer effects: local aggregate or local average? journal Journal of Economic Behavior & Organization volume 103 , pages 39--59
2014
-
[33]
, year 2005
author Longford, N. , year 2005 . title Editorial: model selection and efficiency is ‘which model... ?’ the right question? journal Journal of Royal Statistical Society, Series A volume 168 , pages 469--472
2005
-
[34]
, year 1973
author Mallows, C. , year 1973 . title Some comments on C p . journal Technometrics volume 15 , pages 661--675
1973
-
[35]
, author Barry, R
author Pace, R.K. , author Barry, R. , author Gilley, O.W. , author Sirmans, C. , year 2000 . title A method for spatial--temporal forecasting with an application to real estate prices . journal International Journal of Forecasting volume 16 , pages 229--246
2000
-
[36]
, author LeSage, J.P
author Pace, R.K. , author LeSage, J.P. , year 2002 . title Semiparametric maximum likelihood estimates of spatial dependence . journal Geographical Analysis volume 34 , pages 76--90
2002
-
[37]
, year 1997
author Shao, J. , year 1997 . title An asymptotic theory for linear model selection . journal Statistica sinica volume 7 , pages 221--264
1997
-
[38]
, year 1981
author Stein, C.M. , year 1981 . title Estimation of the mean of a multivariate normal distribution . journal The Annals of Statistics volume 9 , pages 1135--1151
1981
-
[39]
, author Zhang, X
author Wan, A.T. , author Zhang, X. , author Zou, G. , year 2010 . title Least squares model averaging by mallows criterion . journal Journal of Econometrics volume 156 , pages 277--283
2010
-
[40]
, year 1960
author Whittle, P. , year 1960 . title Bounds for the moments of linear and quadratic forms in independent variables . journal Theory of Probability & Its Applications volume 5 , pages 302--305
1960
-
[41]
, author Lee, L.F
author Yang, K. , author Lee, L.F. , year 2017 . title Identification and QML estimation of multivariate and simultaneous equations spatial autoregressive models . journal Journal of Econometrics volume 196 , pages 196--214
2017
-
[42]
, author Do g an, O
author Yang, Y. , author Do g an, O. , author Taspinar, S. , year 2022 . title Model selection and model averaging for matrix exponential spatial models . journal Econometric Reviews volume 41 , pages 827--858
2022
-
[43]
, author Yang, Y
author Yuan, Z. , author Yang, Y. , year 2005 . title Combining linear regression models: W hen and how? journal Journal of the American Statistical Association volume 100 , pages 1202--1214
2005
-
[44]
, author Yu, J
author Zhang, X. , author Yu, J. , year 2018 . title Spatial weights matrix selection and model averaging for spatial autoregressive models . journal Journal of Econometrics volume 203 , pages 1--18
2018
-
[45]
, author Zou, G
author Zhang, X. , author Zou, G. , author Liang, H. , year 2014 . title Model averaging and weight choice in linear mixed-effects models . journal Biometrika volume 101 , pages 205--218
2014
-
[46]
, author Huang, D
author Zhu, X. , author Huang, D. , author Pan, R. , author Wang, H. , year 2020 . title Multivariate spatial autoregressive model for large scale social networks . journal Journal of Econometrics volume 215 , pages 591--606
2020
-
[47]
degrees of freedom
author Zou, H. , author Hastie, T. , author Tibshirani, R. , year 2007 . title On the “degrees of freedom” of the lasso . journal The Annals of Statistics volume 35 , pages 2173--2192
2007
-
[48]
@esa (Ref
\@ifxundefined[1] #1\@undefined \@firstoftwo \@secondoftwo \@ifnum[1] #1 \@firstoftwo \@secondoftwo \@ifx[1] #1 \@firstoftwo \@secondoftwo [2] @ #1 \@temptokena #2 #1 @ \@temptokena \@ifclassloaded agu2001 natbib The agu2001 class already includes natbib coding, so you should ...
-
[49]
\@lbibitem[] @bibitem@first@sw\@secondoftwo \@lbibitem[#1]#2 \@extra@b@citeb \@ifundefined br@#2\@extra@b@citeb \@namedef br@#2 \@nameuse br@#2\@extra@b@citeb \@ifundefined b@#2\@extra@b@citeb @num @parse #2 @tmp #1 NAT@b@open@#2 NAT@b@shut@#2 \@ifnum @merge>\@ne @bibitem@firs...
-
[50]
@open @close @open @close and [1] URL: #1 \@ifundefined chapter * \@mkboth \@ifxundefined @sectionbib * \@mkboth * \@mkboth\@gobbletwo \@ifclassloaded amsart * \@ifclassloaded amsbook * \@ifxundefined @heading @heading NAT@ctr thebibliography [1] @ \@biblabel @NAT@ctr \@bibset...
1997
-
[51]
, " * write output.state after.block = add.period
ENTRY address archive author booktitle chapter collaboration edition editor eid howpublished institution journal key lastchecked month note number numpages organization pages publisher school series title type url urldate volume year label extra.label sort.label INTEGERS outpu...
-
[52]
write newline
" write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 gl...
Reviewed August 5, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.