RECORD
Non-Local Priors for High-Dimensional Estimation
Statistics Theory · Submitted 20 Feb 2014
abstract compiled · 2026-09-23 · no language-model review
The authors' main claim Our findings contribute to the debate of whether different priors should be used for estimation and model selection, showing that selection priors may actually be desirable for high-dimensional estimation.
The compiled record
The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
Open the compiled record
The abstract, sentence by sentence
Simultaneously achieving parsimony and good predictive power in high dimensions is a main challenge in statistics. Non-local priors (NLPs) possess appealing properties for high-dimensional model choice, but their use for estimation has not been studied in detail. We show that, for regular models, Bayesian model averaging (BMA) estimates based on NLPs shrink spurious parameters either at fast polynomial or quasi-exponential rates as the sample size $n$ increases (depending on the chosen prior density). Non-spurious parameter estimates only differ from the oracle MLE by a factor of $n^{-1}$. We extend some results to linear models with dimension $p$ growing with $n$. Coupled with our theoretical investigations, we outline the constructive representation of NLPs as mixtures of truncated distributions. From a practitioners' perspective, our work enables simple posterior sampling and extending NLPs beyond previous proposals. Our results show notable high-dimensional estimation for linear models with $p>>n$ at reduced computational cost. NLPs provided lower estimation error than benchmark and hyper-g priors, SCAD and LASSO in simulations, and in gene expression data achieved higher cross-validated $R^2$ with an order of magnitude less predictors. Remarkably, these results were obtained without the need to pre-screen predictors. Our findings contribute to the debate of whether different priors should be used for estimation and model selection, showing that selection priors may actually be desirable for high-dimensional estimation.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | Simultaneously achieving parsimony and good predictive power in high dimensions is a main challenge in statistics. | background 1.00 | 0.05 | 0.03 | asserted 1.00 |
| s1 | Non-local priors (NLPs) possess appealing properties for high-dimensional model choice, but their use for estimation has not been studied in detail. | gap 0.99 | 0.05 | 0.03 | asserted 0.97 |
| s2 | We show that, for regular models, Bayesian model averaging (BMA) estimates based on NLPs shrink spurious parameters either at fast polynomial or quasi-exponential rates as the sample size $n$ increases (depending on the chosen prior density). | result 0.99 | 0.94 | 0.41 | asserted 1.00 |
| s3 | Non-spurious parameter estimates only differ from the oracle MLE by a factor of $n^{-1}$. | result 1.00 | 0.88 | 0.14 | asserted 1.00 |
| s4 | We extend some results to linear models with dimension $p$ growing with $n$. | contribution 0.86 | 0.91 | 0.04 | asserted 0.98 |
| s5 | Coupled with our theoretical investigations, we outline the constructive representation of NLPs as mixtures of truncated distributions. | contribution 0.62 | 0.93 | 0.05 | asserted 0.94 |
| s6 | From a practitioners' perspective, our work enables simple posterior sampling and extending NLPs beyond previous proposals. | interpretation 0.55 | 0.80 | 0.06 | asserted 0.79 |
| s7 | Our results show notable high-dimensional estimation for linear models with $p>>n$ at reduced computational cost. | result 0.98 | 0.91 | 0.20 | asserted 1.00 |
| s8 | NLPs provided lower estimation error than benchmark and hyper-g priors, SCAD and LASSO in simulations, and in gene expression data achieved higher cross-validated $R^2$ with an order of magnitude less predictors. | result 1.00 | 0.95 | 0.38 | asserted 1.00 |
| s9 | Remarkably, these results were obtained without the need to pre-screen predictors. | result 0.83 | 0.89 | 0.08 | asserted 1.00 |
| s10 | Our findings contribute to the debate of whether different priors should be used for estimation and model selection, showing that selection priors may actually be desirable for high-dimensional estimation. | interpretation 0.96 | 0.80 | 0.55 | hedged possibility 0.70 |
What was examined, and what was not
- arXiv listing abstract v3
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
The paper
Original abstract
Simultaneously achieving parsimony and good predictive power in high dimensions is a main challenge in statistics. Non-local priors (NLPs) possess appealing properties for high-dimensional model choice, but their use for estimation has not been studied in detail. We show that, for regular models, Bayesian model averaging (BMA) estimates based on NLPs shrink spurious parameters either at fast polynomial or quasi-exponential rates as the sample size $n$ increases (depending on the chosen prior density). Non-spurious parameter estimates only differ from the oracle MLE by a factor of $n^{-1}$. We extend some results to linear models with dimension $p$ growing with $n$. Coupled with our theoretical investigations, we outline the constructive representation of NLPs as mixtures of truncated distributions. From a practitioners' perspective, our work enables simple posterior sampling and extending NLPs beyond previous proposals. Our results show notable high-dimensional estimation for linear models with $p>>n$ at reduced computational cost. NLPs provided lower estimation error than benchmark and hyper-g priors, SCAD and LASSO in simulations, and in gene expression data achieved higher cross-validated $R^2$ with an order of magnitude less predictors. Remarkably, these results were obtained without the need to pre-screen predictors. Our findings contribute to the debate of whether different priors should be used for estimation and model selection, showing that selection priors may actually be desirable for high-dimensional estimation.
Human review
Discussion
Know something about this paper? Leave a comment, or highlight any passage above to comment on it.