REVIEW 4 major objections 6 minor 21 references
Quantile Convolutional Neural Networks for Value at Risk Forecasting
T0 review · 4 major / 6 minor · reviewed 2026-08-14 · deepseek-v4-flash
Pith's one-line read A convolutional network trained jointly on many stocks' histories can forecast Value at Risk with exceedance rates close to nominal levels, beating constant, GARCH, and linear quantile regression baselines.
desk verdict Joint multi-asset training helps quantile CNNs for VaR, but the evidence is thinner than the conclusion. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
Three components carry the argument. (1) The pinball quantile loss replaces mean squared error so that the network's output is a conditional quantile, i.e., a VaR estimate, without distributional assumptions. (2) The network is a WaveNet-style stack of six causal convolutional layers with eight filters of kernel size 2, ReLU activations, and exponentially increasing dilation rates ($2^{l-1}$), followed by a $1\times 1$ convolution with a linear activation; causal dilated convolutions give an exponential receptive field so the 128-step input window can predict one step ahead. (3) Joint training feeds the overlapping 128-return windows from all 100 stocks into the same network, so the model learns from pooled tail events rather than from a single asset's history. The claim is that these three pieces together produce calibrated one-day-ahead VaR forecasts at 95%, 99%, and 99.9% confidence.
What would settle it
Train the joint QCNN on 100 stocks and evaluate it on a held-out set of stocks from a market or sector that was deliberately absent from training, for example train on US equities and test on European equities. The central claim predicts that exceedance rates stay near nominal and the Dynamic Quantile rejection rate stays low; if instead the rejection rate rises to the level of the single-stock QCNN, the pooling benefit depends on shared tail sources and does not generalize.
Extended reading notes
Core claim
The discovery is that quantile forecasting with a convolutional neural network works for Value at Risk when the network is trained jointly on multiple assets, and fails when trained on a single asset's history alone. The QCNN is a causal, dilated, one-dimensional convolutional network whose final layer outputs a $\theta$-quantile of the next day's return, optimized with the asymmetric absolute loss $\theta\sum_{y_i \ge \hat q_i}(y_i-\hat q_i) + (\theta-1)\sum_{y_i < \hat q_i}(y_i-\hat q_i)$. In the empirical study on 100 US-listed stocks, the single-stock QCNN overshoots the targeted exceedance rates by up to an order of magnitude, while the joint QCNN trained on all 100 stocks gives mean exceedance rates of 0.0433, 0.0115, and 0.0023 for the 95%, 99%, and 99.9% levels—close to the nominal 0.05, 0.01, and 0.001—and has lower average DQ-test rejection rates (0.05 and 0.16 at the 5% and 1% significance levels for 95% VaR) than all baselines, with lower average VaR values than the constant historical estimate.
Load-bearing premise
The load-bearing premise is that the daily returns of different stocks have similar enough tail behavior—common sources of extreme events—that one network trained on many assets can learn valid quantiles for any single asset; if tails are idiosyncratic, the joint model's calibration could be an artifact of pooling rather than a real transferable property.
Editorial extensions
If this is right
- If the central claim is correct, VaR can be produced nonparametrically: no normality or t-distribution assumption is needed, because the network learns the empirical tail directly from returns.
- Joint training is the load-bearing ingredient for deep quantile models: with only one stock's history the same architecture grossly overshoots exceedance rates, so pooling many assets is what makes the data volume sufficient.
- Better calibration transfers into capital: the joint QCNN's average VaR values are lower than the constant historical estimate's while maintaining similar exceedance rates, meaning a bank or portfolio using it would set aside less capital for the same coverage.
- The low Dynamic Quantile rejection rates indicate that the joint model's exceedances are not only correctly frequent but also correctly timed—past exceedances and VaR levels have little explanatory power for future hits.
Reading between the lines
- A natural next test the paper does not run: train the joint QCNN on stocks from one sector or market and test on a held-out sector or market; if the calibration holds, the transfer is general, and if it degrades, the benefit depends on the training and test stocks sharing tail sources.
- The paper's explanation for pooling—'more stocks have experienced more extreme events, and we may expect them to have similar sources'—suggests a data-economy interpretation: the effective sample size for tail estimation is the number of pooled extreme events, not the length of any one series. That interpretation could be tested by varying the number of training assets and observing whether DQ rej
- The same pinball-loss architecture should apply to expected shortfall by swapping the loss for a coherent tail-loss function, and to intraday or high-frequency returns, though neither is evaluated here.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper proposes a quantile convolutional neural network (QCNN), a one-dimensional dilated causal CNN trained with the pinball loss, for one-day-ahead Value at Risk forecasting. The model is evaluated on daily log returns of 100 randomly selected US stocks over 2009-2018, with the last 30% as test set. The authors compare a per-stock QCNN and a joint QCNN trained on all stocks against a constant quantile estimator, a normal GARCH(1,1), and a linear quantile autoregression. The reported tables show that the joint QCNN yields exceedance rates closer to the nominal 95%, 99%, and 99.9% levels, lower standard deviations of exceedance rates, and lower Dynamic Quantile test rejection rates than all baselines, while the single-stock QCNN is badly miscalibrated. The paper concludes that training on multiple assets improves VaR forecasts.
Significance. The central empirical claim—that the joint QCNN improves quantile calibration relative to standard baselines—is plausible and, if confirmed, practically useful: VaR forecasts that are both accurately calibrated and less conservative than a historical quantile are valuable for risk budgeting. The authors are to be credited for evaluating out-of-sample with a standard backtesting test, for reporting exceedance rates, and for including simple baselines rather than only neural alternatives. However, the statistical support is incomplete: no significance tests, no confidence intervals, and no control experiment separate the effect of larger sample size from the claimed cross-asset tail pooling. The paper is clearly written and the QCNN idea is presented transparently, but the empirical evidence as reported is not yet at the standard needed to support the strong conclusions in Section 3.5.
major comments (4)
- [Section 3.5, Tables 1–3] The comparisons are based solely on point estimates (means, medians, standard deviations) with no significance tests or confidence intervals. Because the same 100 stocks are used for every method, paired tests are available; for example, a paired sign test or bootstrap on the per-stock exceedance-rate difference between Joint QCNN and GARCH would directly assess whether the reported gap (0.0433 vs. 0.0347 at the 95% level) is systematic. Likewise, the DQ rejection rates are proportions out of 100 stocks, so binomial confidence intervals should accompany them. Without such measures, the claim in the text that the joint QCNN 'produces the highest quality VaR estimates' is not statistically established.
- [Section 3.1 and Section 3.5] The rationale for joint training is that extreme returns across different stocks 'may ... have similar sources,' but this assumption is never tested, and the reported comparison of Joint QCNN with single-stock QCNN conflates cross-asset pooling with a roughly 100-fold increase in training data. The authors should add a control that holds sample size fixed while destroying the cross-asset structure, such as training the same architecture on a random permutation of the returns across the 100 stocks, or on the pooled returns with the asset index removed. If the permuted/pooled model matches Joint QCNN's performance, the improvement is attributable to sample size rather than to shared tail dynamics; otherwise the stated 'similar sources' mechanism receives support. This distinction is load-bearing for the paper's contribution, which is explicitly about learning from multiple assets.
- [Section 3.4, Eq. (6) and Tables 1–2] Assigning a p-value of 0 to zero-exceedance forecasts is not part of the Engle-Manganelli Dynamic Quantile test as defined by Eq. (6). When Hit has no variation, the regression in Eq. (5) is degenerate and the chi-square approximation is invalid, so a pre-specified replacement rule can bias the reported rejection rates. The authors should report the frequency of zero-exceedance forecasts for each method, justify the 0-p-value rule, and show that the DQ rejection-rate comparisons are robust to an alternative treatment (e.g., excluding such stocks or using an exact test).
- [Section 3.3] The joint QCNN training and evaluation protocol is underspecified. It is not stated whether the standardization ('subtracting the mean and dividing by the standard deviation') is computed per asset or globally, how training minibatches are composed from the 100 stocks, or whether the single trained network is applied to each stock's test sequence without any asset-specific conditioning. These details determine whether the network can in principle learn asset-specific tail behavior, and they are necessary for reproducing Tables 1–3. Please spell out the protocol and, if relevant, provide code.
minor comments (6)
- [Section 1] The phrase 'slided local receptive fields' should be 'sliding local receptive fields'; there are also typographical spacing errors such as 'V aR' in the abstract.
- [Section 2.2, Eq. (1)] The quantile loss is written with summation subscripts that are hard to parse; use the standard pinball loss ρ_θ(u)=u(θ−1{u<0}) and sum over the batch.
- [Section 3.3] The statement 'The output sequences are the inputs shifted by 1 step' should clarify how the target value for the one-day-ahead VaR forecast is extracted from the output sequence.
- [Section 3.5] The robustness statement that 'the results were quite similar' for 1999–2008 is not accompanied by any numbers; include the corresponding table or remove the claim.
- [Section 3.4] State explicitly why DQ test results are not reported for the 99.9% level; presumably the expected number of exceedances is too small for the asymptotic test.
- [General] No code or data-publication link is provided; for an empirical study of this kind, releasing the implementation would substantially increase confidence in the results.
Circularity Check
No circularity: the QCNN is trained with the quantile loss and evaluated out-of-sample with the Dynamic Quantile test, with no parameter fitted to the test outcome.
full rationale
The paper's claim is empirical, not derivational. The QCNN is trained by minimizing the check loss (Eq. 1) on training returns, and then evaluated one-day-ahead on the last 30% of each series, where Tables 1 to 3 report exceedance rates and Dynamic Quantile test rejection rates. Nothing in the paper fits any constant to the test-set exceedance rates or DQ results; the network weights are optimized to the quantile objective, and the DQ test is an external misspecification test based on the Hit variable (Eqs. 4 to 6). The joint QCNN is a modeling choice motivated, not derived, by the statement that stocks 'have experienced more extreme events, and we may expect them to have similar sources'; even if this tail-homogeneity assumption were false, that would be an empirical robustness concern, not circularity. The paper contains no self-citation chain: all cited methods are external prior work (e.g., CAViaR, WaveNet), and no cited result is equivalent to the paper's conclusion. Thus no claimed prediction reduces to its input by construction.
Assumptions & free parameters
free parameters (1)
- Architecture hyperparameters
assumptions (5)
- standard math Minimizing the quantile loss in Eq. (1) yields the conditional quantile of the target distribution.
- standard math The Dynamic Quantile test statistic in Eq. (6) is asymptotically chi-square distributed.
- domain assumption Daily stock returns across different assets share common tail dynamics that can be learned jointly.
- domain assumption The Kaggle stock dataset accurately represents U.S. stock return behavior for the studied periods.
- domain assumption The fixed hyperparameters are adequate without tuning.
Cite this review
Pith. "Pith review of Quantile Convolutional Neural Networks for Value at Risk Forecasting." pith.science (2026). https://pith.science/paper/OQ7NOG4R
@misc{pith2026190807978,
author = {Pith},
title = {Pith review of: Quantile Convolutional Neural Networks for Value at Risk Forecasting},
year = {2026},
howpublished = {\url{https://pith.science/paper/OQ7NOG4R}},
note = {Machine review of arXiv:1908.07978}
}
read the original abstract
This article presents a new method for forecasting Value at Risk. Convolutional neural networks can do time series forecasting, since they can learn local patterns in time. A simple modification enables them to forecast not the mean, but arbitrary quantiles of the distribution, and thus allows them to be applied to VaR-forecasting. The proposed model can learn from the price history of different assets, and it seems to produce fairly accurate forecasts.
Reference graph
Works this paper leans on
-
[1]
An empirical evaluation of generic convolutional and recurrent networks for sequence modeling
Shaojie Bai, J Zico Kolter, and Vladlen Koltun. An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv preprint arXiv:1803.01271, 2018
arXiv 2018
-
[2]
Conditional time series forecasting with convolutional neural networks
Anastasia Borovykh, Sander Bohte, and Cornelis W Oosterlee. Conditional time series forecasting with convolutional neural networks. arXiv preprint arXiv:1703.04691, 2017
arXiv 2017
-
[3]
Application of quantile regression to estimation of value at risk
Mei-Yuan Chen and Jau-Er Chen. Application of quantile regression to estimation of value at risk. Review of Financial Risk Management, 1 0 (2): 0 15, 2002
work page 2002
-
[4]
Garch 101: The use of arch/garch models in applied econometrics
Robert Engle. Garch 101: The use of arch/garch models in applied econometrics. Journal of economic perspectives, 15 0 (4): 0 157--168, 2001
work page 2001
-
[5]
Caviar: conditional value at risk by quantile regression
Robert F Engle and Simone Manganelli. Caviar: conditional value at risk by quantile regression. Technical report, National Bureau of Economic Research, 1999
work page 1999
-
[6]
Portfolio value-at-risk with heavy-tailed risk factors
Paul Glasserman, Philip Heidelberger, and Perwez Shahabuddin. Portfolio value-at-risk with heavy-tailed risk factors. Mathematical Finance, 12 0 (3): 0 239--269, 2002
work page 2002
-
[7]
Value at risk when daily changes in market variables are not normally distributed
John Hull and Alan White. Value at risk when daily changes in market variables are not normally distributed. Journal of derivatives, 5: 0 9--19, 1998
work page 1998
- [8]
Show all 21 references
-
[9]
Quantile regression
Roger Koenker and Kevin F Hallock. Quantile regression. Journal of economic perspectives, 15 0 (4): 0 143--156, 2001
2001
-
[10]
Quantile autoregression
Roger Koenker and Zhijie Xiao. Quantile autoregression. Journal of the American Statistical Association, 101 0 (475): 0 980--990, 2006
2006
-
[11]
Convolutional networks for images, speech, and time series
Yann LeCun, Yoshua Bengio, et al. Convolutional networks for images, speech, and time series. The handbook of brain theory and neural networks, 3361 0 (10): 0 1995, 1995
1995
-
[12]
Wavenet: A generative model for raw audio
Aaron van den Oord, Sander Dieleman, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alex Graves, Nal Kalchbrenner, Andrew Senior, and Koray Kavukcuoglu. Wavenet: A generative model for raw audio. arXiv preprint arXiv:1609.03499, 2016
2016 arXiv
-
[13]
Risk and liquidity
Hyun Song Shin. Risk and liquidity. Oxford University Press, 2010
2010
-
[14]
A quantile regression neural network approach to estimating the conditional density of multiperiod returns
James W Taylor. A quantile regression neural network approach to estimating the conditional density of multiperiod returns. Journal of Forecasting, 19 0 (4): 0 299--311, 2000
2000
-
[15]
Using exponentially weighted quantile regression to estimate value at risk and expected shortfall
James W Taylor. Using exponentially weighted quantile regression to estimate value at risk and expected shortfall. Journal of financial Econometrics, 6 0 (3): 0 382--406, 2007
2007
-
[16]
Phoneme recognition using time-delay neural networks
Alexander Waibel, Toshiyuki Hanazawa, Geoffrey Hinton, Kiyohiro Shikano, and Kevin J Lang. Phoneme recognition using time-delay neural networks. Backpropagation: Theory, Architectures and Applications, pages 35--61, 1995
1995
-
[17]
Var for var: Measuring tail dependence using multivariate regression quantiles
Halbert White, Tae-Hwan Kim, and Simone Manganelli. Var for var: Measuring tail dependence using multivariate regression quantiles. Journal of Econometrics, 187 0 (1): 0 169--188, 2015
2015
-
[18]
Quantile autoregression neural network model with applications to evaluating value at risk
Qifa Xu, Xi Liu, Cuixia Jiang, and Keming Yu. Quantile autoregression neural network model with applications to evaluating value at risk. Applied Soft Computing, 49: 0 1--12, 2016
2016
-
[19]
Parsimonious quantile regression of financial asset tail dynamics via sequential learning
Xing Yan, Weizhong Zhang, Lin Ma, Wei Liu, and Qi Wu. Parsimonious quantile regression of financial asset tail dynamics via sequential learning. In Advances in Neural Information Processing Systems, pages 1575--1585, 2018
2018
-
[20]
Multi-scale context aggregation by dilated convolutions
Fisher Yu and Vladlen Koltun. Multi-scale context aggregation by dilated convolutions. arXiv preprint arXiv:1511.07122, 2015
2015 arXiv
-
[21]
Adadelta: an adaptive learning rate method
Matthew D Zeiler. Adadelta: an adaptive learning rate method. arXiv preprint arXiv:1212.5701, 2012
2012 arXiv
Reviewed August 14, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.