Pith. sign in

REVIEW 4 major objections 6 minor 21 references

Quantile Convolutional Neural Networks for Value at Risk Forecasting

T0 review · 4 major / 6 minor · reviewed 2026-08-14 · deepseek-v4-flash

Pith's one-line read A convolutional network trained jointly on many stocks' histories can forecast Value at Risk with exceedance rates close to nominal levels, beating constant, GARCH, and linear quantile regression baselines.

desk verdict Joint multi-asset training helps quantile CNNs for VaR, but the evidence is thinner than the conclusion. read the letter →

arxiv 1908.07978 v4 pith:OQ7NOG4R submitted 2019-08-21 cs.LG q-fin.CPstat.ML

classification cs.LGq-fin.CPstat.ML
keywords ValueatRiskquantileregressionconvolutionalneuralnetworkdilatedcausalconvolutiontimeseriesforecastingmulti-assetlearningDynamictesttail
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper proposes a one-dimensional convolutional neural network that forecasts quantiles of daily stock returns directly, rather than forecasting the mean. The network is trained with a quantile (pinball) loss, so its output is an estimate of a Value at Risk level such as the 1% or 5% tail quantile. The central claim is that when the network is trained jointly on the price histories of many stocks, it produces one-day-ahead VaR forecasts with exceedance rates close to the nominal levels and with fewer Dynamic Quantile test rejections than constant, GARCH(1,1), and linear quantile regression baselines. If true, this means that pooling extreme events across assets can make deep quantile forecasting work despite the scarcity of tail data for any single stock, and that the resulting risk budgets are cheaper than those from a historical constant estimate.

What carries the argument

Three components carry the argument. (1) The pinball quantile loss replaces mean squared error so that the network's output is a conditional quantile, i.e., a VaR estimate, without distributional assumptions. (2) The network is a WaveNet-style stack of six causal convolutional layers with eight filters of kernel size 2, ReLU activations, and exponentially increasing dilation rates ($2^{l-1}$), followed by a $1\times 1$ convolution with a linear activation; causal dilated convolutions give an exponential receptive field so the 128-step input window can predict one step ahead. (3) Joint training feeds the overlapping 128-return windows from all 100 stocks into the same network, so the model learns from pooled tail events rather than from a single asset's history. The claim is that these three pieces together produce calibrated one-day-ahead VaR forecasts at 95%, 99%, and 99.9% confidence.

What would settle it

Train the joint QCNN on 100 stocks and evaluate it on a held-out set of stocks from a market or sector that was deliberately absent from training, for example train on US equities and test on European equities. The central claim predicts that exceedance rates stay near nominal and the Dynamic Quantile rejection rate stays low; if instead the rejection rate rises to the level of the single-stock QCNN, the pooling benefit depends on shared tail sources and does not generalize.

Watch

Extended reading notes

Core claim

The discovery is that quantile forecasting with a convolutional neural network works for Value at Risk when the network is trained jointly on multiple assets, and fails when trained on a single asset's history alone. The QCNN is a causal, dilated, one-dimensional convolutional network whose final layer outputs a $\theta$-quantile of the next day's return, optimized with the asymmetric absolute loss $\theta\sum_{y_i \ge \hat q_i}(y_i-\hat q_i) + (\theta-1)\sum_{y_i < \hat q_i}(y_i-\hat q_i)$. In the empirical study on 100 US-listed stocks, the single-stock QCNN overshoots the targeted exceedance rates by up to an order of magnitude, while the joint QCNN trained on all 100 stocks gives mean exceedance rates of 0.0433, 0.0115, and 0.0023 for the 95%, 99%, and 99.9% levels—close to the nominal 0.05, 0.01, and 0.001—and has lower average DQ-test rejection rates (0.05 and 0.16 at the 5% and 1% significance levels for 95% VaR) than all baselines, with lower average VaR values than the constant historical estimate.

Load-bearing premise

The load-bearing premise is that the daily returns of different stocks have similar enough tail behavior—common sources of extreme events—that one network trained on many assets can learn valid quantiles for any single asset; if tails are idiosyncratic, the joint model's calibration could be an artifact of pooling rather than a real transferable property.

Editorial extensions

If this is right

  • If the central claim is correct, VaR can be produced nonparametrically: no normality or t-distribution assumption is needed, because the network learns the empirical tail directly from returns.
  • Joint training is the load-bearing ingredient for deep quantile models: with only one stock's history the same architecture grossly overshoots exceedance rates, so pooling many assets is what makes the data volume sufficient.
  • Better calibration transfers into capital: the joint QCNN's average VaR values are lower than the constant historical estimate's while maintaining similar exceedance rates, meaning a bank or portfolio using it would set aside less capital for the same coverage.
  • The low Dynamic Quantile rejection rates indicate that the joint model's exceedances are not only correctly frequent but also correctly timed—past exceedances and VaR levels have little explanatory power for future hits.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A natural next test the paper does not run: train the joint QCNN on stocks from one sector or market and test on a held-out sector or market; if the calibration holds, the transfer is general, and if it degrades, the benefit depends on the training and test stocks sharing tail sources.
  • The paper's explanation for pooling—'more stocks have experienced more extreme events, and we may expect them to have similar sources'—suggests a data-economy interpretation: the effective sample size for tail estimation is the number of pooled extreme events, not the length of any one series. That interpretation could be tested by varying the number of training assets and observing whether DQ rej
  • The same pinball-loss architecture should apply to expected shortfall by swapping the loss for a coherent tail-loss function, and to intraday or high-frequency returns, though neither is evaluated here.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 6 minor

Summary. This paper proposes a quantile convolutional neural network (QCNN), a one-dimensional dilated causal CNN trained with the pinball loss, for one-day-ahead Value at Risk forecasting. The model is evaluated on daily log returns of 100 randomly selected US stocks over 2009-2018, with the last 30% as test set. The authors compare a per-stock QCNN and a joint QCNN trained on all stocks against a constant quantile estimator, a normal GARCH(1,1), and a linear quantile autoregression. The reported tables show that the joint QCNN yields exceedance rates closer to the nominal 95%, 99%, and 99.9% levels, lower standard deviations of exceedance rates, and lower Dynamic Quantile test rejection rates than all baselines, while the single-stock QCNN is badly miscalibrated. The paper concludes that training on multiple assets improves VaR forecasts.

Significance. The central empirical claim—that the joint QCNN improves quantile calibration relative to standard baselines—is plausible and, if confirmed, practically useful: VaR forecasts that are both accurately calibrated and less conservative than a historical quantile are valuable for risk budgeting. The authors are to be credited for evaluating out-of-sample with a standard backtesting test, for reporting exceedance rates, and for including simple baselines rather than only neural alternatives. However, the statistical support is incomplete: no significance tests, no confidence intervals, and no control experiment separate the effect of larger sample size from the claimed cross-asset tail pooling. The paper is clearly written and the QCNN idea is presented transparently, but the empirical evidence as reported is not yet at the standard needed to support the strong conclusions in Section 3.5.

major comments (4)
  1. [Section 3.5, Tables 1–3] The comparisons are based solely on point estimates (means, medians, standard deviations) with no significance tests or confidence intervals. Because the same 100 stocks are used for every method, paired tests are available; for example, a paired sign test or bootstrap on the per-stock exceedance-rate difference between Joint QCNN and GARCH would directly assess whether the reported gap (0.0433 vs. 0.0347 at the 95% level) is systematic. Likewise, the DQ rejection rates are proportions out of 100 stocks, so binomial confidence intervals should accompany them. Without such measures, the claim in the text that the joint QCNN 'produces the highest quality VaR estimates' is not statistically established.
  2. [Section 3.1 and Section 3.5] The rationale for joint training is that extreme returns across different stocks 'may ... have similar sources,' but this assumption is never tested, and the reported comparison of Joint QCNN with single-stock QCNN conflates cross-asset pooling with a roughly 100-fold increase in training data. The authors should add a control that holds sample size fixed while destroying the cross-asset structure, such as training the same architecture on a random permutation of the returns across the 100 stocks, or on the pooled returns with the asset index removed. If the permuted/pooled model matches Joint QCNN's performance, the improvement is attributable to sample size rather than to shared tail dynamics; otherwise the stated 'similar sources' mechanism receives support. This distinction is load-bearing for the paper's contribution, which is explicitly about learning from multiple assets.
  3. [Section 3.4, Eq. (6) and Tables 1–2] Assigning a p-value of 0 to zero-exceedance forecasts is not part of the Engle-Manganelli Dynamic Quantile test as defined by Eq. (6). When Hit has no variation, the regression in Eq. (5) is degenerate and the chi-square approximation is invalid, so a pre-specified replacement rule can bias the reported rejection rates. The authors should report the frequency of zero-exceedance forecasts for each method, justify the 0-p-value rule, and show that the DQ rejection-rate comparisons are robust to an alternative treatment (e.g., excluding such stocks or using an exact test).
  4. [Section 3.3] The joint QCNN training and evaluation protocol is underspecified. It is not stated whether the standardization ('subtracting the mean and dividing by the standard deviation') is computed per asset or globally, how training minibatches are composed from the 100 stocks, or whether the single trained network is applied to each stock's test sequence without any asset-specific conditioning. These details determine whether the network can in principle learn asset-specific tail behavior, and they are necessary for reproducing Tables 1–3. Please spell out the protocol and, if relevant, provide code.
minor comments (6)
  1. [Section 1] The phrase 'slided local receptive fields' should be 'sliding local receptive fields'; there are also typographical spacing errors such as 'V aR' in the abstract.
  2. [Section 2.2, Eq. (1)] The quantile loss is written with summation subscripts that are hard to parse; use the standard pinball loss ρ_θ(u)=u(θ−1{u<0}) and sum over the batch.
  3. [Section 3.3] The statement 'The output sequences are the inputs shifted by 1 step' should clarify how the target value for the one-day-ahead VaR forecast is extracted from the output sequence.
  4. [Section 3.5] The robustness statement that 'the results were quite similar' for 1999–2008 is not accompanied by any numbers; include the corresponding table or remove the claim.
  5. [Section 3.4] State explicitly why DQ test results are not reported for the 99.9% level; presumably the expected number of exceedances is too small for the asymptotic test.
  6. [General] No code or data-publication link is provided; for an empirical study of this kind, releasing the implementation would substantially increase confidence in the results.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: the QCNN is trained with the quantile loss and evaluated out-of-sample with the Dynamic Quantile test, with no parameter fitted to the test outcome.

full rationale

The paper's claim is empirical, not derivational. The QCNN is trained by minimizing the check loss (Eq. 1) on training returns, and then evaluated one-day-ahead on the last 30% of each series, where Tables 1 to 3 report exceedance rates and Dynamic Quantile test rejection rates. Nothing in the paper fits any constant to the test-set exceedance rates or DQ results; the network weights are optimized to the quantile objective, and the DQ test is an external misspecification test based on the Hit variable (Eqs. 4 to 6). The joint QCNN is a modeling choice motivated, not derived, by the statement that stocks 'have experienced more extreme events, and we may expect them to have similar sources'; even if this tail-homogeneity assumption were false, that would be an empirical robustness concern, not circularity. The paper contains no self-citation chain: all cited methods are external prior work (e.g., CAViaR, WaveNet), and no cited result is equivalent to the paper's conclusion. Thus no claimed prediction reduces to its input by construction.

Assumptions & free parameters 1 free parameters · 5 assumptions · 0 invented entities

The model's trainable weights are estimated by minimizing the quantile loss, which is standard estimation rather than an ad hoc free parameter. The key ad hoc choices are the architecture hyperparameters, which are picked by hand without sensitivity analysis. The central scientific assumption of cross-asset tail similarity is borrowed without independent validation beyond this one experiment. No new physical entities are introduced.

free parameters (1)
  • Architecture hyperparameters
    Number of layers (6), filters per layer (8), kernel size (2), dilation schedule 2^(l-1), input length (128), training epochs (128), batch size (128), and adadelta optimizer are selected by hand without a reported search. The performance of the joint QCNN depends on these choices, and no sensitivity analysis is provided.
assumptions (5)
  • standard math Minimizing the quantile loss in Eq. (1) yields the conditional quantile of the target distribution.
    This is the standard justification for quantile regression, cited via Koenker and Hallock (2001). The paper relies on it to connect the network output to VaR.
  • standard math The Dynamic Quantile test statistic in Eq. (6) is asymptotically chi-square distributed.
    The paper uses the DQ test to validate model calibration. This rests on standard asymptotic theory for regression-based specification tests.
  • domain assumption Daily stock returns across different assets share common tail dynamics that can be learned jointly.
    Section 3.1 states that more stocks provide more extreme events and that similar sources are expected. The joint QCNN result depends on this transferability assumption.
  • domain assumption The Kaggle stock dataset accurately represents U.S. stock return behavior for the studied periods.
    All empirical conclusions rely on the dataset's correctness and representativeness. The paper does not validate the data or the random stock selection beyond a single repeat period.
  • domain assumption The fixed hyperparameters are adequate without tuning.
    The paper reports no hyperparameter search and no seed averaging. The reported results are a single run of a chosen architecture, so the conclusion assumes this run is representative.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Quantile Convolutional Neural Networks for Value at Risk Forecasting." pith.science (2026). https://pith.science/paper/OQ7NOG4R

@misc{pith2026190807978,
  author       = {Pith},
  title        = {Pith review of: Quantile Convolutional Neural Networks for Value at Risk Forecasting},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/OQ7NOG4R}},
  note         = {Machine review of arXiv:1908.07978}
}
read the original abstract

This article presents a new method for forecasting Value at Risk. Convolutional neural networks can do time series forecasting, since they can learn local patterns in time. A simple modification enables them to forecast not the mean, but arbitrary quantiles of the distribution, and thus allows them to be applied to VaR-forecasting. The proposed model can learn from the price history of different assets, and it seems to produce fairly accurate forecasts.

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

21 extracted references · 15 canonical work pages

  1. [1]

    An empirical evaluation of generic convolutional and recurrent networks for sequence modeling

    Shaojie Bai, J Zico Kolter, and Vladlen Koltun. An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv preprint arXiv:1803.01271, 2018

  2. [2]

    Conditional time series forecasting with convolutional neural networks

    Anastasia Borovykh, Sander Bohte, and Cornelis W Oosterlee. Conditional time series forecasting with convolutional neural networks. arXiv preprint arXiv:1703.04691, 2017

  3. [3]

    Application of quantile regression to estimation of value at risk

    Mei-Yuan Chen and Jau-Er Chen. Application of quantile regression to estimation of value at risk. Review of Financial Risk Management, 1 0 (2): 0 15, 2002

  4. [4]

    Garch 101: The use of arch/garch models in applied econometrics

    Robert Engle. Garch 101: The use of arch/garch models in applied econometrics. Journal of economic perspectives, 15 0 (4): 0 157--168, 2001

  5. [5]

    Caviar: conditional value at risk by quantile regression

    Robert F Engle and Simone Manganelli. Caviar: conditional value at risk by quantile regression. Technical report, National Bureau of Economic Research, 1999

  6. [6]

    Portfolio value-at-risk with heavy-tailed risk factors

    Paul Glasserman, Philip Heidelberger, and Perwez Shahabuddin. Portfolio value-at-risk with heavy-tailed risk factors. Mathematical Finance, 12 0 (3): 0 239--269, 2002

  7. [7]

    Value at risk when daily changes in market variables are not normally distributed

    John Hull and Alan White. Value at risk when daily changes in market variables are not normally distributed. Journal of derivatives, 5: 0 9--19, 1998

  8. [8]

    Value at risk

    Philippe Jorion. Value at risk. 2000

Show all 21 references
  1. [9]

    Quantile regression

    Roger Koenker and Kevin F Hallock. Quantile regression. Journal of economic perspectives, 15 0 (4): 0 143--156, 2001

  2. [10]

    Quantile autoregression

    Roger Koenker and Zhijie Xiao. Quantile autoregression. Journal of the American Statistical Association, 101 0 (475): 0 980--990, 2006

  3. [11]

    Convolutional networks for images, speech, and time series

    Yann LeCun, Yoshua Bengio, et al. Convolutional networks for images, speech, and time series. The handbook of brain theory and neural networks, 3361 0 (10): 0 1995, 1995

  4. [12]

    Wavenet: A generative model for raw audio

    Aaron van den Oord, Sander Dieleman, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alex Graves, Nal Kalchbrenner, Andrew Senior, and Koray Kavukcuoglu. Wavenet: A generative model for raw audio. arXiv preprint arXiv:1609.03499, 2016

  5. [13]

    Risk and liquidity

    Hyun Song Shin. Risk and liquidity. Oxford University Press, 2010

  6. [14]

    A quantile regression neural network approach to estimating the conditional density of multiperiod returns

    James W Taylor. A quantile regression neural network approach to estimating the conditional density of multiperiod returns. Journal of Forecasting, 19 0 (4): 0 299--311, 2000

  7. [15]

    Using exponentially weighted quantile regression to estimate value at risk and expected shortfall

    James W Taylor. Using exponentially weighted quantile regression to estimate value at risk and expected shortfall. Journal of financial Econometrics, 6 0 (3): 0 382--406, 2007

  8. [16]

    Phoneme recognition using time-delay neural networks

    Alexander Waibel, Toshiyuki Hanazawa, Geoffrey Hinton, Kiyohiro Shikano, and Kevin J Lang. Phoneme recognition using time-delay neural networks. Backpropagation: Theory, Architectures and Applications, pages 35--61, 1995

  9. [17]

    Var for var: Measuring tail dependence using multivariate regression quantiles

    Halbert White, Tae-Hwan Kim, and Simone Manganelli. Var for var: Measuring tail dependence using multivariate regression quantiles. Journal of Econometrics, 187 0 (1): 0 169--188, 2015

  10. [18]

    Quantile autoregression neural network model with applications to evaluating value at risk

    Qifa Xu, Xi Liu, Cuixia Jiang, and Keming Yu. Quantile autoregression neural network model with applications to evaluating value at risk. Applied Soft Computing, 49: 0 1--12, 2016

  11. [19]

    Parsimonious quantile regression of financial asset tail dynamics via sequential learning

    Xing Yan, Weizhong Zhang, Lin Ma, Wei Liu, and Qi Wu. Parsimonious quantile regression of financial asset tail dynamics via sequential learning. In Advances in Neural Information Processing Systems, pages 1575--1585, 2018

  12. [20]

    Multi-scale context aggregation by dilated convolutions

    Fisher Yu and Vladlen Koltun. Multi-scale context aggregation by dilated convolutions. arXiv preprint arXiv:1511.07122, 2015

  13. [21]

    Adadelta: an adaptive learning rate method

    Matthew D Zeiler. Adadelta: an adaptive learning rate method. arXiv preprint arXiv:1212.5701, 2012

Pith tools

Reviewed August 14, 2026 · model on record in the stance chip above.