Pith. sign in

REVIEW 4 major objections 6 minor 70 references

DELPHYNE: A Pre-Trained Model for General and Financial Time Series

T0 review · 4 major / 6 minor · reviewed 2026-08-15 · deepseek-v4-flash

Pith's one-line read A time-series transformer pre-trained on general and financial data matches foundation and dedicated models after a few fine-tuning steps, and beats them on finance tasks.

desk verdict Negative-transfer study is the real contribution; the Monash aggregate is computed on a biased subset and the abstract overpromises. read the letter →

arxiv 2506.06288 v1 pith:PMAP5GHD submitted 2025-05-12 q-fin.ST cs.AIcs.LG

classification q-fin.STcs.AIcs.LG
keywords time-seriesfoundationmodelsnegativetransferfine-tuningfinancialtimeseriesprobabilisticforecastingany-variateattentionnowcastingmixtureofStudent-tdistributions
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper tries to establish that the value of a pre-trained time-series model lies in fine-tuning, not zero-shot transfer, and that a model pre-trained on general plus financial data can therefore serve both worlds. It documents a negative-transfer effect—mixing financial data into the pre-training corpus degrades zero-shot forecasts on general benchmarks, in synthetic experiments (GARCH versus wavelet generators) and in the full model alike—and proposes Delphyne, an encoder transformer with any-variate attention, a missing-data mask alongside the forecast mask, and a mixture of Student-$t$ output distribution. The paper claims that after a few fine-tuning steps Delphyne becomes competitive with existing foundation and full-shot models on public benchmarks, and that it beats them on financial tasks such as stock-return risk, intraday volume, and company-revenue nowcasting. If correct, this reframes what a time-series foundation model is for: not immediate zero-shot generalization, but fast adaptation from small amounts of task data.

What carries the argument

The central mechanism is an encoder transformer built to tolerate the messiness of financial series: all variates are flattened and given identity embeddings, series are right-padded, split into patches of size 32, and a missing-data mask runs alongside the forecast mask so that irregular sampling, multiple frequencies, and contemporaneous (nowcasting) inputs do not misalign the data. Attention is any-variate attention with rotary position embeddings, and the forecast is a mixture of Student-$t$ distributions. Around this architecture sits the paper's main conceptual mechanism: the demonstration and removal of negative transfer. Using synthetic GARCH-versus-wavelet models, a Bayesian MCMC posterior analysis, and the Delphyne-A versus Delphyne-L comparison, the paper argues that heterogeneous pre-training data degrades zero-shot forecasts, and that fine-tuning is what 'unlearns' that bias—making the fine-tuning protocol, not the zero-shot prior, the load-bearing part of the system.

What would settle it

Re-run the Monash fine-tuning evaluation with validation and hyperparameter selection confined to the training split of each dataset (or to a time-based split that never touches the test horizon), and check whether Delphyne-A-FT still posts an aggregate normalized MAE near 0.536 and still rivals MOIRAI; if the clean-protocol numbers degrade materially, the 'competitive after few fine-tuning steps' claim loses its support. A supporting check is to replicate the financial tasks on years after 2023, well beyond the end-2019 pre-training cutoff, to test whether fine-tuned finance gains persist under drift.

Watch

Extended reading notes

Core claim

On the paper's own terms, the central claim is that pre-training a time-series transformer jointly on the public LOTSA corpus and on financial data—stocks, ETFs, currencies, commodities, and intraday bars—produces a model whose zero-shot performance on general tasks is worse than that of a model trained on LOTSA alone, yet whose fine-tuned performance matches or beats the best available baselines. Delphyne-A (LOTSA plus finance) shows higher zero-shot MAE than Delphyne-L (LOTSA only) on ETTh2 and on the Monash archive, but after fine-tuning the two converge, and Delphyne-A-FT posts the best numbers on the financial tasks: next-day stock-return risk likelihood (NLL 1.741), 78-step intraday bar-volume error (MSE 0.551), and nowcast MAE of 0.071 on company revenue growth, with quantile-coverage statistics close to optimal. The paper reads these results as evidence that the negative transfer induced by heterogeneous pre-training data is real and inherent—confirmed by GARCH-versus-wavelet synthetic models and a Bayesian MCMC posterior analysis—and that fine-tuning is the mechanism that 'unlearns' the pre-training bias.

Load-bearing premise

The load-bearing premise is the Monash fine-tuning protocol: validation for early stopping and hyperparameter selection is carved out of the same hold-out test horizon that later produces the reported scores, so if that protocol leaks test information, the fine-tuned gains on public benchmarks—including the aggregate 0.536 normalized MAE—are optimistic.

Editorial extensions

If this is right

  • A single pre-trained model covering general plus financial data can serve both worlds: after a short fine-tuning phase it reaches an aggregate 0.536 normalized MAE on the Monash archive and rivals the best foundation model on several datasets.
  • On financial tasks, fine-tuning delivers the wins: Delphyne beats the Student-$t$ GARCH baseline in next-day return likelihood, the fine-tuned Delphyne variants post the best errors on intraday bar volume and company-revenue nowcasting, and coverage statistics sit close to optimal.
  • Zero-shot results systematically understate a model trained on heterogeneous data, so evaluations of time-series foundation models should report fine-tuned performance; the negative-transfer penalty is a property of the data mixture, not a failure of the architecture.
  • Pre-training choices such as longer context lengths and lighter masking ratios improve downstream few-shot adaptation, so these hyperparameters should be selected with the fine-tuning regime in mind.
  • The same fine-tuned model also handles probabilistic forecasting (CRPS/MSIS) and anomaly detection, indicating that one foundation model can cover forecasting, uncertainty quantification, and monitoring after light adaptation.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A testable extension the paper leaves open: give the finance-only model (Delphyne-F) a much larger fine-tuning budget on financial tasks and check whether the general-domain prior in Delphyne-A eventually becomes irrelevant or actively harmful, which would sharpen the question of which pre-training data actually pays for itself.
  • The missing-data mask suggests an imputation use the paper does not develop: evaluate Delphyne on genuinely irregular calendars (holidays, half-days, multi-frequency lags) where left-padding and zero-filling baselines should degrade, and measure whether the mask preserves forecast calibration.
  • Because the financial pre-training data stops at end-2019, the reported finance results cover 2020-2023; a natural stress test is whether the fine-tuned advantage survives rolling windows after 2023, when the pre-training distribution is older.
  • The negative-transfer diagnostic could be repurposed: a practitioner facing a new domain could read zero-shot degradation as a cheap signal of domain mismatch, and use its size to decide how much fine-tuning data to collect.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 6 minor

Summary. The paper introduces Delphyne, an encoder-only transformer pretrained on the LOTSA public corpus and on proprietary financial data, with any-variate attention, missing-data and forecast masks, and a mixture-of-Student-T output distribution. The authors document a negative transfer effect when financial and non-financial data are mixed, argue that fine-tuning is the remedy, and evaluate Delphyne on Monash short-term forecasting, long-horizon out-of-distribution forecasting, probabilistic forecasting, anomaly detection, and four financial tasks (stock risk, volatility, intraday bars, and company nowcasting). The central claim is that Delphyne is competitive with existing foundation and full-shot models after few fine-tuning steps on public benchmarks and superior on financial tasks.

Significance. If the claims are supported, the paper would make a meaningful contribution: it provides evidence that a time-series foundation model can incorporate proprietary financial data and recover from negative transfer through fine-tuning, and it gives a systematic study of design choices (masking, context length, variate handling, output distribution). Strengths of the paper include clean temporal separations in the financial experiments (pretraining data end in 2019 while evaluation windows start in 2021), consistent fine-tuning gains across most benchmarks, and a thorough ablation suite on synthetic data. The main weaknesses are that several headline comparisons are not computed on matched data subsets, the 'few fine-tuning steps' claim is not quantified, and some broad performance claims are contradicted by the paper's own tables. These issues are fixable but currently overstate the evidence.

major comments (4)
  1. [Sec. 5.2, Tables 16-17] The headline Monash comparison is computed on unmatched dataset subsets. Table 17 has no fine-tuned entries for M1 Monthly, M3 Monthly, M3 Other, Tourism Quarterly, CIF 2016, Vehicle Trips, Carparts, and Hospital, so the Delphyne-A-FT aggregate 0.536 is a geometric mean over the remaining datasets, whereas the MOIRAI 0.58 aggregate in Table 16 covers all 28 datasets. On several of the excluded datasets Delphyne-A-ZS is much worse than MOIRAI (e.g., Sunspot 3.51 vs. 0.08; Pedestrian Counts 52.99 vs. 23.17), so dropping them can only improve Delphyne's aggregate. The sentence in Sec. 5.2 that fine-tuned Delphyne is 'rivaling the best model, MOIRAI' is not supported by the current tables; please report a matched-subset comparison and state the number of datasets in each aggregate.
  2. [Abstract and Sec. 2] The claim of adaptation with 'few fine-tuning steps' and 'minimal iterations' is never quantified. Sec. 5.2 reports only that early stopping is used, Fig. 2's x-axis is pre-training steps, and no experiment reports the number of gradient updates, epochs, or wall-clock time for fine-tuning the main models. Without this information, the 'few fine-tuning steps' qualifier in the abstract is unsupported. Please report fine-tuning cost (e.g., steps or epochs) for the Monash, long-horizon, and financial experiments, or remove the qualifier.
  3. [Sec. 5.4 and Table 12] The probabilistic-forecasting claim is broader than the evidence. After fine-tuning, Delphyne-A's CRPS on Electricity is 0.140, compared with 0.048-0.065 for full-shot baselines and 0.055 for MOIRAI zero-shot; on Solar the fine-tuned CRPS is 1.306, compared with 0.420-0.518 for baselines and 0.419 for MOIRAI zero-shot. The statement that fine-tuned Delphyne 'achieves the best results across various datasets' is inaccurate for these datasets. Please restrict the claim to the datasets where it holds, or add a discussion of why fine-tuning does not close the gap on Electricity and Solar.
  4. [Sec. 5.1 and Appendix B.2] The financial evaluations are performed on proprietary data of the same types that appear in Delphyne's pretraining corpus (company consumer transactions, intraday bars, stock returns, and related fields). While the temporal split is clean (pretraining ends in 2019 and evaluation starts in 2021), the 'superior performances on various financial tasks' claim is an in-domain result; the comparison methods (MOIRAI, MOMENT, TTM, PatchTST) did not have access to this proprietary pretraining data, so the comparison is not controlled for pretraining data. Please state this limitation explicitly and, if possible, add an external financial benchmark that is not part of the pretraining corpus.
minor comments (6)
  1. [Table 10 caption] The caption says 'MSE results' but the table reports MAE; please correct the caption.
  2. [Appendix J, Table 29] MOIRAI is cited as (Wang et al., 2024a), but the correct reference is Woo et al. (2024); the current citation points to a graph negative-transfer paper.
  3. [Table 1] The blank entries in Table 1 should be marked as not applicable rather than left empty, to avoid ambiguity about whether the measurement was not performed.
  4. [Table 6] The sampling probabilities for LOTSA sum to approximately 85.1 and those for finance to approximately 14.2, not the stated 85 and 15; please reconcile the rounding.
  5. [Sec. 5.2] The sentence 'We partition out the same forecast length as the test set, used as validation data for finetuning the model' can be misread as using test data for validation; please clarify that the validation set is carved from the training split.
  6. [Fig. 2] The x-axis of Fig. 2 is described as training steps but the axis label is missing; please add a label and, if possible, indicate the fine-tuning step count on the same axis.

Circularity Check

0 steps flagged · score 0.0 of 10

No circular derivation found; the Monash aggregate-subset mismatch is a benchmark fairness concern, not a circularity.

full rationale

The paper's chain of reasoning is empirical rather than derivational: the pretraining objective in Eq. (2) is a standard NLL forecasting loss, the negative-transfer demonstrations are synthetic-data experiments, and the general-benchmark evaluations use held-out test splits. No prediction or claimed result is defined in terms of its own input. The Monash validation split described in Sec. 5.2 partitions out a validation horizon from the training split, not the test set, so there is no leakage that would make the fine-tuned results forced by construction. The finance evaluations are partly in-distribution because Delphyne-A is pretrained on the same families of proprietary financial data (stocks, intraday bars, consumer transactions) that appear in the downstream tasks, but this limits external validity rather than making the result circular. The selection of the mixture-of-Student-t output distribution is an ablation-driven model choice, not a fitted parameter renamed as a prediction, and the self-citations (e.g., Gopal 2024) are contextual and not load-bearing. The comparison of Delphyne-A-FT's subset-based Monash aggregate (0.536 in Table 17) against MOIRAI's full-benchmark aggregate (0.58 in Table 16) is an unmatched-subset comparison that weakens the 'rivaling MOIRAI' claim, but it is a fairness and reporting issue, not a reduction of the result to its inputs. No circular step can be exhibited from the paper's equations or cited chain.

Assumptions & free parameters 5 free parameters · 5 assumptions · 0 invented entities

Delphyne is a trained model, not a postulated physical entity; the masking mechanisms are methodological constructs, not entities requiring independent evidence. The free parameters listed are hand-chosen training and architecture constants that the central empirical claim depends on.

free parameters (5)
  • pretraining data mixture = 85% LOTSA / 15% financial
    Chosen by the authors; determines how much financial signal enters pretraining and is central to the finance-versus-general tradeoff.
  • variate sampling beta-binomial = alpha=2, beta=5
    Controls how many variates appear per training sample; affects multivariate and nowcasting behavior.
  • masking beta-binomial = alpha=5, beta=10 (mean about 30%)
    Mask ratio is a tuned pretraining hyperparameter; ablations in Sec. 3.2 motivate moderate masking.
  • patch size = 32
    Fixed patch length for tokenization; affects forecast resolution and context coverage.
  • context length = 512 x 32 timesteps
    Truncation length used in pretraining; chosen to support long financial histories.
assumptions (5)
  • domain assumption Diverse pretraining on LOTSA plus proprietary financial data yields transferable time-series representations.
    Foundational premise of the method; the paper's own negative-transfer results show cross-domain pretraining can hurt, so this assumption is not guaranteed.
  • domain assumption Negative transfer observed in synthetic wavelet and GARCH experiments transfers to real financial pretraining.
    Sec. 2 generalizes from synthetic data and one ETTh2 checkpoint comparison to the full Delphyne design.
  • domain assumption Mixture of Student-T distributions is adequate as the output family for all downstream tasks.
    Ablation in Sec. 3.4 uses stock NLL only; adequacy on other datasets is assumed.
  • ad hoc to paper The Monash test horizon can be used as a validation set for fine-tuning without biasing results.
    Sec. 5.2 states the test set partition is used as validation; this is a protocol assumption that affects the general fine-tuning claim.
  • domain assumption Proprietary financial data cutoff at end-2019 prevents lookahead leakage into evaluations after 2020.
    Sec. 4.1 states the cutoff; the paper provides no data lineage audit or external verification.

how reviews work

0 comments
Cite this review

Pith. "Pith review of DELPHYNE: A Pre-Trained Model for General and Financial Time Series." pith.science (2026). https://pith.science/paper/PMAP5GHD

@misc{pith2026250606288,
  author       = {Pith},
  title        = {Pith review of: DELPHYNE: A Pre-Trained Model for General and Financial Time Series},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/PMAP5GHD}},
  note         = {Machine review of arXiv:2506.06288}
}
read the original abstract

Time-series data is a vital modality within data science communities. This is particularly valuable in financial applications, where it helps in detecting patterns, understanding market behavior, and making informed decisions based on historical data. Recent advances in language modeling have led to the rise of time-series pre-trained models that are trained on vast collections of datasets and applied to diverse tasks across financial domains. However, across financial applications, existing time-series pre-trained models have not shown boosts in performance over simple finance benchmarks in both zero-shot and fine-tuning settings. This phenomenon occurs because of a i) lack of financial data within the pre-training stage, and ii) the negative transfer effect due to inherently different time-series patterns across domains. Furthermore, time-series data is continuous, noisy, and can be collected at varying frequencies and with varying lags across different variables, making this data more challenging to model than languages. To address the above problems, we introduce a Pre-trained MoDEL for FINance TimE-series (Delphyne). Delphyne achieves competitive performance to existing foundation and full-shot models with few fine-tuning steps on publicly available datasets, and also shows superior performances on various financial tasks.

Figures

Figures reproduced from arXiv: 2506.06288 by the authors.

Figure 1
Figure 1. (Left) Wavelet Function. (Right) GARCH-style data [PITH_FULL_IMAGE:figures/full_fig_p003_1.png] view at source ↗
Figure 2
Figure 2. MAE on ETTh2 across (average forecast length of {96, 192}) train￾ing. Finance data hurts zero-shot (ZS) performance of Delphyne-A on ETTh2, but finetune (FT) eventually “undoes” the effect. Given the negative transfer phenomenon, why do we need to build a pre-trained time-series model? The strength of a pre-trained time￾series model lies in its ability to quickly adapt to downstream tasks with finetuning on only a f… view at source ↗
Figure 3
Figure 3. Delphyne Overview 3.1 OVERALL ARCHITECTURE Following recent approaches (Woo et al., 2024; Goswami et al., 2024), we adopt a transformer encoder structure as the backbone of Delphyne [PITH_FULL_IMAGE:figures/full_fig_p005_3.png] view at source ↗
Figures from the paper (7 more)
Figure 4
Figure 4. Figure 4: Stock NLL perfor￾mance on three different out￾put distributions. We include both publicly available data and financial data in Del￾phyne’s training, allowing Delphyne to generalize well to daily time-series forecast tasks as well as financial time-series tasks. We give…
Figure 6
Figure 6. Figure 6: Aggregated geometric mean of normalized MAEs for Delphyne zero-shot (ZS) and fine￾tuned(FT) models. 9 [PITH_FULL_IMAGE:figures/full_fig_p009_6.png]
Figure 7
Figure 7. Figure 7: Aggregated Ad￾justed F1 Score for Delphyne￾A vs. comparison baselines. We measure adjusted F1 score for the anomaly detection task, on 44 time-series datasets for the UCR anomaly detection archive, in comparison to popular full-shot models and foundation model MO￾MENT …
Figure 8
Figure 8. Figure 8: Visualization of fine-tuned forecasts from [PITH_FULL_IMAGE:figures/full_fig_p030_8.png]
Figure 9
Figure 9. Figure 9: Visualization of fine-tuned fore￾casts from Delphyne-A on Stock Variance dataset. Note that since sometimes the squared returns are very large, we clip the plot but not the data during training and eval￾uation. Stock 1 Stock 2 Stock 3 Stock 4 [PITH_FULL_IMAGE:figures/…
Figure 11
Figure 11. Figure 11: Visualization of fine-tuned fore￾casts from Delphyne-A on Nowcasting Com￾pany Revenue dataset. Series 1 Series 2 Series 3 Series 4 [PITH_FULL_IMAGE:figures/full_fig_p032_11.png]
Figure 13
Figure 13. Figure 13: Visualization of fine-tuned fore￾casts from MOMENT on Financial Bars dataset. Series 3 Series 2 Series 1 Series 4 [PITH_FULL_IMAGE:figures/full_fig_p033_13.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

70 extracted references · 39 canonical work pages

  1. [1]

    Maddix, Syama Rangapuram, David Salinas, Jasper Schulz, Lorenzo Stella, Ali Caner T \"u rkmen, and Yuyang Wang

    Alexander Alexandrov, Konstantinos Benidis, Michael Bohlke-Schneider, Valentin Flunkert, Jan Gasthaus, Tim Januschowski, Danielle C. Maddix, Syama Rangapuram, David Salinas, Jasper Schulz, Lorenzo Stella, Ali Caner T \"u rkmen, and Yuyang Wang. Gluon TS : Probabilistic and Neural Time Series Modeling in P ython . Journal of Machine Learning Research, 21 0...

  2. [2]

    Maddix, Hao Wang, Michael W

    Abdul Fatir Ansari, Lorenzo Stella, Caner Turkmen, Xiyuan Zhang, Pedro Mercado, Huibin Shen, Oleksandr Shchur, Syama Syndar Rangapuram, Sebastian Pineda Arango, Shubham Kapoor, Jasper Zschiegner, Danielle C. Maddix, Hao Wang, Michael W. Mahoney, Kari Torkkola, Andrew Gordon Wilson, Michael Bohlke-Schneider, and Yuyang Wang. Chronos: Learning the Language ...

  3. [3]

    Machine Learning Methods for Inflation Forecasting in B razil: New Contenders versus Classical Models

    Gustavo Silva Araujo and Wagner Piazza Gaglianone. Machine Learning Methods for Inflation Forecasting in B razil: New Contenders versus Classical Models . Latin American Journal of Central Banking, 4 0 (2): 0 100087, 2023. doi:10.1016/j.latcb.2023.100087

  4. [4]

    Assimakopoulos and K

    V. Assimakopoulos and K. Nikolopoulos. The T heta Model: A Decomposition Approach to Forecasting . International Journal of Forecasting, 16 0 (4): 0 521--530, 2000. doi:10.1016/S0169-2070(00)00066-2

  5. [5]

    Generalized Autoregressive Conditional Heteroskedasticity , journal = Journal of Econometrics

    Tim Bollerslev. Generalized Autoregressive Conditional Heteroskedasticity , journal = Journal of Econometrics . 31 0 (3): 0 307--327, 1986. doi:10.1016/0304-4076(86)90063-1

  6. [6]

    David Campos, Miao Zhang, Bin Yang, Tung Kieu, Chenjuan Guo, and Christian S. Jensen. LightTS: Lightweight Time Series Classification with Adaptive Ensemble Distillation . Proc. ACM Manag. Data , 1 0 (2): 0 171:1--171:27, 2023. doi:10.1145/3589316

  7. [7]

    Llm4ts: Two-stage fine-tuning for time-series forecasting with pre-trained llms

    Ching Chang, Wen-Chih Peng, and Tien-Fu Chen. Llm4ts: Two-stage fine-tuning for time-series forecasting with pre-trained llms. arXiv preprint arXiv:2308.08469, 2023

  8. [8]

    C hat GPT Informed Graph Neural Network for Stock Movement Prediction

    Zihan Chen, Lei Zheng, Cheng Lu, Jialu Yuan, and Di Zhu. C hat GPT Informed Graph Neural Network for Stock Movement Prediction . SSRN Electronic Journal, 2023. doi:10.2139/ssrn.4464002

Show all 70 references
  1. [9]

    A decoder-only foundation model for time-series forecasting

    Abhimanyu Das, Weihao Kong, Rajat Sen, and Yichen Zhou. A decoder-only foundation model for time-series forecasting . In Ruslan Salakhutdinov, Zico Kolter, Katherine Heller, Adrian Weller, Nuria Oliver, Jonathan Scarlett, and Felix Berkenkamp (eds.), Proceedings of the 41st In...

  2. [10]

    Cat B oost: G radient Boosting with Categorical Features Support

    Anna Veronika Dorogush, Vasily Ershov, and Andrey Gulin. Cat B oost: G radient Boosting with Categorical Features Support . CoRR, abs/1810.11363, 2018. URL http://arxiv.org/abs/1810.11363

  3. [11]

    Nguyen, Wesley M

    Vijay Ekambaram, Arindam Jati, Pankaj Dayama, Sumanta Mukherjee, Nam H. Nguyen, Wesley M. Gifford, Chandra Reddy, and Jayant Kalagnanam. Tiny Time Mixers ( TTM s): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Series , 2024. URL https://ar...

  4. [12]

    Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning

    Stefan Elfwing, Eiji Uchibe, and Kenji Doya. Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning . Neural Networks (Special issue on reinforcement learning) , 107: 0 3--11, 2018. doi:10.1016/j.neunet.2017.12.012

  5. [13]

    BuildingsBench: A Large-Scale Dataset of 900K Buildings and Benchmark for Short-Term Load Forecasting

    Patrick Emami, Abhijeet Sahu, and Peter Graf. BuildingsBench: A Large-Scale Dataset of 900K Buildings and Benchmark for Short-Term Load Forecasting . In Thirty-seventh Conference on Neural Information Processing Systems Datasets and Benchmarks Track, 2023. URL https://openrevi...

  6. [14]

    Dish- TS : A General Paradigm for Alleviating Distribution Shift in Time Series Forecasting

    Wei Fan, Pengyang Wang, Dongkun Wang, Dongjie Wang, Yuanchun Zhou, and Yanjie Fu. Dish- TS : A General Paradigm for Alleviating Distribution Shift in Time Series Forecasting . In Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence and Thirty-Fifth Conf...

  7. [15]

    Timegpt-1

    Azul Garza and Max Mergenthaler-Canseco. Timegpt-1. arXiv preprint arXiv:2310.03589, 2023

  8. [16]

    Strictly Proper Scoring Rules, Prediction, and Estimation

    Tilmann Gneiting and Adrian E Raftery. Strictly Proper Scoring Rules, Prediction, and Estimation . Journal of the American Statistical Association, 102 0 (477): 0 359--378, 2007

  9. [17]

    R. W. Godahewa, C. Bergmeir, G. I. Webb, R. Hyndman, and P. Montero-Manso. Monash Time Series Forecasting Archive . In Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 2), 2021. URL https://openreview.net/forum?id=wEc1mgAjU-

  10. [18]

    Neuralfactors: A novel factor learning approach to generative modeling of equities

    Achintya Gopal. Neuralfactors: A novel factor learning approach to generative modeling of equities. In Proceedings of the 5th ACM International Conference on AI in Finance, pp.\ 99--107, 2024

  11. [19]

    Unsupervised Model Selection for Time Series Anomaly Detection

    Mononito Goswami, Cristian Ignacio Challu, Laurent Callot, Lenon Minorics, and Andrey Kan. Unsupervised Model Selection for Time Series Anomaly Detection . In The Eleventh International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=gOZ_pKANaPW

  12. [20]

    MOMENT: A Family of Open Time-series Foundation Models , 2024

    Mononito Goswami, Konrad Szafer, Arjun Choudhry, Yifu Cai, Shuo Li, and Artur Dubrawski. MOMENT: A Family of Open Time-series Foundation Models , 2024. URL https://arxiv.org/abs/2402.03885

  13. [21]

    Large Language Models Are Zero-Shot Time Series Forecasters

    Nate Gruver, Marc Finzi, Shikai Qiu, and Andrew G Wilson. Large Language Models Are Zero-Shot Time Series Forecasters . In A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine (eds.), Advances in N eural I nformation P rocessing S ystems , volume 36, pp.\ 19622-...

  14. [22]

    Masked Autoencoders Are Scalable Vision Learners

    Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dollár, and Ross Girshick. Masked Autoencoders Are Scalable Vision Learners . In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp.\ 15979--15988, 2022. doi:10.1109/CVPR52688.2022.01553

  15. [23]

    Hoffman and Andrew Gelman

    Matthew D. Hoffman and Andrew Gelman. The No-U-Turn Sampler: Adaptively Setting Path Lengths in H amiltonian M onte C arlo . Journal of Machine Learning Research , 15 0 (47): 0 1593--1623, 2014. URL http://jmlr.org/papers/v15/hoffman14a.html

  16. [24]

    Tab PFN : A Transformer That Solves Small Tabular Classification Problems in a Second

    Noah Hollmann, Samuel M \"u ller, Katharina Eggensperger, and Frank Hutter. Tab PFN : A Transformer That Solves Small Tabular Classification Problems in a Second . In The Eleventh International Conference on Learning Representations , 2023. URL https://openreview.net/forum?id=...

  17. [25]

    Deep learning volatility

    Blanka Horvath, Aitor Muguruza, and Mehdi Tomas. Deep learning volatility. arXiv preprint arXiv:1901.09647, 2019

  18. [26]

    Errors on Percentage Errors , 4 2014

    Rob J Hyndman. Errors on Percentage Errors , 4 2014. URL https://robjhyndman.com/hyndsight/smape/

  19. [27]

    Another Look at Measures of Forecast Accuracy

    Rob J Hyndman and Anne B Koehler. Another Look at Measures of Forecast Accuracy . International Journal of Forecasting, 22 0 (4): 0 679--688, 2006

  20. [28]

    Zhang, Xiaoming Shi, Pin-Yu Chen, Yuxuan Liang, Yuan-Fang Li, Shirui Pan, and Qingsong Wen

    Ming Jin, Shiyu Wang, Lintao Ma, Zhixuan Chu, James Y. Zhang, Xiaoming Shi, Pin-Yu Chen, Yuxuan Liang, Yuan-Fang Li, Shirui Pan, and Qingsong Wen. Time- LLM : Time Series Forecasting by Reprogramming Large Language Models . In The Twelfth International Conference on Learning R...

  21. [29]

    A study of bfloat16 for deep learning training

    Dhiraj Kalamkar, Dheevatsa Mudigere, Naveen Mellempudi, Dipankar Das, Kunal Banerjee, Sasikanth Avancha, Dharma Teja Vooturi, Nataraj Jammalamadaka, Jianyu Huang, Hector Yuen, et al. A study of bfloat16 for deep learning training. arXiv preprint arXiv:1905.12322, 2019

  22. [30]

    Reversible Instance Normalization for Accurate Time-Series Forecasting against Distribution Shift

    Taesung Kim, Jinhee Kim, Yunwon Tae, Cheonbok Park, Jang-Ho Choi, and Jaegul Choo. Reversible Instance Normalization for Accurate Time-Series Forecasting against Distribution Shift . In International Conference on Learning Representations , 2022. URL https://openreview.net/for...

  23. [31]

    Aditya Prakash

    Haoxin Liu, Harshavardhan Kamarthi, Lingkai Kong, Zhiyuan Zhao, Chao Zhang, and B. Aditya Prakash. Time-series forecasting for out-of-distribution generalization using invariant learning. In Forty-first International Conference on Machine Learning, 2024 a . URL https://openrev...

  24. [32]

    Sasanur, Megha Sharma, Jiaming Cui, Qingsong Wen, Chao Zhang, and B

    Haoxin Liu, Shangqing Xu, Zhiyuan Zhao, Lingkai Kong, Harshavardhan Kamarthi, Aditya B. Sasanur, Megha Sharma, Jiaming Cui, Qingsong Wen, Chao Zhang, and B. Aditya Prakash. Time- MMD : Multi-domain multimodal dataset for time series analysis. In The Thirty-eight Conference on ...

  25. [33]

    Lstprompt: Large language models as zero-shot time series forecasters by long-short-term prompting

    Haoxin Liu, Zhiyuan Zhao, Jindong Wang, Harshavardhan Kamarthi, and B Aditya Prakash. Lstprompt: Large language models as zero-shot time series forecasters by long-short-term prompting. arXiv preprint arXiv:2402.16132, 2024 c

  26. [34]

    Large ST : A Benchmark Dataset for Large-Scale Traffic Forecasting

    Xu Liu, Yutong Xia, Yuxuan Liang, Junfeng Hu, Yiwei Wang, LEI BAI, Chao Huang, Zhenguang Liu, Bryan Hooi, and Roger Zimmermann. Large ST : A Benchmark Dataset for Large-Scale Traffic Forecasting . In Thirty-seventh Conference on Neural Information Processing Systems Datasets a...

  27. [35]

    iTransformer: Inverted Transformers Are Effective for Time Series Forecasting

    Yong Liu, Tengge Hu, Haoran Zhang, Haixu Wu, Shiyu Wang, Lintao Ma, and Mingsheng Long. iTransformer: Inverted Transformers Are Effective for Time Series Forecasting . In The Twelfth International Conference on Learning Representations, 2024 d . URL https://openreview.net/foru...

  28. [36]

    Neuralbeta: Estimating beta using deep learning

    Yuxin Liu, Jimin Lin, and Achintya Gopal. Neuralbeta: Estimating beta using deep learning. arXiv preprint arXiv:2408.01387, 2024 e

  29. [37]

    Can chatgpt forecast stock price movements? return predictability and large language models

    Alejandro Lopez-Lira and Yuehua Tang. Can chatgpt forecast stock price movements? return predictability and large language models. arXiv preprint arXiv:2304.07619, 2023

  30. [38]

    The M4 Competition: 100,000 time series and 61 forecasting methods

    Spyros Makridakis, Evangelos Spiliotis, and Vassilios Assimakopoulos. The M4 Competition: 100,000 time series and 61 forecasting methods . International Journal of Forecasting, 36 0 (1): 0 54--74, 2020

  31. [39]

    Position: Graph Foundation Models Are Already Here

    Haitao Mao, Zhikai Chen, Wenzhuo Tang, Jianan Zhao, Yao Ma, Tong Zhao, Neil Shah, Mikhail Galkin, and Jiliang Tang. Position: Graph Foundation Models Are Already Here . In Ruslan Salakhutdinov, Zico Kolter, Katherine Heller, Adrian Weller, Nuria Oliver, Jonathan Scarlett, and ...

  32. [40]

    Mouatadid, P

    S. Mouatadid, P. Orenstein, G. E. Flaspohler, M. Oprescu, J. Cohen, F. Wang, S. E. Knight, M. Geogdzhayeva, S. J. Levang, E. Fraenkel, and L. Mackey. SubseasonalclimateUSA: A Dataset for Subseasonal Forecasting and Benchmarking . In Thirty-seventh Conference on Neural Informat...

  33. [41]

    Transformers Can Do B ayesian I nference

    Samuel M \"u ller, Noah Hollmann, Sebastian Pineda Arango, Josif Grabocka, and Frank Hutter. Transformers Can Do B ayesian I nference . In International Conference on Learning Representations , 2022. URL https://openreview.net/forum?id=KSugKcbNf9

  34. [42]

    A Time Series is Worth 64 Words: Long-term Forecasting with Transformers

    Yuqi Nie, Nam H Nguyen, Phanwadee Sinthong, and Jayant Kalagnanam. A Time Series is Worth 64 Words: Long-term Forecasting with Transformers . In The Eleventh International Conference on Learning Representations , 2023. URL https://openreview.net/forum?id=Jbdc0vTOcol

  35. [43]

    Oreshkin, Dmitri Carpov, Nicolas Chapados, and Yoshua Bengio

    Boris N. Oreshkin, Dmitri Carpov, Nicolas Chapados, and Yoshua Bengio. N-BEATS: Neural Basis Expansion Analysis for Interpretable Time Series Forecasting . In International Conference on Learning Representations, 2020. URL https://openreview.net/forum?id=r1ecqn4YwB

  36. [44]

    Learning Quantile Functions without Quantile Crossing for Distribution-Free Time Series Forecasting

    Youngsuk Park, Danielle Maddix, Fran c ois-Xavier Aubet, Kelvin Kan, Jan Gasthaus, and Yuyang Wang. Learning Quantile Functions without Quantile Crossing for Distribution-Free Time Series Forecasting . In International Conference on Artificial Intelligence and Statistics, pp.\...

  37. [45]

    Deep Learning for Volatility Forecasting in Asset Management

    Alessio Petrozziello, Luigi Troiano, Angela Serra, Ivan Jordanov, Giuseppe Storti, Roberto Tagliaferri, and Michele La Rocca. Deep Learning for Volatility Forecasting in Asset Management . Soft Computing, 26 0 (17): 0 8553--8574, 2022. doi:10.1007/s00500-022-07161-1

  38. [46]

    Lag- L lama: Towards Foundation Models for Time Series Forecasting

    Kashif Rasul, Arjun Ashok, Andrew Robert Williams, Arian Khorasani, George Adamopoulos, Rishika Bhagwatkar, Marin Bilo s , Hena Ghonia, Nadhir Hassen, Anderson Schneider, Sahil Garg, Alexandre Drouin, Nicolas Chapados, Yuriy Nevmyvaka, and Irina Rish. Lag- L lama: Towards Foun...

  39. [48]

    DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networks

    David Salinas, Valentin Flunkert, Jan Gasthaus, and Tim Januschowski. DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networks . International Journal of Forecasting, 36 0 (3): 0 1181--1191, 2020 b . doi:10.1016/j.ijforecast.2019.07.001

  40. [49]

    Glu variants improve transformer

    Noam Shazeer. Glu variants improve transformer. arXiv preprint arXiv:2002.05202, 2020

  41. [50]

    RoFormer: Enhanced transformer with Rotary Position Embedding

    Jianlin Su, Murtadha Ahmed, Yu Lu, Shengfeng Pan, Wen Bo, and Yunfeng Liu. RoFormer: Enhanced transformer with Rotary Position Embedding . Neurocomput., 568 0 (C), March 2024. doi:10.1016/j.neucom.2023.127063

  42. [51]

    Generative Machine Learning for Multivariate Equity Returns

    Ruslan Tepelyan and Achintya Gopal. Generative Machine Learning for Multivariate Equity Returns . In Proceedings of the Fourth ACM International Conference on AI in Finance, ICAIF '23, pp.\ 159–166, New York, NY, USA, 2023. Association for Computing Machinery. doi:10.1145/3604...

  43. [52]

    ElectricityLoadDiagrams20112014

    Artur Trindade. ElectricityLoadDiagrams20112014 . UCI Machine Learning Repository, 2015

  44. [53]

    Senior, and Koray Kavukcuoglu

    A \" a ron van den Oord, Sander Dieleman, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alex Graves, Nal Kalchbrenner, Andrew W. Senior, and Koray Kavukcuoglu. WaveNet: A Generative Model for Raw Audio . CoRR, abs/1609.03499, 2016. URL http://arxiv.org/abs/1609.03499

  45. [54]

    Cross-frequency time series meta-forecasting

    Mike Van Ness, Huibin Shen, Hao Wang, Xiaoyong Jin, Danielle C Maddix, and Karthick Gopalswamy. Cross-frequency time series meta-forecasting. arXiv preprint arXiv:2302.02077, 2023

  46. [55]

    J. Wang, J. Jiang, W. Jiang, C. Han, and W. X. Zhao. Towards Efficient and Comprehensive Urban Spatial-Temporal Prediction: A Unified Library and Performance Benchmark . arXiv preprint arXiv:2304.14343, 2023

  47. [56]

    Subgraph Pooling: Tackling Negative Transfer on Graphs

    Zehong Wang, Zheyuan Zhang, Chuxu Zhang, and Yanfang Ye. Subgraph Pooling: Tackling Negative Transfer on Graphs . In Kate Larson (ed.), Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence, IJCAI-24 , pp.\ 5153--5161. International Joint Co...

  48. [57]

    Benchmarks and Custom Package for Electrical Load Forecasting , 2024 b

    Zhixian Wang, Qingsong Wen, Chaoli Zhang, Liang Sun, Leandro Von Krannichfeldt, Shirui Pan, and Yi Wang. Benchmarks and Custom Package for Electrical Load Forecasting , 2024 b . URL https://openreview.net/forum?id=gjB7qqPJbv

  49. [58]

    Characterizing and Avoiding Negative Transfer

    Zirui Wang, Zihang Dai, Barnabás Póczos, and Jaime Carbonell. Characterizing and Avoiding Negative Transfer . In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp.\ 11285--11294, 2019. doi:10.1109/CVPR.2019.01155

  50. [59]

    Transformers in Time Series: A Survey

    Qingsong Wen, Tian Zhou, Chaoli Zhang, Weiqi Chen, Ziqing Ma, Junchi Yan, and Liang Sun. Transformers in Time Series: A Survey . In Edith Elkind (ed.), Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, IJCAI-23 , pp.\ 6778--6786. Inter...

  51. [60]

    Pushing the limits of pre-training for time series forecasting in the cloudops domain

    Gerald Woo, Chenghao Liu, Akshat Kumar, and Doyen Sahoo. Pushing the limits of pre-training for time series forecasting in the cloudops domain. arXiv preprint arXiv:2310.05063, 2023

  52. [61]

    Unified Training of Universal Time Series Forecasting Transformers

    Gerald Woo, Chenghao Liu, Akshat Kumar, Caiming Xiong, Silvio Savarese, and Doyen Sahoo. Unified Training of Universal Time Series Forecasting Transformers . In Ruslan Salakhutdinov, Zico Kolter, Katherine Heller, Adrian Weller, Nuria Oliver, Jonathan Scarlett, and Felix Berke...

  53. [62]

    Timesnet: Temporal 2d-variation modeling for general time series analysis

    Haixu Wu, Tengge Hu, Yong Liu, Hang Zhou, Jianmin Wang, and Mingsheng Long. Timesnet: Temporal 2d-variation modeling for general time series analysis. In The Eleventh International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=ju_Uqw384Oq

  54. [63]

    On Layer Normalization in the Transformer Architecture

    Ruibin Xiong, Yunchang Yang, Di He, Kai Zheng, Shuxin Zheng, Chen Xing, Huishuai Zhang, Yanyan Lan, Liwei Wang, and Tieyan Liu. On Layer Normalization in the Transformer Architecture . In Hal Daumé III and Aarti Singh (eds.), Proceedings of the 37th International Conference on...

  55. [64]

    Temporal regularized matrix factorization for high-dimensional time series prediction

    Hsiang-Fu Yu, Nikhil Rao, and Inderjit S Dhillon. Temporal regularized matrix factorization for high-dimensional time series prediction. In D. Lee, M. Sugiyama, U. Luxburg, I. Guyon, and R. Garnett (eds.), Advances in Neural Information Processing Systems, volume 29. Curran As...

  56. [65]

    Temporal data meets llm--explainable financial time series forecasting

    Xinli Yu, Zheng Chen, Yuan Ling, Shujing Dong, Zongyi Liu, and Yanbin Lu. Temporal data meets llm--explainable financial time series forecasting. arXiv preprint arXiv:2306.11025, 2023

  57. [66]

    Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting

    Haoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang, Jianxin Li, Hui Xiong, and Wancai Zhang. Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting . Proceedings of the AAAI Conference on Artificial Intelligence , 35 0 (12): 0 11106--11115, May 2021...

  58. [67]

    FED former: Frequency Enhanced Decomposed Transformer for Long-term Series Forecasting

    Tian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang, Liang Sun, and Rong Jin. FED former: Frequency Enhanced Decomposed Transformer for Long-term Series Forecasting . In Kamalika Chaudhuri, Stefanie Jegelka, Le Song, Csaba Szepesvari, Gang Niu, and Sivan Sabato (eds.), Proceedings of...

  59. [68]

    One Fits All: Power General Time Series Analysis by Pretrained LM

    Tian Zhou, Peisong Niu, Xue Wang, Liang Sun, and Rong Jin. One Fits All: Power General Time Series Analysis by Pretrained LM . In Thirty-seventh Conference on Neural Information Processing Systems , 2023. URL https://openreview.net/forum?id=gMS6FVZvmF

  60. [69]

    @esa (Ref

    \@ifxundefined[1] #1\@undefined \@firstoftwo \@secondoftwo \@ifnum[1] #1 \@firstoftwo \@secondoftwo \@ifx[1] #1 \@firstoftwo \@secondoftwo [2] @ #1 \@temptokena #2 #1 @ \@temptokena \@ifclassloaded agu2001 natbib The agu2001 class already includes natbib coding, so you should ...

  61. [70]

    \@lbibitem[] @bibitem@first@sw\@secondoftwo \@lbibitem[#1]#2 \@extra@b@citeb \@ifundefined br@#2\@extra@b@citeb \@namedef br@#2 \@nameuse br@#2\@extra@b@citeb \@ifundefined b@#2\@extra@b@citeb @num @parse #2 @tmp #1 NAT@b@open@#2 NAT@b@shut@#2 \@ifnum @merge>\@ne @bibitem@firs...

  62. [71]

    Aggregated

    @open @close @open @close and [1] URL: #1 \@ifundefined chapter * \@mkboth \@ifxundefined @sectionbib * \@mkboth * \@mkboth\@gobbletwo \@ifclassloaded amsart * \@ifclassloaded amsbook * \@ifxundefined @heading @heading NAT@ctr thebibliography [1] @ \@biblabel @NAT@ctr \@bibset...

Pith tools

Reviewed August 15, 2026 · model on record in the stance chip above.