REVIEW 4 major objections 6 minor 70 references
DELPHYNE: A Pre-Trained Model for General and Financial Time Series
T0 review · 4 major / 6 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read A time-series transformer pre-trained on general and financial data matches foundation and dedicated models after a few fine-tuning steps, and beats them on finance tasks.
desk verdict Negative-transfer study is the real contribution; the Monash aggregate is computed on a biased subset and the abstract overpromises. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central mechanism is an encoder transformer built to tolerate the messiness of financial series: all variates are flattened and given identity embeddings, series are right-padded, split into patches of size 32, and a missing-data mask runs alongside the forecast mask so that irregular sampling, multiple frequencies, and contemporaneous (nowcasting) inputs do not misalign the data. Attention is any-variate attention with rotary position embeddings, and the forecast is a mixture of Student-$t$ distributions. Around this architecture sits the paper's main conceptual mechanism: the demonstration and removal of negative transfer. Using synthetic GARCH-versus-wavelet models, a Bayesian MCMC posterior analysis, and the Delphyne-A versus Delphyne-L comparison, the paper argues that heterogeneous pre-training data degrades zero-shot forecasts, and that fine-tuning is what 'unlearns' that bias—making the fine-tuning protocol, not the zero-shot prior, the load-bearing part of the system.
What would settle it
Re-run the Monash fine-tuning evaluation with validation and hyperparameter selection confined to the training split of each dataset (or to a time-based split that never touches the test horizon), and check whether Delphyne-A-FT still posts an aggregate normalized MAE near 0.536 and still rivals MOIRAI; if the clean-protocol numbers degrade materially, the 'competitive after few fine-tuning steps' claim loses its support. A supporting check is to replicate the financial tasks on years after 2023, well beyond the end-2019 pre-training cutoff, to test whether fine-tuned finance gains persist under drift.
Extended reading notes
Core claim
On the paper's own terms, the central claim is that pre-training a time-series transformer jointly on the public LOTSA corpus and on financial data—stocks, ETFs, currencies, commodities, and intraday bars—produces a model whose zero-shot performance on general tasks is worse than that of a model trained on LOTSA alone, yet whose fine-tuned performance matches or beats the best available baselines. Delphyne-A (LOTSA plus finance) shows higher zero-shot MAE than Delphyne-L (LOTSA only) on ETTh2 and on the Monash archive, but after fine-tuning the two converge, and Delphyne-A-FT posts the best numbers on the financial tasks: next-day stock-return risk likelihood (NLL 1.741), 78-step intraday bar-volume error (MSE 0.551), and nowcast MAE of 0.071 on company revenue growth, with quantile-coverage statistics close to optimal. The paper reads these results as evidence that the negative transfer induced by heterogeneous pre-training data is real and inherent—confirmed by GARCH-versus-wavelet synthetic models and a Bayesian MCMC posterior analysis—and that fine-tuning is the mechanism that 'unlearns' the pre-training bias.
Load-bearing premise
The load-bearing premise is the Monash fine-tuning protocol: validation for early stopping and hyperparameter selection is carved out of the same hold-out test horizon that later produces the reported scores, so if that protocol leaks test information, the fine-tuned gains on public benchmarks—including the aggregate 0.536 normalized MAE—are optimistic.
Editorial extensions
If this is right
- A single pre-trained model covering general plus financial data can serve both worlds: after a short fine-tuning phase it reaches an aggregate 0.536 normalized MAE on the Monash archive and rivals the best foundation model on several datasets.
- On financial tasks, fine-tuning delivers the wins: Delphyne beats the Student-$t$ GARCH baseline in next-day return likelihood, the fine-tuned Delphyne variants post the best errors on intraday bar volume and company-revenue nowcasting, and coverage statistics sit close to optimal.
- Zero-shot results systematically understate a model trained on heterogeneous data, so evaluations of time-series foundation models should report fine-tuned performance; the negative-transfer penalty is a property of the data mixture, not a failure of the architecture.
- Pre-training choices such as longer context lengths and lighter masking ratios improve downstream few-shot adaptation, so these hyperparameters should be selected with the fine-tuning regime in mind.
- The same fine-tuned model also handles probabilistic forecasting (CRPS/MSIS) and anomaly detection, indicating that one foundation model can cover forecasting, uncertainty quantification, and monitoring after light adaptation.
Reading between the lines
- A testable extension the paper leaves open: give the finance-only model (Delphyne-F) a much larger fine-tuning budget on financial tasks and check whether the general-domain prior in Delphyne-A eventually becomes irrelevant or actively harmful, which would sharpen the question of which pre-training data actually pays for itself.
- The missing-data mask suggests an imputation use the paper does not develop: evaluate Delphyne on genuinely irregular calendars (holidays, half-days, multi-frequency lags) where left-padding and zero-filling baselines should degrade, and measure whether the mask preserves forecast calibration.
- Because the financial pre-training data stops at end-2019, the reported finance results cover 2020-2023; a natural stress test is whether the fine-tuned advantage survives rolling windows after 2023, when the pre-training distribution is older.
- The negative-transfer diagnostic could be repurposed: a practitioner facing a new domain could read zero-shot degradation as a cheap signal of domain mismatch, and use its size to decide how much fine-tuning data to collect.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces Delphyne, an encoder-only transformer pretrained on the LOTSA public corpus and on proprietary financial data, with any-variate attention, missing-data and forecast masks, and a mixture-of-Student-T output distribution. The authors document a negative transfer effect when financial and non-financial data are mixed, argue that fine-tuning is the remedy, and evaluate Delphyne on Monash short-term forecasting, long-horizon out-of-distribution forecasting, probabilistic forecasting, anomaly detection, and four financial tasks (stock risk, volatility, intraday bars, and company nowcasting). The central claim is that Delphyne is competitive with existing foundation and full-shot models after few fine-tuning steps on public benchmarks and superior on financial tasks.
Significance. If the claims are supported, the paper would make a meaningful contribution: it provides evidence that a time-series foundation model can incorporate proprietary financial data and recover from negative transfer through fine-tuning, and it gives a systematic study of design choices (masking, context length, variate handling, output distribution). Strengths of the paper include clean temporal separations in the financial experiments (pretraining data end in 2019 while evaluation windows start in 2021), consistent fine-tuning gains across most benchmarks, and a thorough ablation suite on synthetic data. The main weaknesses are that several headline comparisons are not computed on matched data subsets, the 'few fine-tuning steps' claim is not quantified, and some broad performance claims are contradicted by the paper's own tables. These issues are fixable but currently overstate the evidence.
major comments (4)
- [Sec. 5.2, Tables 16-17] The headline Monash comparison is computed on unmatched dataset subsets. Table 17 has no fine-tuned entries for M1 Monthly, M3 Monthly, M3 Other, Tourism Quarterly, CIF 2016, Vehicle Trips, Carparts, and Hospital, so the Delphyne-A-FT aggregate 0.536 is a geometric mean over the remaining datasets, whereas the MOIRAI 0.58 aggregate in Table 16 covers all 28 datasets. On several of the excluded datasets Delphyne-A-ZS is much worse than MOIRAI (e.g., Sunspot 3.51 vs. 0.08; Pedestrian Counts 52.99 vs. 23.17), so dropping them can only improve Delphyne's aggregate. The sentence in Sec. 5.2 that fine-tuned Delphyne is 'rivaling the best model, MOIRAI' is not supported by the current tables; please report a matched-subset comparison and state the number of datasets in each aggregate.
- [Abstract and Sec. 2] The claim of adaptation with 'few fine-tuning steps' and 'minimal iterations' is never quantified. Sec. 5.2 reports only that early stopping is used, Fig. 2's x-axis is pre-training steps, and no experiment reports the number of gradient updates, epochs, or wall-clock time for fine-tuning the main models. Without this information, the 'few fine-tuning steps' qualifier in the abstract is unsupported. Please report fine-tuning cost (e.g., steps or epochs) for the Monash, long-horizon, and financial experiments, or remove the qualifier.
- [Sec. 5.4 and Table 12] The probabilistic-forecasting claim is broader than the evidence. After fine-tuning, Delphyne-A's CRPS on Electricity is 0.140, compared with 0.048-0.065 for full-shot baselines and 0.055 for MOIRAI zero-shot; on Solar the fine-tuned CRPS is 1.306, compared with 0.420-0.518 for baselines and 0.419 for MOIRAI zero-shot. The statement that fine-tuned Delphyne 'achieves the best results across various datasets' is inaccurate for these datasets. Please restrict the claim to the datasets where it holds, or add a discussion of why fine-tuning does not close the gap on Electricity and Solar.
- [Sec. 5.1 and Appendix B.2] The financial evaluations are performed on proprietary data of the same types that appear in Delphyne's pretraining corpus (company consumer transactions, intraday bars, stock returns, and related fields). While the temporal split is clean (pretraining ends in 2019 and evaluation starts in 2021), the 'superior performances on various financial tasks' claim is an in-domain result; the comparison methods (MOIRAI, MOMENT, TTM, PatchTST) did not have access to this proprietary pretraining data, so the comparison is not controlled for pretraining data. Please state this limitation explicitly and, if possible, add an external financial benchmark that is not part of the pretraining corpus.
minor comments (6)
- [Table 10 caption] The caption says 'MSE results' but the table reports MAE; please correct the caption.
- [Appendix J, Table 29] MOIRAI is cited as (Wang et al., 2024a), but the correct reference is Woo et al. (2024); the current citation points to a graph negative-transfer paper.
- [Table 1] The blank entries in Table 1 should be marked as not applicable rather than left empty, to avoid ambiguity about whether the measurement was not performed.
- [Table 6] The sampling probabilities for LOTSA sum to approximately 85.1 and those for finance to approximately 14.2, not the stated 85 and 15; please reconcile the rounding.
- [Sec. 5.2] The sentence 'We partition out the same forecast length as the test set, used as validation data for finetuning the model' can be misread as using test data for validation; please clarify that the validation set is carved from the training split.
- [Fig. 2] The x-axis of Fig. 2 is described as training steps but the axis label is missing; please add a label and, if possible, indicate the fine-tuning step count on the same axis.
Circularity Check
No circular derivation found; the Monash aggregate-subset mismatch is a benchmark fairness concern, not a circularity.
full rationale
The paper's chain of reasoning is empirical rather than derivational: the pretraining objective in Eq. (2) is a standard NLL forecasting loss, the negative-transfer demonstrations are synthetic-data experiments, and the general-benchmark evaluations use held-out test splits. No prediction or claimed result is defined in terms of its own input. The Monash validation split described in Sec. 5.2 partitions out a validation horizon from the training split, not the test set, so there is no leakage that would make the fine-tuned results forced by construction. The finance evaluations are partly in-distribution because Delphyne-A is pretrained on the same families of proprietary financial data (stocks, intraday bars, consumer transactions) that appear in the downstream tasks, but this limits external validity rather than making the result circular. The selection of the mixture-of-Student-t output distribution is an ablation-driven model choice, not a fitted parameter renamed as a prediction, and the self-citations (e.g., Gopal 2024) are contextual and not load-bearing. The comparison of Delphyne-A-FT's subset-based Monash aggregate (0.536 in Table 17) against MOIRAI's full-benchmark aggregate (0.58 in Table 16) is an unmatched-subset comparison that weakens the 'rivaling MOIRAI' claim, but it is a fairness and reporting issue, not a reduction of the result to its inputs. No circular step can be exhibited from the paper's equations or cited chain.
Assumptions & free parameters
free parameters (5)
- pretraining data mixture =
85% LOTSA / 15% financial
- variate sampling beta-binomial =
alpha=2, beta=5
- masking beta-binomial =
alpha=5, beta=10 (mean about 30%)
- patch size =
32
- context length =
512 x 32 timesteps
assumptions (5)
- domain assumption Diverse pretraining on LOTSA plus proprietary financial data yields transferable time-series representations.
- domain assumption Negative transfer observed in synthetic wavelet and GARCH experiments transfers to real financial pretraining.
- domain assumption Mixture of Student-T distributions is adequate as the output family for all downstream tasks.
- ad hoc to paper The Monash test horizon can be used as a validation set for fine-tuning without biasing results.
- domain assumption Proprietary financial data cutoff at end-2019 prevents lookahead leakage into evaluations after 2020.
Cite this review
Pith. "Pith review of DELPHYNE: A Pre-Trained Model for General and Financial Time Series." pith.science (2026). https://pith.science/paper/PMAP5GHD
@misc{pith2026250606288,
author = {Pith},
title = {Pith review of: DELPHYNE: A Pre-Trained Model for General and Financial Time Series},
year = {2026},
howpublished = {\url{https://pith.science/paper/PMAP5GHD}},
note = {Machine review of arXiv:2506.06288}
}
read the original abstract
Time-series data is a vital modality within data science communities. This is particularly valuable in financial applications, where it helps in detecting patterns, understanding market behavior, and making informed decisions based on historical data. Recent advances in language modeling have led to the rise of time-series pre-trained models that are trained on vast collections of datasets and applied to diverse tasks across financial domains. However, across financial applications, existing time-series pre-trained models have not shown boosts in performance over simple finance benchmarks in both zero-shot and fine-tuning settings. This phenomenon occurs because of a i) lack of financial data within the pre-training stage, and ii) the negative transfer effect due to inherently different time-series patterns across domains. Furthermore, time-series data is continuous, noisy, and can be collected at varying frequencies and with varying lags across different variables, making this data more challenging to model than languages. To address the above problems, we introduce a Pre-trained MoDEL for FINance TimE-series (Delphyne). Delphyne achieves competitive performance to existing foundation and full-shot models with few fine-tuning steps on publicly available datasets, and also shows superior performances on various financial tasks.
Figures
Figures from the paper (7 more)
Reference graph
Works this paper leans on
-
[1]
Alexander Alexandrov, Konstantinos Benidis, Michael Bohlke-Schneider, Valentin Flunkert, Jan Gasthaus, Tim Januschowski, Danielle C. Maddix, Syama Rangapuram, David Salinas, Jasper Schulz, Lorenzo Stella, Ali Caner T \"u rkmen, and Yuyang Wang. Gluon TS : Probabilistic and Neural Time Series Modeling in P ython . Journal of Machine Learning Research, 21 0...
work page 2020
-
[2]
Abdul Fatir Ansari, Lorenzo Stella, Caner Turkmen, Xiyuan Zhang, Pedro Mercado, Huibin Shen, Oleksandr Shchur, Syama Syndar Rangapuram, Sebastian Pineda Arango, Shubham Kapoor, Jasper Zschiegner, Danielle C. Maddix, Hao Wang, Michael W. Mahoney, Kari Torkkola, Andrew Gordon Wilson, Michael Bohlke-Schneider, and Yuyang Wang. Chronos: Learning the Language ...
arXiv 2024
-
[3]
Gustavo Silva Araujo and Wagner Piazza Gaglianone. Machine Learning Methods for Inflation Forecasting in B razil: New Contenders versus Classical Models . Latin American Journal of Central Banking, 4 0 (2): 0 100087, 2023. doi:10.1016/j.latcb.2023.100087
arXiv 2023
-
[4]
V. Assimakopoulos and K. Nikolopoulos. The T heta Model: A Decomposition Approach to Forecasting . International Journal of Forecasting, 16 0 (4): 0 521--530, 2000. doi:10.1016/S0169-2070(00)00066-2
-
[5]
Generalized Autoregressive Conditional Heteroskedasticity , journal = Journal of Econometrics
Tim Bollerslev. Generalized Autoregressive Conditional Heteroskedasticity , journal = Journal of Econometrics . 31 0 (3): 0 307--327, 1986. doi:10.1016/0304-4076(86)90063-1
-
[6]
David Campos, Miao Zhang, Bin Yang, Tung Kieu, Chenjuan Guo, and Christian S. Jensen. LightTS: Lightweight Time Series Classification with Adaptive Ensemble Distillation . Proc. ACM Manag. Data , 1 0 (2): 0 171:1--171:27, 2023. doi:10.1145/3589316
doi:10.1145/3589316 2023
-
[7]
Llm4ts: Two-stage fine-tuning for time-series forecasting with pre-trained llms
Ching Chang, Wen-Chih Peng, and Tien-Fu Chen. Llm4ts: Two-stage fine-tuning for time-series forecasting with pre-trained llms. arXiv preprint arXiv:2308.08469, 2023
arXiv 2023
-
[8]
C hat GPT Informed Graph Neural Network for Stock Movement Prediction
Zihan Chen, Lei Zheng, Cheng Lu, Jialu Yuan, and Di Zhu. C hat GPT Informed Graph Neural Network for Stock Movement Prediction . SSRN Electronic Journal, 2023. doi:10.2139/ssrn.4464002
Show all 70 references
-
[9]
A decoder-only foundation model for time-series forecasting
Abhimanyu Das, Weihao Kong, Rajat Sen, and Yichen Zhou. A decoder-only foundation model for time-series forecasting . In Ruslan Salakhutdinov, Zico Kolter, Katherine Heller, Adrian Weller, Nuria Oliver, Jonathan Scarlett, and Felix Berkenkamp (eds.), Proceedings of the 41st In...
2024
-
[10]
Cat B oost: G radient Boosting with Categorical Features Support
Anna Veronika Dorogush, Vasily Ershov, and Andrey Gulin. Cat B oost: G radient Boosting with Categorical Features Support . CoRR, abs/1810.11363, 2018. URL http://arxiv.org/abs/1810.11363
2018 arXiv
-
[11]
Nguyen, Wesley M
Vijay Ekambaram, Arindam Jati, Pankaj Dayama, Sumanta Mukherjee, Nam H. Nguyen, Wesley M. Gifford, Chandra Reddy, and Jayant Kalagnanam. Tiny Time Mixers ( TTM s): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Series , 2024. URL https://ar...
2024 arXiv
-
[12]
Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning
Stefan Elfwing, Eiji Uchibe, and Kenji Doya. Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning . Neural Networks (Special issue on reinforcement learning) , 107: 0 3--11, 2018. doi:10.1016/j.neunet.2017.12.012
2018 doi
-
[13]
BuildingsBench: A Large-Scale Dataset of 900K Buildings and Benchmark for Short-Term Load Forecasting
Patrick Emami, Abhijeet Sahu, and Peter Graf. BuildingsBench: A Large-Scale Dataset of 900K Buildings and Benchmark for Short-Term Load Forecasting . In Thirty-seventh Conference on Neural Information Processing Systems Datasets and Benchmarks Track, 2023. URL https://openrevi...
2023
-
[14]
Dish- TS : A General Paradigm for Alleviating Distribution Shift in Time Series Forecasting
Wei Fan, Pengyang Wang, Dongkun Wang, Dongjie Wang, Yuanchun Zhou, and Yanjie Fu. Dish- TS : A General Paradigm for Alleviating Distribution Shift in Time Series Forecasting . In Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence and Thirty-Fifth Conf...
2023 doi
-
[15]
Timegpt-1
Azul Garza and Max Mergenthaler-Canseco. Timegpt-1. arXiv preprint arXiv:2310.03589, 2023
2023 arXiv
-
[16]
Strictly Proper Scoring Rules, Prediction, and Estimation
Tilmann Gneiting and Adrian E Raftery. Strictly Proper Scoring Rules, Prediction, and Estimation . Journal of the American Statistical Association, 102 0 (477): 0 359--378, 2007
2007
-
[17]
R. W. Godahewa, C. Bergmeir, G. I. Webb, R. Hyndman, and P. Montero-Manso. Monash Time Series Forecasting Archive . In Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 2), 2021. URL https://openreview.net/forum?id=wEc1mgAjU-
2021
-
[18]
Neuralfactors: A novel factor learning approach to generative modeling of equities
Achintya Gopal. Neuralfactors: A novel factor learning approach to generative modeling of equities. In Proceedings of the 5th ACM International Conference on AI in Finance, pp.\ 99--107, 2024
2024
-
[19]
Unsupervised Model Selection for Time Series Anomaly Detection
Mononito Goswami, Cristian Ignacio Challu, Laurent Callot, Lenon Minorics, and Andrey Kan. Unsupervised Model Selection for Time Series Anomaly Detection . In The Eleventh International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=gOZ_pKANaPW
2023
-
[20]
MOMENT: A Family of Open Time-series Foundation Models , 2024
Mononito Goswami, Konrad Szafer, Arjun Choudhry, Yifu Cai, Shuo Li, and Artur Dubrawski. MOMENT: A Family of Open Time-series Foundation Models , 2024. URL https://arxiv.org/abs/2402.03885
2024 arXiv
-
[21]
Large Language Models Are Zero-Shot Time Series Forecasters
Nate Gruver, Marc Finzi, Shikai Qiu, and Andrew G Wilson. Large Language Models Are Zero-Shot Time Series Forecasters . In A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine (eds.), Advances in N eural I nformation P rocessing S ystems , volume 36, pp.\ 19622-...
2023
-
[22]
Masked Autoencoders Are Scalable Vision Learners
Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dollár, and Ross Girshick. Masked Autoencoders Are Scalable Vision Learners . In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp.\ 15979--15988, 2022. doi:10.1109/CVPR52688.2022.01553
2022
-
[23]
Hoffman and Andrew Gelman
Matthew D. Hoffman and Andrew Gelman. The No-U-Turn Sampler: Adaptively Setting Path Lengths in H amiltonian M onte C arlo . Journal of Machine Learning Research , 15 0 (47): 0 1593--1623, 2014. URL http://jmlr.org/papers/v15/hoffman14a.html
2014
-
[24]
Tab PFN : A Transformer That Solves Small Tabular Classification Problems in a Second
Noah Hollmann, Samuel M \"u ller, Katharina Eggensperger, and Frank Hutter. Tab PFN : A Transformer That Solves Small Tabular Classification Problems in a Second . In The Eleventh International Conference on Learning Representations , 2023. URL https://openreview.net/forum?id=...
2023
-
[25]
Deep learning volatility
Blanka Horvath, Aitor Muguruza, and Mehdi Tomas. Deep learning volatility. arXiv preprint arXiv:1901.09647, 2019
1901 arXiv
-
[26]
Errors on Percentage Errors , 4 2014
Rob J Hyndman. Errors on Percentage Errors , 4 2014. URL https://robjhyndman.com/hyndsight/smape/
2014
-
[27]
Another Look at Measures of Forecast Accuracy
Rob J Hyndman and Anne B Koehler. Another Look at Measures of Forecast Accuracy . International Journal of Forecasting, 22 0 (4): 0 679--688, 2006
2006
-
[28]
Zhang, Xiaoming Shi, Pin-Yu Chen, Yuxuan Liang, Yuan-Fang Li, Shirui Pan, and Qingsong Wen
Ming Jin, Shiyu Wang, Lintao Ma, Zhixuan Chu, James Y. Zhang, Xiaoming Shi, Pin-Yu Chen, Yuxuan Liang, Yuan-Fang Li, Shirui Pan, and Qingsong Wen. Time- LLM : Time Series Forecasting by Reprogramming Large Language Models . In The Twelfth International Conference on Learning R...
2024
-
[29]
A study of bfloat16 for deep learning training
Dhiraj Kalamkar, Dheevatsa Mudigere, Naveen Mellempudi, Dipankar Das, Kunal Banerjee, Sasikanth Avancha, Dharma Teja Vooturi, Nataraj Jammalamadaka, Jianyu Huang, Hector Yuen, et al. A study of bfloat16 for deep learning training. arXiv preprint arXiv:1905.12322, 2019
1905 arXiv
-
[30]
Reversible Instance Normalization for Accurate Time-Series Forecasting against Distribution Shift
Taesung Kim, Jinhee Kim, Yunwon Tae, Cheonbok Park, Jang-Ho Choi, and Jaegul Choo. Reversible Instance Normalization for Accurate Time-Series Forecasting against Distribution Shift . In International Conference on Learning Representations , 2022. URL https://openreview.net/for...
2022
-
[31]
Aditya Prakash
Haoxin Liu, Harshavardhan Kamarthi, Lingkai Kong, Zhiyuan Zhao, Chao Zhang, and B. Aditya Prakash. Time-series forecasting for out-of-distribution generalization using invariant learning. In Forty-first International Conference on Machine Learning, 2024 a . URL https://openrev...
2024
-
[32]
Sasanur, Megha Sharma, Jiaming Cui, Qingsong Wen, Chao Zhang, and B
Haoxin Liu, Shangqing Xu, Zhiyuan Zhao, Lingkai Kong, Harshavardhan Kamarthi, Aditya B. Sasanur, Megha Sharma, Jiaming Cui, Qingsong Wen, Chao Zhang, and B. Aditya Prakash. Time- MMD : Multi-domain multimodal dataset for time series analysis. In The Thirty-eight Conference on ...
2024
-
[33]
Lstprompt: Large language models as zero-shot time series forecasters by long-short-term prompting
Haoxin Liu, Zhiyuan Zhao, Jindong Wang, Harshavardhan Kamarthi, and B Aditya Prakash. Lstprompt: Large language models as zero-shot time series forecasters by long-short-term prompting. arXiv preprint arXiv:2402.16132, 2024 c
2024 arXiv
-
[34]
Large ST : A Benchmark Dataset for Large-Scale Traffic Forecasting
Xu Liu, Yutong Xia, Yuxuan Liang, Junfeng Hu, Yiwei Wang, LEI BAI, Chao Huang, Zhenguang Liu, Bryan Hooi, and Roger Zimmermann. Large ST : A Benchmark Dataset for Large-Scale Traffic Forecasting . In Thirty-seventh Conference on Neural Information Processing Systems Datasets a...
2023
-
[35]
iTransformer: Inverted Transformers Are Effective for Time Series Forecasting
Yong Liu, Tengge Hu, Haoran Zhang, Haixu Wu, Shiyu Wang, Lintao Ma, and Mingsheng Long. iTransformer: Inverted Transformers Are Effective for Time Series Forecasting . In The Twelfth International Conference on Learning Representations, 2024 d . URL https://openreview.net/foru...
2024
-
[36]
Neuralbeta: Estimating beta using deep learning
Yuxin Liu, Jimin Lin, and Achintya Gopal. Neuralbeta: Estimating beta using deep learning. arXiv preprint arXiv:2408.01387, 2024 e
2024 arXiv
-
[37]
Can chatgpt forecast stock price movements? return predictability and large language models
Alejandro Lopez-Lira and Yuehua Tang. Can chatgpt forecast stock price movements? return predictability and large language models. arXiv preprint arXiv:2304.07619, 2023
2023
-
[38]
The M4 Competition: 100,000 time series and 61 forecasting methods
Spyros Makridakis, Evangelos Spiliotis, and Vassilios Assimakopoulos. The M4 Competition: 100,000 time series and 61 forecasting methods . International Journal of Forecasting, 36 0 (1): 0 54--74, 2020
2020
-
[39]
Position: Graph Foundation Models Are Already Here
Haitao Mao, Zhikai Chen, Wenzhuo Tang, Jianan Zhao, Yao Ma, Tong Zhao, Neil Shah, Mikhail Galkin, and Jiliang Tang. Position: Graph Foundation Models Are Already Here . In Ruslan Salakhutdinov, Zico Kolter, Katherine Heller, Adrian Weller, Nuria Oliver, Jonathan Scarlett, and ...
2024
-
[40]
Mouatadid, P
S. Mouatadid, P. Orenstein, G. E. Flaspohler, M. Oprescu, J. Cohen, F. Wang, S. E. Knight, M. Geogdzhayeva, S. J. Levang, E. Fraenkel, and L. Mackey. SubseasonalclimateUSA: A Dataset for Subseasonal Forecasting and Benchmarking . In Thirty-seventh Conference on Neural Informat...
2023
-
[41]
Transformers Can Do B ayesian I nference
Samuel M \"u ller, Noah Hollmann, Sebastian Pineda Arango, Josif Grabocka, and Frank Hutter. Transformers Can Do B ayesian I nference . In International Conference on Learning Representations , 2022. URL https://openreview.net/forum?id=KSugKcbNf9
2022
-
[42]
A Time Series is Worth 64 Words: Long-term Forecasting with Transformers
Yuqi Nie, Nam H Nguyen, Phanwadee Sinthong, and Jayant Kalagnanam. A Time Series is Worth 64 Words: Long-term Forecasting with Transformers . In The Eleventh International Conference on Learning Representations , 2023. URL https://openreview.net/forum?id=Jbdc0vTOcol
2023
-
[43]
Oreshkin, Dmitri Carpov, Nicolas Chapados, and Yoshua Bengio
Boris N. Oreshkin, Dmitri Carpov, Nicolas Chapados, and Yoshua Bengio. N-BEATS: Neural Basis Expansion Analysis for Interpretable Time Series Forecasting . In International Conference on Learning Representations, 2020. URL https://openreview.net/forum?id=r1ecqn4YwB
2020
-
[44]
Learning Quantile Functions without Quantile Crossing for Distribution-Free Time Series Forecasting
Youngsuk Park, Danielle Maddix, Fran c ois-Xavier Aubet, Kelvin Kan, Jan Gasthaus, and Yuyang Wang. Learning Quantile Functions without Quantile Crossing for Distribution-Free Time Series Forecasting . In International Conference on Artificial Intelligence and Statistics, pp.\...
2022
-
[45]
Deep Learning for Volatility Forecasting in Asset Management
Alessio Petrozziello, Luigi Troiano, Angela Serra, Ivan Jordanov, Giuseppe Storti, Roberto Tagliaferri, and Michele La Rocca. Deep Learning for Volatility Forecasting in Asset Management . Soft Computing, 26 0 (17): 0 8553--8574, 2022. doi:10.1007/s00500-022-07161-1
2022 doi
-
[46]
Lag- L lama: Towards Foundation Models for Time Series Forecasting
Kashif Rasul, Arjun Ashok, Andrew Robert Williams, Arian Khorasani, George Adamopoulos, Rishika Bhagwatkar, Marin Bilo s , Hena Ghonia, Nadhir Hassen, Anderson Schneider, Sahil Garg, Alexandre Drouin, Nicolas Chapados, Yuriy Nevmyvaka, and Irina Rish. Lag- L lama: Towards Foun...
2023
-
[48]
DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networks
David Salinas, Valentin Flunkert, Jan Gasthaus, and Tim Januschowski. DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networks . International Journal of Forecasting, 36 0 (3): 0 1181--1191, 2020 b . doi:10.1016/j.ijforecast.2019.07.001
2020 doi
-
[49]
Glu variants improve transformer
Noam Shazeer. Glu variants improve transformer. arXiv preprint arXiv:2002.05202, 2020
2002 arXiv
-
[50]
RoFormer: Enhanced transformer with Rotary Position Embedding
Jianlin Su, Murtadha Ahmed, Yu Lu, Shengfeng Pan, Wen Bo, and Yunfeng Liu. RoFormer: Enhanced transformer with Rotary Position Embedding . Neurocomput., 568 0 (C), March 2024. doi:10.1016/j.neucom.2023.127063
2024
-
[51]
Generative Machine Learning for Multivariate Equity Returns
Ruslan Tepelyan and Achintya Gopal. Generative Machine Learning for Multivariate Equity Returns . In Proceedings of the Fourth ACM International Conference on AI in Finance, ICAIF '23, pp.\ 159–166, New York, NY, USA, 2023. Association for Computing Machinery. doi:10.1145/3604...
2023
-
[52]
ElectricityLoadDiagrams20112014
Artur Trindade. ElectricityLoadDiagrams20112014 . UCI Machine Learning Repository, 2015
2015
-
[53]
Senior, and Koray Kavukcuoglu
A \" a ron van den Oord, Sander Dieleman, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alex Graves, Nal Kalchbrenner, Andrew W. Senior, and Koray Kavukcuoglu. WaveNet: A Generative Model for Raw Audio . CoRR, abs/1609.03499, 2016. URL http://arxiv.org/abs/1609.03499
2016 arXiv
-
[54]
Cross-frequency time series meta-forecasting
Mike Van Ness, Huibin Shen, Hao Wang, Xiaoyong Jin, Danielle C Maddix, and Karthick Gopalswamy. Cross-frequency time series meta-forecasting. arXiv preprint arXiv:2302.02077, 2023
2023 arXiv
-
[55]
J. Wang, J. Jiang, W. Jiang, C. Han, and W. X. Zhao. Towards Efficient and Comprehensive Urban Spatial-Temporal Prediction: A Unified Library and Performance Benchmark . arXiv preprint arXiv:2304.14343, 2023
2023 arXiv
-
[56]
Subgraph Pooling: Tackling Negative Transfer on Graphs
Zehong Wang, Zheyuan Zhang, Chuxu Zhang, and Yanfang Ye. Subgraph Pooling: Tackling Negative Transfer on Graphs . In Kate Larson (ed.), Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence, IJCAI-24 , pp.\ 5153--5161. International Joint Co...
2024 doi
-
[57]
Benchmarks and Custom Package for Electrical Load Forecasting , 2024 b
Zhixian Wang, Qingsong Wen, Chaoli Zhang, Liang Sun, Leandro Von Krannichfeldt, Shirui Pan, and Yi Wang. Benchmarks and Custom Package for Electrical Load Forecasting , 2024 b . URL https://openreview.net/forum?id=gjB7qqPJbv
2024
-
[58]
Characterizing and Avoiding Negative Transfer
Zirui Wang, Zihang Dai, Barnabás Póczos, and Jaime Carbonell. Characterizing and Avoiding Negative Transfer . In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp.\ 11285--11294, 2019. doi:10.1109/CVPR.2019.01155
2019
-
[59]
Transformers in Time Series: A Survey
Qingsong Wen, Tian Zhou, Chaoli Zhang, Weiqi Chen, Ziqing Ma, Junchi Yan, and Liang Sun. Transformers in Time Series: A Survey . In Edith Elkind (ed.), Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, IJCAI-23 , pp.\ 6778--6786. Inter...
2023 doi
-
[60]
Pushing the limits of pre-training for time series forecasting in the cloudops domain
Gerald Woo, Chenghao Liu, Akshat Kumar, and Doyen Sahoo. Pushing the limits of pre-training for time series forecasting in the cloudops domain. arXiv preprint arXiv:2310.05063, 2023
2023 arXiv
-
[61]
Unified Training of Universal Time Series Forecasting Transformers
Gerald Woo, Chenghao Liu, Akshat Kumar, Caiming Xiong, Silvio Savarese, and Doyen Sahoo. Unified Training of Universal Time Series Forecasting Transformers . In Ruslan Salakhutdinov, Zico Kolter, Katherine Heller, Adrian Weller, Nuria Oliver, Jonathan Scarlett, and Felix Berke...
2024
-
[62]
Timesnet: Temporal 2d-variation modeling for general time series analysis
Haixu Wu, Tengge Hu, Yong Liu, Hang Zhou, Jianmin Wang, and Mingsheng Long. Timesnet: Temporal 2d-variation modeling for general time series analysis. In The Eleventh International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=ju_Uqw384Oq
2023
-
[63]
On Layer Normalization in the Transformer Architecture
Ruibin Xiong, Yunchang Yang, Di He, Kai Zheng, Shuxin Zheng, Chen Xing, Huishuai Zhang, Yanyan Lan, Liwei Wang, and Tieyan Liu. On Layer Normalization in the Transformer Architecture . In Hal Daumé III and Aarti Singh (eds.), Proceedings of the 37th International Conference on...
2020
-
[64]
Temporal regularized matrix factorization for high-dimensional time series prediction
Hsiang-Fu Yu, Nikhil Rao, and Inderjit S Dhillon. Temporal regularized matrix factorization for high-dimensional time series prediction. In D. Lee, M. Sugiyama, U. Luxburg, I. Guyon, and R. Garnett (eds.), Advances in Neural Information Processing Systems, volume 29. Curran As...
2016
-
[65]
Temporal data meets llm--explainable financial time series forecasting
Xinli Yu, Zheng Chen, Yuan Ling, Shujing Dong, Zongyi Liu, and Yanbin Lu. Temporal data meets llm--explainable financial time series forecasting. arXiv preprint arXiv:2306.11025, 2023
2023 arXiv
-
[66]
Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting
Haoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang, Jianxin Li, Hui Xiong, and Wancai Zhang. Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting . Proceedings of the AAAI Conference on Artificial Intelligence , 35 0 (12): 0 11106--11115, May 2021...
2021 doi
-
[67]
FED former: Frequency Enhanced Decomposed Transformer for Long-term Series Forecasting
Tian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang, Liang Sun, and Rong Jin. FED former: Frequency Enhanced Decomposed Transformer for Long-term Series Forecasting . In Kamalika Chaudhuri, Stefanie Jegelka, Le Song, Csaba Szepesvari, Gang Niu, and Sivan Sabato (eds.), Proceedings of...
2022
-
[68]
One Fits All: Power General Time Series Analysis by Pretrained LM
Tian Zhou, Peisong Niu, Xue Wang, Liang Sun, and Rong Jin. One Fits All: Power General Time Series Analysis by Pretrained LM . In Thirty-seventh Conference on Neural Information Processing Systems , 2023. URL https://openreview.net/forum?id=gMS6FVZvmF
2023
-
[69]
@esa (Ref
\@ifxundefined[1] #1\@undefined \@firstoftwo \@secondoftwo \@ifnum[1] #1 \@firstoftwo \@secondoftwo \@ifx[1] #1 \@firstoftwo \@secondoftwo [2] @ #1 \@temptokena #2 #1 @ \@temptokena \@ifclassloaded agu2001 natbib The agu2001 class already includes natbib coding, so you should ...
-
[70]
\@lbibitem[] @bibitem@first@sw\@secondoftwo \@lbibitem[#1]#2 \@extra@b@citeb \@ifundefined br@#2\@extra@b@citeb \@namedef br@#2 \@nameuse br@#2\@extra@b@citeb \@ifundefined b@#2\@extra@b@citeb @num @parse #2 @tmp #1 NAT@b@open@#2 NAT@b@shut@#2 \@ifnum @merge>\@ne @bibitem@firs...
-
[71]
Aggregated
@open @close @open @close and [1] URL: #1 \@ifundefined chapter * \@mkboth \@ifxundefined @sectionbib * \@mkboth * \@mkboth\@gobbletwo \@ifclassloaded amsart * \@ifclassloaded amsbook * \@ifxundefined @heading @heading NAT@ctr thebibliography [1] @ \@biblabel @NAT@ctr \@bibset...
1913
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.