REVIEW 3 major objections 5 minor 155 references
Into the ORBIT for Time Series: Training Regimes for Foundation Models
T0 review · 3 major / 5 minor · reviewed 2026-08-14 · deepseek-v4-flash
Pith's one-line read The paper claims that explicitly controlling the pre-training distribution — which datasets, records, variables, contexts, and horizons a model sees — is a first-order factor in time series foundation model performance, and that its ORBIT…
desk verdict A serious training-regime paper with a real confound: the unablated alignment loss means the SOTA claim is not actually attributable to ORBIT. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is ORBIT, a two-part training paradigm. Bootstrap Multi-Level Sampling converts prescribed dataset weights into a global stream via a low-discrepancy greedy blending rule, then constructs an offline sample index of five-tuples (record, variable, context start, context end, horizon) by uniform stochastic selection over records, target variables, feasible context windows, and feasible prediction horizons. Omni-Range Incremental Training consumes this stream in a single stage, left-padding contexts and right-padding targets to batch maxima and masking unsupported positions, so short and long contexts and horizons are seen simultaneously. Falcon-2.0 is the deliberately simple backbone — a univariate encoder-only Transformer with triple-channel patches marking value, missingness indicator, and temporal position, a 21-quantile pinball loss, and multi-stage autoregressive inference for long horizons. A secondary mechanism, Rank-Guided Cross-Depth Alignment, uses a late layer as a stop-gradient teacher for a shallow layer through a token-wise cosine loss; the paper proves that small alignment loss bounds the spectral perturbation between shallow and deep representations, preventing loss of non-negligible singular modes under a separation condition. The machinery matters because it turns the training distribution into a specifiable object rather than an accident of corpus layout.
What would settle it
Re-run Falcon-2.0 and the top five competitors on GIFT-Eval and fev-bench under a single standardized protocol — identical context lengths, preprocessing, evaluation windows, and multiple seeds — and check whether Falcon-2.0's normalized-MASE and WQL leads persist beyond the 0.3–0.9% margins; if the ordering flips or the differences vanish within seed noise, the central claim of leaderboard-leading performance from ORBIT is refuted.
Extended reading notes
Core claim
The central claim is that training-regime design, not architectural sophistication, is what unlocks general zero-shot forecasting in time series foundation models. The evidence is Falcon-2.0: a simple univariate encoder-only Transformer with missingness-aware triple-channel patch tokenization and parallel patch prediction, trained with ORBIT. On GIFT-Eval's 97 dataset–frequency–horizon configurations, it reports the lowest normalized MASE (0.6684, mean rank 7.81) among 29 pretrained models as of July 2026, and on fev-bench it completes all 100 tasks with the best aggregate WQL (0.4842) and near-best MASE (0.6459). The authors attribute these results to ORBIT's explicit control of dataset exposure and its single-stage interleaving of context lengths and prediction horizons, with ablations showing that stochastic sampling and joint context-horizon sampling each contribute sizable gains.
Load-bearing premise
The lead over competing models rests on published leaderboard scores 'as of July 2026' that were computed under other models' evaluation protocols, with margins under one percent and no reported error bars or significance tests.
Editorial extensions
If this is right
- Training-distribution design becomes a first-class axis of time series foundation model development: controlling dataset exposure, context length, and horizon coverage is as consequential as model scale or architecture.
- Deterministic sliding-window enumeration is suboptimal; stochastic bootstrap sampling across records, variables, windows, and horizons improves both point and probabilistic metrics on GIFT-Eval and fev-bench.
- Short and long contexts and horizons can be learned in a single training stage, eliminating the need for separate context-extension or horizon-specific training phases.
- A simple, architecture-unassuming encoder-only Transformer trained under ORBIT is competitive with or better than much larger or more specialized models on zero-shot benchmarks.
- Cross-depth representation alignment can regularize a Transformer without adding inference cost, since the teacher is a stop-gradient deep layer of the same network.
Reading between the lines
- Extension: if ORBIT's gains hold under standardized re-evaluation, the same sampling machinery should transfer to other backbones, including decoder-only and multivariate models, and to other domains facing heterogeneous data budgets.
- Extension: the reported leaderboard margins are small (0.6684 vs 0.6744 on GIFT-Eval; WQL 0.4842 vs the next best) and are compared against scores produced under other models' protocols, so a direct head-to-head with identical context windows, preprocessing, and seeds could shrink or flip the lead.
- Extension: a natural testable variant is to replace ORBIT's uniform record and variable selection with quality- or difficulty-weighted selection; if the gains persist, the mechanism is diversity itself, and if they grow, the sampling rule can be tuned further.
- Extension: the spectral-transfer guarantee suggests a diagnostic for other models — measure the epsilon-numerical rank gap between shallow and deep layers during training; if cross-depth alignment keeps that gap small, the same regularizer should generalize beyond forecasting.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces ORBIT (Omni-Range Bootstrap Incremental Training), a training regime for time series foundation models that combines Bootstrap Multi-Level Sampling with Omni-Range Incremental Training to control the effective pre-training distribution over datasets, records, variables, context windows, and prediction horizons. Under ORBIT the authors train Falcon-2.0, a deliberately simple univariate encoder-only Transformer with missingness-aware triple-channel patch tokenization and parallel patch prediction, and add Rank-Guided Cross-Depth Alignment, a training-only auxiliary objective. The paper reports zero-shot results on GIFT-Eval and fev-bench, claiming the lowest normalized MASE on GIFT-Eval among 29 pretrained models and the best aggregate WQL on fev-bench, and includes ablations of the sampling scheme and of architectural components.
Significance. If the results hold, the paper provides a useful demonstration that training-distribution design is a first-order factor in time series foundation model performance, not merely a detail subordinate to architecture. The ORBIT construction is specified precisely enough to be reproduced, and the controlled comparison of Bootstrap Stochastic Sampling with sliding-window enumeration is a meaningful methodological contribution. The spectral alignment analysis in Section 3.4 is internally consistent and the perturbation bound is derived rather than assumed. The significance is moderated, however, by the absence of an ablation of the auxiliary alignment loss, by unverified spectral diagnostics for the claimed mechanism, and by inconsistencies among the reported final-checkpoint numbers.
major comments (3)
- [Section 6.2 vs. Figure 10] The paper reports conflicting final-checkpoint numbers. Section 6.2 and Figures 4-5 give GIFT-Eval MASE 0.6684 and fev-bench MASE 0.6459, while Figure 10(b)-(c) reports final MASE 0.661 and 0.635 (and CRPS 0.476, WQL 0.477) against Section 6.2's CRPS 0.4843 and WQL 0.4842. Figure 11 confirms 0.6684/0.4843 and 0.6459/0.4842. Because Section 6.3.1's scaling claims are quantified from Figure 10, the authors must reconcile these numbers and state which set is the official evaluation result.
- [Section 3.4, Eq. (24); Section 5.2; Section 6.4.2] The auxiliary cross-depth alignment loss is unablated. Every reported run, including the ORBIT sampling ablations and the scaling curves, is trained with L_total = L_pin + λ_align·L_align and λ_align = 10.0, and no λ_align = 0 variant is shown. The internal comparisons among sampling strategies hold λ_align fixed, so those relative conclusions are meaningful; however, the central attribution that ORBIT's sampling regime unlocks Falcon-2.0's leaderboard advantage over external baselines is confounded by the auxiliary objective, since the external baselines do not use this loss. Moreover, the theoretical claim in Eq. (18) is conditional on small alignment error and a spectral separation condition, yet the paper reports neither the achieved L_align values nor the spectral gap on trained representations. Please add a λ_align = 0 control under otherwise identical ORBIT training and report the achieved alignment loss and spectral diagnostics.
- [Section 6.2, Figures 4-5] The state-of-the-art claims rest on leaderboard results 'as of July 2026' without evidence that the evaluation protocols (context length, preprocessing, seeds, evaluation windows) match Falcon-2.0's protocol. The reported margins are small: 0.9% on GIFT-Eval MASE (0.6684 vs. 0.6744) and 0.3% on fev-bench MASE (0.6459 vs. 0.6438), with no error bars or significance tests. I ask the authors to rerun the closest baselines with the exact Falcon-2.0 evaluation pipeline or report variance across seeds and repeated evaluations, and to temper claims such as 'strongest point-forecasting result' and 'Pareto-frontier' until protocol-matched evidence is available.
minor comments (5)
- [References] The citation '(Hu et al.)' in Section 1 has no year, and the bibliographic entry for 'The landscape of agentic time series systems: Architectures, reliability, and frontiers' is incomplete (no year or venue). Please complete this reference.
- [Figure 3] The label '𝒓𝒎𝒗𝒎𝒔𝒎𝒆𝒎𝒑𝒎' in Figure 3 is garbled; it should display the five-tuple (r_m, v_m, s_m, e_m, p_m) described in Definition 4.1.
- [Section 5.2] The phrase 'matching the single-pass horizon H1 = M×P_out = 6 × 16 = 96 from Section 3.2.3' uses undefined notation P_out and M; it should refer to T_max = M_max · P = 96 from Section 3.7.
- [Figure 10] The annotations in Figure 10 use a different number of decimal places than the tables and the main text (0.661 vs. 0.6684; 0.635 vs. 0.6459). After reconciling the underlying data, please use a single precision convention throughout the figure and text.
- [Appendix A.2] In Table 6, the notation 'W-THU', 'W-FRI', and 'W-WED' for weekly frequencies is not defined in the frequency alias list; please add these aliases to the table footnote.
Circularity Check
No significant circularity: benchmark comparisons and ablations are externally grounded, and the alignment analysis is a derived bound rather than an assumed conclusion.
full rationale
Falcon-2.0's central claims are tested against external benchmarks (GIFT-Eval and fev-bench) with fixed evaluation protocols, and the ORBIT ablations compare sampling rules and context/horizon sampling under matched training budgets, so the main attribution is not manufactured from a fitted parameter. The Rank-Guided Cross-Depth Alignment analysis is an actual derivation: Eq. (15) follows from row normalization, Eqs. (16)-(19) are standard norm and singular-value perturbation inequalities, and Eq. (20) is a chordal-distance identity; these are derived, not assumed. The only overlapping self-citation (TimeAlign, Hu et al. 2025b) is used as inspiration for the stop-gradient optimization and is explicitly adapted, with both representations coming from different depths of the same encoder rather than from a separate future-observing branch, and the paper does not rely on TimeAlign's results as evidence. The unablated lambda_align=10.0 auxiliary loss is a potential confound for the ORBIT attribution, but a missing ablation is an experimental-control concern, not circularity: no benchmark number or ablation outcome is definitionally equal to the sampling-pipeline input. No fitted constant is renamed as a prediction, and no uniqueness theorem or prior result by the same authors is invoked to forbid alternatives. Therefore the derivation chain is self-contained.
Assumptions & free parameters
free parameters (4)
- lambda_align =
10.0
- domain-aware dataset weights =
not reported
- pmin, pmax =
16, 96
- alignment blocks (l_sh, l_dp) =
(1, 31)
assumptions (5)
- standard math Weyl's singular-value perturbation bound and Stewart-Sun perturbation theory
- domain assumption Flow of ranks: deeper layers have broader non-negligible singular spectra (Yu et al., 2026)
- domain assumption Pre-training corpus is disjoint from GIFT-Eval and fev-bench evaluation data
- domain assumption Leaderboard comparisons are commensurable across models and protocols
- domain assumption The prescribed domain-aware weights are set without fitting to the benchmarks
Cite this review
Pith. "Pith review of Into the ORBIT for Time Series: Training Regimes for Foundation Models." pith.science (2026). https://pith.science/paper/FHXQPRZW
@misc{pith2026260813262,
author = {Pith},
title = {Pith review of: Into the ORBIT for Time Series: Training Regimes for Foundation Models},
year = {2026},
howpublished = {\url{https://pith.science/paper/FHXQPRZW}},
note = {Machine review of arXiv:2608.13262}
}
read the original abstract
Time series foundation models (TSFMs) have advanced primarily through architectural innovation, while training regimes for large-scale heterogeneous corpora remain under-explored. As a result, pre-training distributions are often poorly controlled with respect to domain imbalance, context requirements, prediction horizons, and missingness. We introduce ORBIT (Omni-Range Bootstrap Incremental Training), a training paradigm that makes this distribution explicit and controllable. ORBIT combines Bootstrap Multi-Level Sampling, which controls dataset exposure and samples records, target variables, context windows, and prediction horizons, with Omni-Range Incremental Training, which varies context lengths and prediction horizons throughout a single training stage. Under ORBIT, we train Falcon-2.0, a simple univariate encoder-only Transformer with missingness-aware triple-channel patch tokenization and parallel patch prediction. We further introduce Rank-Guided Cross-Depth Alignment, a training objective that uses late-layer representations as stop-gradient teachers for shallow layers without additional inference cost. Evaluations on GIFT-Eval and fev-bench demonstrate strong zero-shot forecasting performance across diverse domains and frequencies.
Reference graph
Works this paper leans on
-
[3]
Proceedings of the 41st International Conference on Machine Learning , articleno =
Das, Abhimanyu and Kong, Weihao and Sen, Rajat and Zhou, Yichen , title =. Proceedings of the 41st International Conference on Machine Learning , articleno =. 2024 , publisher =
2024
-
[4]
Proceedings of the 41st International Conference on Machine Learning , articleno =
Woo, Gerald and Liu, Chenghao and Kumar, Akshat and Xiong, Caiming and Savarese, Silvio and Sahoo, Doyen , title =. Proceedings of the 41st International Conference on Machine Learning , articleno =. 2024 , publisher =
2024
-
[6]
IEEE Transactions on Knowledge and Data Engineering , volume=
Exploring progress in multivariate time series forecasting: Comprehensive benchmarking and heterogeneity analysis , author=. IEEE Transactions on Knowledge and Data Engineering , volume=. 2024 , publisher=
2024
-
[7]
Proceedings of the 19th International Symposium on Spatial and Temporal Data , pages=
Heterogeneity in Multivariate Time Series: Comprehensive Analysis and Adaptive Modeling , author=. Proceedings of the 19th International Symposium on Spatial and Temporal Data , pages=
-
[8]
Advances in neural information processing systems , volume=
Self-supervised contrastive pre-training for time series via time-frequency consistency , author=. Advances in neural information processing systems , volume=
-
[9]
Proceedings of the 33rd ACM International Conference on Information and Knowledge Management , pages=
Time is not enough: Time-frequency based explanation for time-series black-box models , author=. Proceedings of the 33rd ACM International Conference on Information and Knowledge Management , pages=
-
[10]
International conference on machine learning , pages=
Fedformer: Frequency enhanced decomposed transformer for long-term series forecasting , author=. International conference on machine learning , pages=. 2022 , organization=
2022
-
[11]
Scientific reports , volume=
Recurrent neural networks for multivariate time series with missing values , author=. Scientific reports , volume=. 2018 , publisher=
2018
Show all 155 references
-
[12]
Proceedings of the AAAI Conference on Artificial Intelligence , volume=
Adaptive multi-scale decomposition framework for time series forecasting , author=. Proceedings of the AAAI Conference on Artificial Intelligence , volume=
-
[20]
Goswami, Mononito and Szafer, Konrad and Choudhry, Arjun and Cai, Yifu and Li, Shuo and Dubrawski, Artur , booktitle=. M
-
[21]
Proceedings of the 41st International Conference on Machine Learning , articleno =
Liu, Yong and Zhang, Haoran and Li, Chenyu and Huang, Xiangdong and Wang, Jianmin and Long, Mingsheng , title =. Proceedings of the 41st International Conference on Machine Learning , articleno =. 2024 , publisher =
2024
-
[22]
Yong Liu and Guo Qin and Xiangdong Huang and Jianmin Wang and Mingsheng Long , booktitle=. Timer-. 2025 , url=
2025
-
[23]
Forty-third International Conference on Machine Learning Position Paper Track , year=
Position: Time-Series Foundation Models Require Explicit Domain-Level Benchmarks , author=. Forty-third International Conference on Machine Learning Position Paper Track , year=
-
[24]
Proceedings of the 32nd ACM International Conference on Information and Knowledge Management , pages=
Toward a foundation model for time series data , author=. Proceedings of the 32nd ACM International Conference on Information and Knowledge Management , pages=
-
[25]
The Fourteenth International Conference on Learning Representations , year=
Understanding Transformers for Time Series: Rank Structure, Flow-of-ranks, and Compressibility , author=. The Fourteenth International Conference on Learning Representations , year=
-
[26]
Forty-second International Conference on Machine Learning , year=
Sundial: A Family of Highly Capable Time Series Foundation Models , author=. Forty-second International Conference on Machine Learning , year=
-
[27]
The Thirteenth International Conference on Learning Representations , year=
Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Experts , author=. The Thirteenth International Conference on Learning Representations , year=
-
[28]
The Thirty-ninth Annual Conference on Neural Information Processing Systems , year=
TiRex: Zero-Shot Forecasting Across Long and Short Horizons with Enhanced In-Context Learning , author=. The Thirty-ninth Annual Conference on Neural Information Processing Systems , year=
-
[29]
Gifford and Chandra Reddy and Jayant Kalagnanam , booktitle=
Vijay Ekambaram and Arindam Jati and Pankaj Dayama and Sumanta Mukherjee and Nam H Nguyen and Wesley M. Gifford and Chandra Reddy and Jayant Kalagnanam , booktitle=. Tiny Time Mixers (. 2024 , url=
2024
-
[30]
2026 , url=
Cheng HE and Xu Huang and Gangwei Jiang and Zhaoyi Li and Defu Lian and Hong Xie and Enhong Chen and xijie liang and Zhengzengrong and Patrick Lee , booktitle=. 2026 , url=
2026
-
[31]
Yihang Wang and Yuying Qiu and Peng Chen and Yang Shu and Zhongwen Rao and Lujia Pan and Bin Yang and Chenjuan Guo , booktitle=. Light. 2025 , url=
2025
-
[32]
Proceedings of the 41st International Conference on Machine Learning , articleno =
Goswami, Mononito and Szafer, Konrad and Choudhry, Arjun and Cai, Yifu and Li, Shuo and Dubrawski, Artur , title =. Proceedings of the 41st International Conference on Machine Learning , articleno =. 2024 , publisher =
2024
-
[33]
arXiv preprint arXiv:2602.06909 , year=
Revisiting the Generic Transformer: Deconstructing a Strong Baseline for Time Series Foundation Models , author=. arXiv preprint arXiv:2602.06909 , year=
-
[35]
International Conference on Learning Representations , year =
A Time Series is Worth 64 Words: Long-term Forecasting with Transformers , author =. International Conference on Learning Representations , year =
-
[36]
and Kaiser,
Vaswani, Ashish and Shazeer, Noam and Parmar, Niki and Uszkoreit, Jakob and Jones, Llion and Gomez, Aidan N. and Kaiser,. Attention is all you need , year =. Proceedings of the 31st International Conference on Neural Information Processing Systems , pages =
-
[37]
International Conference on Learning Representations (ICLR) , year=
iTransformer: Inverted transformers are effective for time series forecasting , author=. International Conference on Learning Representations (ICLR) , year=
-
[38]
International Conference on Learning Representations (ICLR) , year=
Crossformer: Transformer utilizing cross-dimension dependency for multivariate time series forecasting , author=. International Conference on Learning Representations (ICLR) , year=
-
[39]
AAAI , year=
Informer: Beyond efficient transformer for long sequence time-series forecasting , author=. AAAI , year=
-
[40]
International Conference on Learning Representations (ICLR) , year=
TimesNet: Temporal 2D-variation modeling for general time series analysis , author=. International Conference on Learning Representations (ICLR) , year=
-
[41]
International Journal of Forecasting , volume=
DeepAR: Probabilistic forecasting with autoregressive recurrent networks , author=. International Journal of Forecasting , volume=
-
[42]
International Journal of Forecasting , volume=
Temporal fusion transformers for interpretable multi-horizon time series forecasting , author=. International Journal of Forecasting , volume=
-
[43]
International Conference on Learning Representations , year=
Reversible Instance Normalization for Accurate Time-Series Forecasting against Distribution Shift , author=. International Conference on Learning Representations , year=
-
[44]
Neurocomputing , volume=
Roformer: Enhanced transformer with rotary position embedding , author=. Neurocomputing , volume=. 2024 , publisher=
2024
-
[46]
Long-term Forecasting with Ti
Abhimanyu Das and Weihao Kong and Andrew Leach and Shaan K Mathur and Rajat Sen and Rose Yu , journal=. Long-term Forecasting with Ti. 2023 , url=
2023
-
[47]
International conference on machine learning , pages=
On layer normalization in the transformer architecture , author=. International conference on machine learning , pages=. 2020 , organization=
2020
-
[48]
The Thirty-ninth Annual Conference on Neural Information Processing Systems , year=
Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free , author=. The Thirty-ninth Annual Conference on Neural Information Processing Systems , year=
-
[49]
Journal of economic perspectives , volume=
Quantile regression , author=. Journal of economic perspectives , volume=. 2001 , publisher=
2001
-
[51]
arXiv preprint arXiv:2001.08361 , year=
Scaling laws for neural language models , author=. arXiv preprint arXiv:2001.08361 , year=
2001 arXiv
-
[53]
International Conference on Machine Learning , pages=
TimeFilter: Patch-Specific Spatial-Temporal Graph Filtration for Time Series Forecasting , author=. International Conference on Machine Learning , pages=. 2025 , organization=
2025
-
[55]
The Landscape of Agentic Time Series Systems: Architectures, Reliability, and Frontiers , author=
-
[57]
2019 , publisher=
Statistical Analysis with Missing Data , author=. 2019 , publisher=
2019
-
[58]
Thirty-seventh Conference on Neural Information Processing Systems Datasets and Benchmarks Track , year=
ClimateLearn: Benchmarking Machine Learning for Weather and Climate Modeling , author=. Thirty-seventh Conference on Neural Information Processing Systems Datasets and Benchmarks Track , year=
-
[59]
Xue, Siqiao and Zhu, Zhaoyang and Zhang, Wei and Cai, Rongyao and Wang, Rui and Mu, Yixiang and Zhou, Fan and Li, Jianguo and Di, Peng and Yu, Hang , journal=. Quito
-
[60]
Spyros Makridakis and Evangelos Spiliotis and Vassilios Assimakopoulos , journal=. The
-
[61]
Neural Information Processing Systems , year=
Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting , author=. Neural Information Processing Systems , year=
-
[62]
AutoMixer for Improved Multivariate Time-Series Forecasting on Business and IT Observability Data , volume =
Palaskar, Santosh and Ekambaram, Vijay and Jati, Arindam and Gantayat, Neelamadhav and Saha, Avirup and Nagar, Seema and Nguyen, Nam and Dayama, Pankaj and Sindhgatta, Renuka and Mohapatra, Prateeti and Kumar, Harshit and Kalagnanam, Jayant and Hemachandra, Nandyala and Rangar...
-
[63]
IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing , pages=
Statistical characterization of business-critical workloads hosted in cloud datacenters , author=. IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing , pages=. 2015 , organization=
2015
-
[64]
2017 , note =
Addison Howard and Haruka Yui and Mark McDonald and Will Cukierski , title =. 2017 , note =
2017
-
[65]
Expert Systems with Applications , volume=
A machine learning approach for forecasting hierarchical time series , author=. Expert Systems with Applications , volume=. 2021 , publisher=
2021
-
[66]
2015 , howpublished =
Trindade, Artur , title =. 2015 , howpublished =
2015
-
[68]
The International ACM SIGIR Conference on Research & Development in Information Retrieval , year=
Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networks , author=. The International ACM SIGIR Conference on Research & Development in Information Retrieval , year=
-
[69]
The Conference on Neural Information Processing Systems Datasets and Benchmarks Track , year=
Monash Time Series Forecasting Archive , author=. The Conference on Neural Information Processing Systems Datasets and Benchmarks Track , year=
-
[71]
Aksu, Taha and Woo, Gerald and Liu, Juncheng and Liu, Xu and Liu, Chenghao and Savarese, Silvio and Xiong, Caiming and Sahoo, Doyen , journal=. Gift-
-
[74]
Forecasting using sparse cointegration , journal =
Ines Wilms and Christophe Croux , keywords =. Forecasting using sparse cointegration , journal =. 2016 , issn =. doi:https://doi.org/10.1016/j.ijforecast.2016.04.005 , url =
2016 doi
-
[75]
and Hyndman, Rob J
Athanasopoulos, George and Ahmed, Roman A. and Hyndman, Rob J. , year=. Hierarchical forecasts for. International Journal of Forecasting , publisher=. doi:10.1016/j.ijforecast.2008.07.004 , number=
2008 doi
-
[78]
2025 , note =
Ulrik Thyge Pedersen , title =. 2025 , note =
2025
-
[79]
2025 , note =
Nafay Un Noor , title =. 2025 , note =
2025
-
[80]
2025 , note =
Bushra Qurban , title =. 2025 , note =
2025
-
[81]
2025 , note =
AI Maverick , title =. 2025 , note =
2025
-
[82]
2020 , note =
lexis Cook and DanB and inversion and Ryan Holbrook , title =. 2020 , note =
2020
-
[83]
2015 , howpublished =
FlorianKnauer and Will Cukierski , title =. 2015 , howpublished =
2015
-
[84]
2014 , howpublished =
Walmart Competition Admin and Will Cukierski , title =. 2014 , howpublished =
2014
-
[85]
2024 , howpublished =
MichalKecera , title =. 2024 , howpublished =
2024
-
[86]
2022 , howpublished =
2022
-
[87]
Christiano and Martin Eichenbaum and Charles L
Lawrence J. Christiano and Martin Eichenbaum and Charles L. Evans , keywords =. Monetary policy shocks: What have we learned and to what end? , series =. Handbook of Macroeconomics , volume =. 1999 , issn =. doi:https://doi.org/10.1016/S1574-0048(99)01005-8 , url =
1999 doi
-
[88]
Communications of the ACM , volume=
How not to lie with statistics: the correct way to summarize benchmark results , author=. Communications of the ACM , volume=. 1986 , publisher=
1986
-
[89]
Transactions on Machine Learning Research , year=
Chronos: Learning the Language of Time Series , author=. Transactions on Machine Learning Research , year=
-
[90]
Version 2020-10-06 , author=
Data Package Time series. Version 2020-10-06 , author=. 2020 , note=
2020
-
[91]
Nature Energy , year =
Staffell, Iain and Pfenninger, Stefan and Johnson, Nathan , title =. Nature Energy , year =. doi:10.1038/s41560-023-01341-5 , url =
-
[92]
Advances in neural information processing systems , volume=
This time is different: An observability perspective on time series foundation models , author=. Advances in neural information processing systems , volume=
-
[96]
International Journal of Forecasting , volume=
Global energy forecasting competition 2012 , author=. International Journal of Forecasting , volume=. 2014 , publisher=
2012
-
[97]
2025 , note=
Respiratory Viruses Weekly Data , author=. 2025 , note=
2025
-
[98]
David, Etienne and Bellot, Jean and Corff, Sylvain Le , journal=. H
-
[102]
Matrix perturbation theory , author=. , year=
-
[103]
Walmart recruiting - store sales forecasting
Walmart Competition Admin and Will Cukierski. Walmart recruiting - store sales forecasting. https://kaggle.com/competitions/walmart-recruiting-store-sales-forecasting, 2014. Kaggle
2014
-
[105]
Gift-eval: A benchmark for general time series forecasting model evaluation
Taha Aksu, Gerald Woo, Juncheng Liu, Xu Liu, Chenghao Liu, Silvio Savarese, Caiming Xiong, and Doyen Sahoo. Gift-eval: A benchmark for general time series forecasting model evaluation. arXiv preprint arXiv:2410.10393, 2024 b
2024 arXiv
-
[106]
Chronos: Learning the language of time series
Abdul Fatir Ansari, Lorenzo Stella, Caner Turkmen, Xiyuan Zhang, Pedro Mercado, Huibin Shen, Oleksandr Shchur, Syama Sundar Rangapuram, Sebastian Pineda Arango, Shubham Kapoor, et al. Chronos: Learning the language of time series. Transactions on Machine Learning Research, 2024
2024
-
[107]
Chronos-2: From univariate to universal forecasting
Abdul Fatir Ansari, Oleksandr Shchur, Jaris K \"u ken, Andreas Auer, Boran Han, Pedro Mercado, Syama Sundar Rangapuram, Huibin Shen, Lorenzo Stella, Xiyuan Zhang, et al. Chronos-2: From univariate to universal forecasting. arXiv preprint arXiv:2510.15821, 2025
-
[108]
o ck, G \
Andreas Auer, Patrick Podest, Daniel Klotz, Sebastian B \"o ck, G \"u nter Klambauer, and Sepp Hochreiter. Tirex: Zero-shot forecasting across long and short horizons with enhanced in-context learning. In The Thirty-ninth Annual Conference on Neural Information Processing Syst...
2026
-
[109]
Recurrent neural networks for multivariate time series with missing values
Zhengping Che, Sanjay Purushotham, Kyunghyun Cho, David Sontag, and Yan Liu. Recurrent neural networks for multivariate time series with missing values. Scientific reports, 8 0 (1): 0 6085, 2018
2018
-
[110]
Time is not enough: Time-frequency based explanation for time-series black-box models
Hyunseung Chung, Sumin Jo, Yeonsu Kwon, and Edward Choi. Time is not enough: Time-frequency based explanation for time-series black-box models. In Proceedings of the 33rd ACM International Conference on Information and Knowledge Management, pages 394--403, 2024
2024
-
[111]
This time is different: An observability perspective on time series foundation models
Ben Cohen, Emaad Khwaja, Youssef Doubli, Salahidine Lemaachi, Chris Lettieri, Charles Masson, Hugo Miccinilli, Elise Ram \'e , Qiqi Ren, Afshin Rostamizadeh, et al. This time is different: An observability perspective on time series foundation models. Advances in neural inform...
2026
-
[112]
A decoder-only foundation model for time-series forecasting
Abhimanyu Das, Weihao Kong, Rajat Sen, and Yichen Zhou. A decoder-only foundation model for time-series forecasting. In Proceedings of the 41st International Conference on Machine Learning, ICML'24. JMLR.org, 2024
2024
-
[113]
Data package time series
Open Power System Data. Data package time series. version 2020-10-06, 2020. https://doi.org/10.25832/time_series/2020-10-06
2020 doi
-
[114]
UK COVID-19 dashboard data
UK COVID-19 data from official UK government sources. UK COVID-19 dashboard data. https://www.kaggle.com/datasets/happyadam73/uk-covid19-dashboard-data-sqlite-compressed, 2022. Kaggle
2022
-
[115]
H ERMES : Hybrid error-corrector model with inclusion of external signals for nonstationary fashion time series
Etienne David, Jean Bellot, and Sylvain Le Corff. H ERMES : Hybrid error-corrector model with inclusion of external signals for nonstationary fashion time series. arXiv preprint arXiv:2202.03224, 2022
2022 arXiv
-
[116]
De Vito , E
S. De Vito , E. Massera, M. Piga, L. Martinotto, and G. Di Francia . On field calibration of an electronic nose for benzene estimation in an urban pollution monitoring scenario. Sensors and Actuators B: Chemical, 129 0 (2): 0 750--757, 2008. ISSN 0925-4005. doi:https://doi.org...
2008 doi
-
[117]
Respiratory viruses weekly data
ECDC . Respiratory viruses weekly data. https://github.com/EU-ECDC/Respiratory_viruses_weekly_data/tree/main, 2025. Open data repository; weekly respiratory virus surveillance in the EU/EEA
2025
-
[118]
Gifford, Chandra Reddy, and Jayant Kalagnanam
Vijay Ekambaram, Arindam Jati, Pankaj Dayama, Sumanta Mukherjee, Nam H Nguyen, Wesley M. Gifford, Chandra Reddy, and Jayant Kalagnanam. Tiny time mixers ( TTM s): Fast pre-trained models for enhanced zero/few-shot forecasting of multivariate time series. In The Thirty-eighth A...
2024
-
[119]
How not to lie with statistics: the correct way to summarize benchmark results
Philip J Fleming and John J Wallace. How not to lie with statistics: the correct way to summarize benchmark results. Communications of the ACM, 29 0 (3): 0 218--221, 1986
1986
-
[120]
Rossmann store sales
FlorianKnauer and Will Cukierski. Rossmann store sales. https://kaggle.com/competitions/rossmann-store-sales, 2015. Kaggle
2015
-
[121]
Webb, Rob Hyndman, and Pablo Montero-Manso
Rakshitha Wathsadini Godahewa, Christoph Bergmeir, Geoffrey I. Webb, Rob Hyndman, and Pablo Montero-Manso. Monash time series forecasting archive. In The Conference on Neural Information Processing Systems Datasets and Benchmarks Track, 2021. https://openreview.net/forum?id=wEc1mgAjU-
2021
-
[122]
Moment: a family of open time-series foundation models
Mononito Goswami, Konrad Szafer, Arjun Choudhry, Yifu Cai, Shuo Li, and Artur Dubrawski. Moment: a family of open time-series foundation models. In Proceedings of the 41st International Conference on Machine Learning, ICML'24. JMLR.org, 2024 a
2024
-
[123]
M OMENT : A family of open time-series foundation models
Mononito Goswami, Konrad Szafer, Arjun Choudhry, Yifu Cai, Shuo Li, and Artur Dubrawski. M OMENT : A family of open time-series foundation models. In International Conference on Machine Learning, 2024 b
2024
-
[124]
o ge, Oscar Key, Felix Birkel, Philipp Jund, Brendan Roof, Mihir Manium, Shi Bin Hoo, Magnus B \
L \'e o Grinsztajn, Klemens Fl \"o ge, Oscar Key, Felix Birkel, Philipp Jund, Brendan Roof, Mihir Manium, Shi Bin Hoo, Magnus B \"u hler, Anurag Garg, et al. Tabpfn-3: Technical report. arXiv preprint arXiv:2605.13986, 2026
2026 arXiv
-
[125]
GTM : A general time-series model for enhanced representation learning of time-series data
Cheng HE, Xu Huang, Gangwei Jiang, Zhaoyi Li, Defu Lian, Hong Xie, Enhong Chen, xijie liang, Zhengzengrong, and Patrick Lee. GTM : A general time-series model for enhanced representation learning of time-series data. In The Fourteenth International Conference on Learning Repre...
2026
-
[126]
Global energy forecasting competition 2012
Tao Hong, Pierre Pinson, and Shu Fan. Global energy forecasting competition 2012. International Journal of Forecasting, 30 0 (2): 0 357--363, 2014
2012
-
[127]
From tables to time: Extending tabpfn-v2 to time series forecasting
Shi Bin Hoo, Samuel M \"u ller, David Salinas, and Frank Hutter. From tables to time: Extending tabpfn-v2 to time series forecasting. arXiv preprint arXiv:2501.02945, 2025
2025
-
[128]
Recruit restaurant visitor forecasting
Addison Howard, Haruka Yui, Mark McDonald, and Will Cukierski. Recruit restaurant visitor forecasting. https://kaggle.com/competitions/recruit-restaurant-visitor-forecasting, 2017. Kaggle
2017
-
[129]
The landscape of agentic time series systems: Architectures, reliability, and frontiers
Yifan Hu, Jie Yang, Xilin Dai, Wanxu Cai, Kuiye Ding, Yuante Li, Qinghua Liu, Enze Ma, Zhiyuan Qu, Yixin Wang, et al. The landscape of agentic time series systems: Architectures, reliability, and frontiers
-
[130]
Adaptive multi-scale decomposition framework for time series forecasting
Yifan Hu, Peiyuan Liu, Peng Zhu, Dawei Cheng, and Tao Dai. Adaptive multi-scale decomposition framework for time series forecasting. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 39, pages 17359--17367, 2025 a
2025
-
[131]
Bridging past and future: Distribution-aware alignment for time series forecasting
Yifan Hu, Jie Yang, Tian Zhou, Peiyuan Liu, Yujin Tang, Rong Jin, and Liang Sun. Bridging past and future: Distribution-aware alignment for time series forecasting. arXiv preprint arXiv:2509.14181, 2025 b
2025
-
[132]
Timefilter: Patch-specific spatial-temporal graph filtration for time series forecasting
Yifan Hu, Guibin Zhang, Peiyuan Liu, Disen Lan, Naiqi Li, Dawei Cheng, Tao Dai, Shu-Tao Xia, and Shirui Pan. Timefilter: Patch-specific spatial-temporal graph filtration for time series forecasting. In International Conference on Machine Learning, pages 24893--24911. PMLR, 2025 c
2025
-
[133]
Existence precedes value: Joint modeling of observational existence and evolving states in time series forecasting
Yifan Hu, Hongzhou Chen, Peiyuan Liu, Yiding Liu, Zewei Dong, and Jiang-Ming Yang. Existence precedes value: Joint modeling of observational existence and evolving states in time series forecasting. arXiv preprint arXiv:2606.13571, 2026
2026 arXiv
-
[134]
No other representation component is needed: Diffusion transformers can provide representation guidance by themselves
Dengyang Jiang, Mengmeng Wang, Liuzhuozheng Li, Lei Zhang, Haoyu Wang, Wei Wei, Guang Dai, Yanning Zhang, and Jingdong Wang. No other representation component is needed: Diffusion transformers can provide representation guidance by themselves. arXiv preprint arXiv:2505.02831, 2025
2025
-
[135]
Toto 2.0: Time series forecasting enters the scaling era
Emaad Khwaja, Chris Lettieri, Gerald Woo, Eden Belouadah, Marc Cenac, Guillaume Jarry, Enguerrand Paquin, Xunyi Zhao, Viktoriya Zhukov, Othmane Abou-Amal, et al. Toto 2.0: Time series forecasting enters the scaling era. arXiv preprint arXiv:2605.20119, 2026
2026 arXiv
-
[136]
Reversible instance normalization for accurate time-series forecasting against distribution shift
Taesung Kim, Jinhee Kim, Yunwon Tae, Cheonbok Park, Jang-Ho Choi, and Jaegul Choo. Reversible instance normalization for accurate time-series forecasting against distribution shift. In International Conference on Learning Representations, 2022. https://openreview.net/forum?id=...
2022
-
[137]
Quantile regression
Roger Koenker and Kevin F Hallock. Quantile regression. Journal of economic perspectives, 15 0 (4): 0 143--156, 2001
2001
-
[138]
Foundation models for time series: A survey
Siva Rama Krishna Kottapalli, Karthik Hubli, Sandeep Chandrashekhara, Garima Jain, Sunayana Hubli, Gayathri Botla, and Ramesh Doddaiah. Foundation models for time series: A survey. arXiv preprint arXiv:2504.04011, 2025
2025 arXiv
-
[139]
Modeling long- and short-term temporal patterns with deep neural networks
Guokun Lai, Wei-Cheng Chang, Yiming Yang, and Hanxiao Liu. Modeling long- and short-term temporal patterns with deep neural networks. In The International ACM SIGIR Conference on Research & Development in Information Retrieval, 2017. https://api.semanticscholar.org/CorpusID:4922476
2017
-
[140]
Store sales -- time series forecasting
lexis Cook, DanB, inversion, and Ryan Holbrook. Store sales -- time series forecasting. https://www.kaggle.com/competitions/store-sales-time-series-forecasting, 2020. Kaggle
2020
-
[141]
Foundation models for time series analysis: A tutorial and survey
Yuxuan Liang, Haomin Wen, Yuqi Nie, Yushan Jiang, Ming Jin, Dongjin Song, Shirui Pan, and Qingsong Wen. Foundation models for time series analysis: A tutorial and survey. In Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, KDD ’24, page 655...
2024
-
[142]
Temporal fusion transformers for interpretable multi-horizon time series forecasting
Bryan Lim, Sercan \"O Ar k, Nicolas Loeff, and Tomas Pfister. Temporal fusion transformers for interpretable multi-horizon time series forecasting. International Journal of Forecasting, 37 0 (4): 0 1748--1764, 2021
2021
-
[143]
Moirai 2.0: When less is more for time series forecasting
Chenghao Liu, Taha Aksu, Juncheng Liu, Xu Liu, Hanshu Yan, Quang Pham, Silvio Savarese, Doyen Sahoo, Caiming Xiong, and Junnan Li. Moirai 2.0: When less is more for time series forecasting. arXiv preprint arXiv:2511.11698, 2025 a
2025
-
[144]
Falcon-x: A time series foundation model for heterogeneous multivariate modeling
Yiding Liu, Yifan Hu, Hongjie Xia, Peiyuan Liu, Hongzhou Chen, Xilin Dai, Zewei Dong, and Jiang-Ming Yang. Falcon-x: A time series foundation model for heterogeneous multivariate modeling. arXiv preprint arXiv:2605.27286, 2026 a
2026 arXiv
-
[145]
itransformer: Inverted transformers are effective for time series forecasting
Yong Liu, Tengge Hu, Haoran Zhang, Chenyu Wu, Shiyu Wang, Lintao Ma, and Mingsheng Long. itransformer: Inverted transformers are effective for time series forecasting. International Conference on Learning Representations (ICLR), 2024 a
2024
-
[146]
Timer: generative pre-trained transformers are large time series models
Yong Liu, Haoran Zhang, Chenyu Li, Xiangdong Huang, Jianmin Wang, and Mingsheng Long. Timer: generative pre-trained transformers are large time series models. In Proceedings of the 41st International Conference on Machine Learning, ICML'24. JMLR.org, 2024 b
2024
-
[147]
Timer- XL : Long-context transformers for unified time series forecasting
Yong Liu, Guo Qin, Xiangdong Huang, Jianmin Wang, and Mingsheng Long. Timer- XL : Long-context transformers for unified time series forecasting. In The Thirteenth International Conference on Learning Representations, 2025 b . https://openreview.net/forum?id=KMCJXjlDDr
2025
-
[148]
Sundial: A family of highly capable time series foundation models
Yong Liu, Guo Qin, Zhiyuan Shi, Zhi Chen, Caiyin Yang, Xiangdong Huang, Jianmin Wang, and Mingsheng Long. Sundial: A family of highly capable time series foundation models. In Forty-second International Conference on Machine Learning, 2025 c . https://openreview.net/forum?id=L...
2025
-
[149]
Timer-s1: A billion-scale time series foundation model with serial scaling
Yong Liu, Xingjian Su, Shiyu Wang, Haoran Zhang, Haixuan Liu, Yuxuan Wang, Zhou Ye, Yang Xiang, Jianmin Wang, and Mingsheng Long. Timer-s1: A billion-scale time series foundation model with serial scaling. arXiv preprint arXiv:2603.04791, 2026 b
2026 arXiv
-
[150]
Decoupled weight decay regularization
Ilya Loshchilov and Frank Hutter. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101, 2017
2017 arXiv
-
[151]
The M 4 competition: Results, findings, conclusion and way forward
Spyros Makridakis, Evangelos Spiliotis, and Vassilios Assimakopoulos. The M 4 competition: Results, findings, conclusion and way forward. International Journal of Forecasting, 2018
2018
-
[152]
M5 accuracy competition: Results, findings, and conclusions
Spyros Makridakis, Evangelos Spiliotis, and Vassilios Assimakopoulos. M5 accuracy competition: Results, findings, and conclusions. International Journal of Forecasting, 38 0 (4): 0 1346--1364, 2022. ISSN 0169-2070. doi:https://doi.org/10.1016/j.ijforecast.2021.11.013. https://...
2022 doi
-
[153]
A machine learning approach for forecasting hierarchical time series
Paolo Mancuso, Veronica Piccialli, and Antonio M Sudoso. A machine learning approach for forecasting hierarchical time series. Expert Systems with Applications, 182: 0 115102, 2021
2021
-
[154]
McCracken and Serena Ng
Michael W. McCracken and Serena Ng. F RED-MD : A monthly database for macroeconomic research. Journal of Business & Economic Statistics, 34 0 (4): 0 574--589, 2016. doi:10.1080/07350015.2015.1086655. https://doi.org/10.1080/07350015.2015.1086655
2016
-
[155]
McCracken and Serena Ng
Michael W. McCracken and Serena Ng. F RED-QD : A quarterly database for macroeconomic research. Review, 103 0 (1): 0 1--44, January 2021. doi:10.20955/r.103.1-44. https://ideas.repec.org/a/fip/fedlrv/90588.html
2021 doi
-
[156]
Rohlik sales forecasting challenge
MichalKecera. Rohlik sales forecasting challenge. https://kaggle.com/competitions/rohlik-sales-forecasting-challenge-v2, 2024. Kaggle
2024
-
[157]
Compilation, revision and updating of the global var (gvar) database
Kamiar Mohaddes and Mehdi Raissi. Compilation, revision and updating of the global var (gvar) database. Mendeley Data, Version 1, 2024. https://doi.org/10.17632/kfp5fhgkvf.1
2024 doi
-
[158]
Nguyen, Phanwadee Sinthong, and Jayant Kalagnanam
Yuqi Nie, Nam H. Nguyen, Phanwadee Sinthong, and Jayant Kalagnanam. A time series is worth 64 words: Long-term forecasting with transformers. In International Conference on Learning Representations, 2023
2023
-
[159]
Riyadh hospital admissions dataset (2020–2024)
General Directorate of Health Affairs and Saudi Arabia Ministry of Health. Riyadh hospital admissions dataset (2020–2024). https://www.kaggle.com/dsv/9992619, 2024
2020
-
[160]
Automixer for improved multivariate time-series forecasting on business and it observability data
Santosh Palaskar, Vijay Ekambaram, Arindam Jati, Neelamadhav Gantayat, Avirup Saha, Seema Nagar, Nam Nguyen, Pankaj Dayama, Renuka Sindhgatta, Prateeti Mohapatra, Harshit Kumar, Jayant Kalagnanam, Nandyala Hemachandra, and Narayan Rangaraj. Automixer for improved multivariate ...
2024
-
[161]
u rger, Levente Z \'o lyomi, Bernhard Voggenberger, Wilhelm Berghammer, Daniel Klotz, Sebastian B \
Patrick Podest, Marco Pichler, Elias B \"u rger, Levente Z \'o lyomi, Bernhard Voggenberger, Wilhelm Berghammer, Daniel Klotz, Sebastian B \"o ck, G \"u nter Klambauer, and Sepp Hochreiter. Tirex-2: Generalizing tirex to multivariate data and streaming. arXiv preprint arXiv:26...
2026 arXiv
-
[162]
Gated attention for large language models: Non-linearity, sparsity, and attention-sink-free
Zihan Qiu, Zekun Wang, Bo Zheng, Zeyu Huang, Kaiyue Wen, Songlin Yang, Rui Men, Le Yu, Fei Huang, Suozhi Huang, Dayiheng Liu, Jingren Zhou, and Junyang Lin. Gated attention for large language models: Non-linearity, sparsity, and attention-sink-free. In The Thirty-ninth Annual ...
2026
-
[163]
Exploring progress in multivariate time series forecasting: Comprehensive benchmarking and heterogeneity analysis
Zezhi Shao, Fei Wang, Yongjun Xu, Wei Wei, Chengqing Yu, Zhao Zhang, Di Yao, Tao Sun, Guangyin Jin, Xin Cao, et al. Exploring progress in multivariate time series forecasting: Comprehensive benchmarking and heterogeneity analysis. IEEE Transactions on Knowledge and Data Engine...
2024
-
[164]
Heterogeneity in multivariate time series: Comprehensive analysis and adaptive modeling
Zezhi Shao, Chengqing Yu, and Fei Wang. Heterogeneity in multivariate time series: Comprehensive analysis and adaptive modeling. In Proceedings of the 19th International Symposium on Spatial and Temporal Data, pages 76--79, 2025
2025
-
[165]
Glu variants improve transformer
Noam Shazeer. Glu variants improve transformer. arXiv preprint arXiv:2002.05202, 2020
2002 arXiv
-
[166]
fev-bench: A realistic benchmark for time series forecasting
Oleksandr Shchur, Abdul Fatir Ansari, Caner Turkmen, Lorenzo Stella, Nick Erickson, Pablo Guerron, Michael Bohlke-Schneider, and Yuyang Wang. fev-bench: A realistic benchmark for time series forecasting. arXiv preprint arXiv:2509.26468, 2025
2025 arXiv
-
[167]
Statistical characterization of business-critical workloads hosted in cloud datacenters
Siqi Shen, Vincent Van Beek, and Alexandru Iosup. Statistical characterization of business-critical workloads hosted in cloud datacenters. In IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, pages 465--474. IEEE, 2015
2015
-
[168]
Time-moe: Billion-scale time series foundation models with mixture of experts
Xiaoming Shi, Shiyu Wang, Yuqi Nie, Dianqi Li, Zhou Ye, Qingsong Wen, and Ming Jin. Time-moe: Billion-scale time series foundation models with mixture of experts. In The Thirteenth International Conference on Learning Representations, 2025. https://openreview.net/forum?id=e1wDDFmlVu
2025
-
[169]
Megatron-lm: Training multi-billion parameter language models using model parallelism
Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, and Bryan Catanzaro. Megatron-lm: Training multi-billion parameter language models using model parallelism. arXiv preprint arXiv:1909.08053, 2019
1909 arXiv
-
[170]
Matrix perturbation theory
Gilbert W Stewart and Ji-guang Sun. Matrix perturbation theory. 1990
1990
-
[171]
Roformer: Enhanced transformer with rotary position embedding
Jianlin Su, Murtadha Ahmed, Yu Lu, Shengfeng Pan, Wen Bo, and Yunfeng Liu. Roformer: Enhanced transformer with rotary position embedding. Neurocomputing, 568: 0 127063, 2024
2024
-
[172]
Position: Time-series foundation models require explicit domain-level benchmarks
Md Asif Bin Syed, Md Younus Ahamed, and Azmine Toushik Wasi. Position: Time-series foundation models require explicit domain-level benchmarks. In Forty-third International Conference on Machine Learning Position Paper Track, 2026. https://openreview.net/forum?id=W2eEMPjzIQ
2026
-
[173]
ElectricityLoadDiagrams20112014
Artur Trindade. ElectricityLoadDiagrams20112014 . UCI Machine Learning Repository, 2015. DOI : https://doi.org/10.24432/C58C86
2015 doi
-
[174]
Why TPC is not enough: An analysis of the amazon redshift fleet
Alexander van Renen, Dominik Horn, Pascal Pfeil, Kapil Vaidya, Wenjian Dong, Murali Narayanaswamy, Zhengchun Liu, Gaurav Saxena, Andreas Kipf, and Tim Kraska. Why TPC is not enough: An analysis of the amazon redshift fleet. Proc. VLDB Endow., 17 0 (11): 0 3694–3706, July 2024....
2024
-
[175]
Towards efficient and comprehensive urban spatial-temporal prediction: A unified library and performance benchmark
Jingyuan Wang, Jiawei Jiang, Wenjun Jiang, Chengkai Han, and Wayne Xin Zhao. Towards efficient and comprehensive urban spatial-temporal prediction: A unified library and performance benchmark. arXiv preprint arXiv:2304.14343, 2023
2023 arXiv
-
[176]
Unified training of universal time series forecasting transformers
Gerald Woo, Chenghao Liu, Akshat Kumar, Caiming Xiong, Silvio Savarese, and Doyen Sahoo. Unified training of universal time series forecasting transformers. In Proceedings of the 41st International Conference on Machine Learning, ICML'24. JMLR.org, 2024
2024
-
[177]
Autoformer: Decomposition transformers with auto-correlation for long-term series forecasting
Haixu Wu, Jiehui Xu, Jianmin Wang, and Mingsheng Long. Autoformer: Decomposition transformers with auto-correlation for long-term series forecasting. In Neural Information Processing Systems, 2021. https://api.semanticscholar.org/CorpusID:235623791
2021
-
[178]
Quito B ench: A high-quality open time series forecasting benchmark
Siqiao Xue, Zhaoyang Zhu, Wei Zhang, Rongyao Cai, Rui Wang, Yixiang Mu, Fan Zhou, Jianguo Li, Peng Di, and Hang Yu. Quito B ench: A high-quality open time series forecasting benchmark. arXiv preprint arXiv:2603.26017, 2026
2026
-
[179]
Toward a foundation model for time series data
Chin-Chia Michael Yeh, Xin Dai, Huiyuan Chen, Yan Zheng, Yujie Fan, Audrey Der, Vivian Lai, Zhongfang Zhuang, Junpeng Wang, Liang Wang, et al. Toward a foundation model for time series data. In Proceedings of the 32nd ACM International Conference on Information and Knowledge M...
2023
-
[180]
Maddix, Boran Han, Xiyuan Zhang, Abdul Fatir Ansari, Oleksandr Shchur, Christos Faloutsos, Andrew Gordon Wilson, Michael W
Annan Yu, Danielle C. Maddix, Boran Han, Xiyuan Zhang, Abdul Fatir Ansari, Oleksandr Shchur, Christos Faloutsos, Andrew Gordon Wilson, Michael W. Mahoney, and Bernie Wang. Understanding transformers for time series: Rank structure, flow-of-ranks, and compressibility. In The Fo...
2026
-
[181]
Self-supervised contrastive pre-training for time series via time-frequency consistency
Xiang Zhang, Ziyuan Zhao, Theodoros Tsiligkaridis, and Marinka Zitnik. Self-supervised contrastive pre-training for time series via time-frequency consistency. Advances in neural information processing systems, 35: 0 3988--4003, 2022
2022
-
[182]
Informer: Beyond efficient transformer for long sequence time-series forecasting
Haoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang, Jianxin Li, Hui Xiong, and Wancai Zhang. Informer: Beyond efficient transformer for long sequence time-series forecasting. AAAI, 2021
2021
-
[183]
S DWPF : A dataset for spatial dynamic wind power forecasting over a large turbine array
Jingbo Zhou, Xinjiang Lu, Yixiong Xiao, Jian Tang, Jiantao Su, Yu Li, Ji Liu, Junfu Lyu, Yanjun Ma, and Dejing Dou. S DWPF : A dataset for spatial dynamic wind power forecasting over a large turbine array. Scientific Data, 11 0 (1): 0 649, 2024. doi:10.1038/s41597-024-03427-5....
2024 doi
-
[184]
Fedformer: Frequency enhanced decomposed transformer for long-term series forecasting
Tian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang, Liang Sun, and Rong Jin. Fedformer: Frequency enhanced decomposed transformer for long-term series forecasting. In International conference on machine learning, pages 27268--27286. PMLR, 2022
2022
Reviewed August 14, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.