Pith. sign in

REVIEW 3 major objections 5 minor 155 references

Into the ORBIT for Time Series: Training Regimes for Foundation Models

T0 review · 3 major / 5 minor · reviewed 2026-08-14 · deepseek-v4-flash

Pith's one-line read The paper claims that explicitly controlling the pre-training distribution — which datasets, records, variables, contexts, and horizons a model sees — is a first-order factor in time series foundation model performance, and that its ORBIT…

desk verdict A serious training-regime paper with a real confound: the unablated alignment loss means the SOTA claim is not actually attributable to ORBIT. read the letter →

arxiv 2608.13262 v1 pith:FHXQPRZW submitted 2026-08-13 cs.LG cs.AI

classification cs.LGcs.AI
keywords timeseriesfoundationmodelspre-trainingdistributiontrainingregimebootstrapsamplingzero-shotforecastingquantileregressionrepresentationalignmentcontextlengthandhorizon
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Time series foundation models have improved mostly by changing architectures, while the way their training data is sampled has received little attention. This paper argues that the effective pre-training distribution — which datasets, records, variables, context windows, and prediction horizons the model actually sees — determines how well a time series foundation model transfers to new forecasting tasks. To make that distribution explicit and controllable, the authors introduce ORBIT, which combines corpus-level dataset blending with stochastic sampling of records, variables, context windows, and horizons, and then consumes those examples in a single training stage so short and long contexts and horizons coexist. Trained under ORBIT, Falcon-2.0, a deliberately simple 585M-parameter encoder-only Transformer, achieves the lowest Seasonal-Naive-normalized MASE on GIFT-Eval (0.6684) among 29 pretrained models and the best aggregate WQL on fev-bench (0.4842) as of July 2026. If the central claim is right, training-distribution design becomes a first-order lever for building generalizable time series models, on par with architectural scaling.

What carries the argument

The load-bearing mechanism is ORBIT, a two-part training paradigm. Bootstrap Multi-Level Sampling converts prescribed dataset weights into a global stream via a low-discrepancy greedy blending rule, then constructs an offline sample index of five-tuples (record, variable, context start, context end, horizon) by uniform stochastic selection over records, target variables, feasible context windows, and feasible prediction horizons. Omni-Range Incremental Training consumes this stream in a single stage, left-padding contexts and right-padding targets to batch maxima and masking unsupported positions, so short and long contexts and horizons are seen simultaneously. Falcon-2.0 is the deliberately simple backbone — a univariate encoder-only Transformer with triple-channel patches marking value, missingness indicator, and temporal position, a 21-quantile pinball loss, and multi-stage autoregressive inference for long horizons. A secondary mechanism, Rank-Guided Cross-Depth Alignment, uses a late layer as a stop-gradient teacher for a shallow layer through a token-wise cosine loss; the paper proves that small alignment loss bounds the spectral perturbation between shallow and deep representations, preventing loss of non-negligible singular modes under a separation condition. The machinery matters because it turns the training distribution into a specifiable object rather than an accident of corpus layout.

What would settle it

Re-run Falcon-2.0 and the top five competitors on GIFT-Eval and fev-bench under a single standardized protocol — identical context lengths, preprocessing, evaluation windows, and multiple seeds — and check whether Falcon-2.0's normalized-MASE and WQL leads persist beyond the 0.3–0.9% margins; if the ordering flips or the differences vanish within seed noise, the central claim of leaderboard-leading performance from ORBIT is refuted.

Watch

Extended reading notes

Core claim

The central claim is that training-regime design, not architectural sophistication, is what unlocks general zero-shot forecasting in time series foundation models. The evidence is Falcon-2.0: a simple univariate encoder-only Transformer with missingness-aware triple-channel patch tokenization and parallel patch prediction, trained with ORBIT. On GIFT-Eval's 97 dataset–frequency–horizon configurations, it reports the lowest normalized MASE (0.6684, mean rank 7.81) among 29 pretrained models as of July 2026, and on fev-bench it completes all 100 tasks with the best aggregate WQL (0.4842) and near-best MASE (0.6459). The authors attribute these results to ORBIT's explicit control of dataset exposure and its single-stage interleaving of context lengths and prediction horizons, with ablations showing that stochastic sampling and joint context-horizon sampling each contribute sizable gains.

Load-bearing premise

The lead over competing models rests on published leaderboard scores 'as of July 2026' that were computed under other models' evaluation protocols, with margins under one percent and no reported error bars or significance tests.

Editorial extensions

If this is right

  • Training-distribution design becomes a first-class axis of time series foundation model development: controlling dataset exposure, context length, and horizon coverage is as consequential as model scale or architecture.
  • Deterministic sliding-window enumeration is suboptimal; stochastic bootstrap sampling across records, variables, windows, and horizons improves both point and probabilistic metrics on GIFT-Eval and fev-bench.
  • Short and long contexts and horizons can be learned in a single training stage, eliminating the need for separate context-extension or horizon-specific training phases.
  • A simple, architecture-unassuming encoder-only Transformer trained under ORBIT is competitive with or better than much larger or more specialized models on zero-shot benchmarks.
  • Cross-depth representation alignment can regularize a Transformer without adding inference cost, since the teacher is a stop-gradient deep layer of the same network.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Extension: if ORBIT's gains hold under standardized re-evaluation, the same sampling machinery should transfer to other backbones, including decoder-only and multivariate models, and to other domains facing heterogeneous data budgets.
  • Extension: the reported leaderboard margins are small (0.6684 vs 0.6744 on GIFT-Eval; WQL 0.4842 vs the next best) and are compared against scores produced under other models' protocols, so a direct head-to-head with identical context windows, preprocessing, and seeds could shrink or flip the lead.
  • Extension: a natural testable variant is to replace ORBIT's uniform record and variable selection with quality- or difficulty-weighted selection; if the gains persist, the mechanism is diversity itself, and if they grow, the sampling rule can be tuned further.
  • Extension: the spectral-transfer guarantee suggests a diagnostic for other models — measure the epsilon-numerical rank gap between shallow and deep layers during training; if cross-depth alignment keeps that gap small, the same regularizer should generalize beyond forecasting.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. The paper introduces ORBIT (Omni-Range Bootstrap Incremental Training), a training regime for time series foundation models that combines Bootstrap Multi-Level Sampling with Omni-Range Incremental Training to control the effective pre-training distribution over datasets, records, variables, context windows, and prediction horizons. Under ORBIT the authors train Falcon-2.0, a deliberately simple univariate encoder-only Transformer with missingness-aware triple-channel patch tokenization and parallel patch prediction, and add Rank-Guided Cross-Depth Alignment, a training-only auxiliary objective. The paper reports zero-shot results on GIFT-Eval and fev-bench, claiming the lowest normalized MASE on GIFT-Eval among 29 pretrained models and the best aggregate WQL on fev-bench, and includes ablations of the sampling scheme and of architectural components.

Significance. If the results hold, the paper provides a useful demonstration that training-distribution design is a first-order factor in time series foundation model performance, not merely a detail subordinate to architecture. The ORBIT construction is specified precisely enough to be reproduced, and the controlled comparison of Bootstrap Stochastic Sampling with sliding-window enumeration is a meaningful methodological contribution. The spectral alignment analysis in Section 3.4 is internally consistent and the perturbation bound is derived rather than assumed. The significance is moderated, however, by the absence of an ablation of the auxiliary alignment loss, by unverified spectral diagnostics for the claimed mechanism, and by inconsistencies among the reported final-checkpoint numbers.

major comments (3)
  1. [Section 6.2 vs. Figure 10] The paper reports conflicting final-checkpoint numbers. Section 6.2 and Figures 4-5 give GIFT-Eval MASE 0.6684 and fev-bench MASE 0.6459, while Figure 10(b)-(c) reports final MASE 0.661 and 0.635 (and CRPS 0.476, WQL 0.477) against Section 6.2's CRPS 0.4843 and WQL 0.4842. Figure 11 confirms 0.6684/0.4843 and 0.6459/0.4842. Because Section 6.3.1's scaling claims are quantified from Figure 10, the authors must reconcile these numbers and state which set is the official evaluation result.
  2. [Section 3.4, Eq. (24); Section 5.2; Section 6.4.2] The auxiliary cross-depth alignment loss is unablated. Every reported run, including the ORBIT sampling ablations and the scaling curves, is trained with L_total = L_pin + λ_align·L_align and λ_align = 10.0, and no λ_align = 0 variant is shown. The internal comparisons among sampling strategies hold λ_align fixed, so those relative conclusions are meaningful; however, the central attribution that ORBIT's sampling regime unlocks Falcon-2.0's leaderboard advantage over external baselines is confounded by the auxiliary objective, since the external baselines do not use this loss. Moreover, the theoretical claim in Eq. (18) is conditional on small alignment error and a spectral separation condition, yet the paper reports neither the achieved L_align values nor the spectral gap on trained representations. Please add a λ_align = 0 control under otherwise identical ORBIT training and report the achieved alignment loss and spectral diagnostics.
  3. [Section 6.2, Figures 4-5] The state-of-the-art claims rest on leaderboard results 'as of July 2026' without evidence that the evaluation protocols (context length, preprocessing, seeds, evaluation windows) match Falcon-2.0's protocol. The reported margins are small: 0.9% on GIFT-Eval MASE (0.6684 vs. 0.6744) and 0.3% on fev-bench MASE (0.6459 vs. 0.6438), with no error bars or significance tests. I ask the authors to rerun the closest baselines with the exact Falcon-2.0 evaluation pipeline or report variance across seeds and repeated evaluations, and to temper claims such as 'strongest point-forecasting result' and 'Pareto-frontier' until protocol-matched evidence is available.
minor comments (5)
  1. [References] The citation '(Hu et al.)' in Section 1 has no year, and the bibliographic entry for 'The landscape of agentic time series systems: Architectures, reliability, and frontiers' is incomplete (no year or venue). Please complete this reference.
  2. [Figure 3] The label '𝒓𝒎𝒗𝒎𝒔𝒎𝒆𝒎𝒑𝒎' in Figure 3 is garbled; it should display the five-tuple (r_m, v_m, s_m, e_m, p_m) described in Definition 4.1.
  3. [Section 5.2] The phrase 'matching the single-pass horizon H1 = M×P_out = 6 × 16 = 96 from Section 3.2.3' uses undefined notation P_out and M; it should refer to T_max = M_max · P = 96 from Section 3.7.
  4. [Figure 10] The annotations in Figure 10 use a different number of decimal places than the tables and the main text (0.661 vs. 0.6684; 0.635 vs. 0.6459). After reconciling the underlying data, please use a single precision convention throughout the figure and text.
  5. [Appendix A.2] In Table 6, the notation 'W-THU', 'W-FRI', and 'W-WED' for weekly frequencies is not defined in the frequency alias list; please add these aliases to the table footnote.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: benchmark comparisons and ablations are externally grounded, and the alignment analysis is a derived bound rather than an assumed conclusion.

full rationale

Falcon-2.0's central claims are tested against external benchmarks (GIFT-Eval and fev-bench) with fixed evaluation protocols, and the ORBIT ablations compare sampling rules and context/horizon sampling under matched training budgets, so the main attribution is not manufactured from a fitted parameter. The Rank-Guided Cross-Depth Alignment analysis is an actual derivation: Eq. (15) follows from row normalization, Eqs. (16)-(19) are standard norm and singular-value perturbation inequalities, and Eq. (20) is a chordal-distance identity; these are derived, not assumed. The only overlapping self-citation (TimeAlign, Hu et al. 2025b) is used as inspiration for the stop-gradient optimization and is explicitly adapted, with both representations coming from different depths of the same encoder rather than from a separate future-observing branch, and the paper does not rely on TimeAlign's results as evidence. The unablated lambda_align=10.0 auxiliary loss is a potential confound for the ORBIT attribution, but a missing ablation is an experimental-control concern, not circularity: no benchmark number or ablation outcome is definitionally equal to the sampling-pipeline input. No fitted constant is renamed as a prediction, and no uniqueness theorem or prior result by the same authors is invoked to forbid alternatives. Therefore the derivation chain is self-contained.

Assumptions & free parameters 4 free parameters · 5 assumptions · 0 invented entities

The paper introduces no new physical or model-internal entities beyond a learnable REG token, which is a standard architectural element. The free parameters are training configuration choices; the key unstated ones are the domain weights and the alignment weight. The axioms above are background mathematical tools plus empirical and domain assumptions that the zero-shot evaluation depends on.

free parameters (4)
  • lambda_align = 10.0
    Weight of the cross-depth alignment loss in Eq. (24); set by hand in Section 5.2, not tuned on benchmarks.
  • domain-aware dataset weights = not reported
    Prescribed weights for the seven pre-training domains used by greedy blending in Section 4.2.1; values are chosen by the authors and not listed, which affects the effective training distribution.
  • pmin, pmax = 16, 96
    Minimum and maximum prediction horizons sampled by ORBIT (Table 4); chosen to match the model's per-stage forecasting capacity Tmax=96.
  • alignment blocks (l_sh, l_dp) = (1, 31)
    Which encoder blocks are aligned in Eq. (12); chosen by hand for the default 32-layer model.
assumptions (5)
  • standard math Weyl's singular-value perturbation bound and Stewart-Sun perturbation theory
    Used in Section 3.4, Eqs. (17)-(19), to connect alignment loss to spectral transfer.
  • domain assumption Flow of ranks: deeper layers have broader non-negligible singular spectra (Yu et al., 2026)
    Taken as motivation for alignment in Section 3.4; not re-derived for Falcon-2.0.
  • domain assumption Pre-training corpus is disjoint from GIFT-Eval and fev-bench evaluation data
    Stated in Section 5.1 following GIFT-Eval leakage principles; correctness of zero-shot results depends on it.
  • domain assumption Leaderboard comparisons are commensurable across models and protocols
    Section 6.2 compares against leaderboard results as of July 2026; if other models used different evaluation conditions, the reported SOTA margins are not meaningful.
  • domain assumption The prescribed domain-aware weights are set without fitting to the benchmarks
    Section 4.2.1; the paper does not state how the weights were chosen, and any implicit tuning on evaluation domains would weaken the zero-shot claim.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Into the ORBIT for Time Series: Training Regimes for Foundation Models." pith.science (2026). https://pith.science/paper/FHXQPRZW

@misc{pith2026260813262,
  author       = {Pith},
  title        = {Pith review of: Into the ORBIT for Time Series: Training Regimes for Foundation Models},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/FHXQPRZW}},
  note         = {Machine review of arXiv:2608.13262}
}
read the original abstract

Time series foundation models (TSFMs) have advanced primarily through architectural innovation, while training regimes for large-scale heterogeneous corpora remain under-explored. As a result, pre-training distributions are often poorly controlled with respect to domain imbalance, context requirements, prediction horizons, and missingness. We introduce ORBIT (Omni-Range Bootstrap Incremental Training), a training paradigm that makes this distribution explicit and controllable. ORBIT combines Bootstrap Multi-Level Sampling, which controls dataset exposure and samples records, target variables, context windows, and prediction horizons, with Omni-Range Incremental Training, which varies context lengths and prediction horizons throughout a single training stage. Under ORBIT, we train Falcon-2.0, a simple univariate encoder-only Transformer with missingness-aware triple-channel patch tokenization and parallel patch prediction. We further introduce Rank-Guided Cross-Depth Alignment, a training objective that uses late-layer representations as stop-gradient teachers for shallow layers without additional inference cost. Evaluations on GIFT-Eval and fev-bench demonstrate strong zero-shot forecasting performance across diverse domains and frequencies.

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

155 extracted references · 39 canonical work pages

  1. [3]

    Proceedings of the 41st International Conference on Machine Learning , articleno =

    Das, Abhimanyu and Kong, Weihao and Sen, Rajat and Zhou, Yichen , title =. Proceedings of the 41st International Conference on Machine Learning , articleno =. 2024 , publisher =

  2. [4]

    Proceedings of the 41st International Conference on Machine Learning , articleno =

    Woo, Gerald and Liu, Chenghao and Kumar, Akshat and Xiong, Caiming and Savarese, Silvio and Sahoo, Doyen , title =. Proceedings of the 41st International Conference on Machine Learning , articleno =. 2024 , publisher =

  3. [6]

    IEEE Transactions on Knowledge and Data Engineering , volume=

    Exploring progress in multivariate time series forecasting: Comprehensive benchmarking and heterogeneity analysis , author=. IEEE Transactions on Knowledge and Data Engineering , volume=. 2024 , publisher=

  4. [7]

    Proceedings of the 19th International Symposium on Spatial and Temporal Data , pages=

    Heterogeneity in Multivariate Time Series: Comprehensive Analysis and Adaptive Modeling , author=. Proceedings of the 19th International Symposium on Spatial and Temporal Data , pages=

  5. [8]

    Advances in neural information processing systems , volume=

    Self-supervised contrastive pre-training for time series via time-frequency consistency , author=. Advances in neural information processing systems , volume=

  6. [9]

    Proceedings of the 33rd ACM International Conference on Information and Knowledge Management , pages=

    Time is not enough: Time-frequency based explanation for time-series black-box models , author=. Proceedings of the 33rd ACM International Conference on Information and Knowledge Management , pages=

  7. [10]

    International conference on machine learning , pages=

    Fedformer: Frequency enhanced decomposed transformer for long-term series forecasting , author=. International conference on machine learning , pages=. 2022 , organization=

  8. [11]

    Scientific reports , volume=

    Recurrent neural networks for multivariate time series with missing values , author=. Scientific reports , volume=. 2018 , publisher=

Show all 155 references
  1. [12]

    Proceedings of the AAAI Conference on Artificial Intelligence , volume=

    Adaptive multi-scale decomposition framework for time series forecasting , author=. Proceedings of the AAAI Conference on Artificial Intelligence , volume=

  2. [20]

    Goswami, Mononito and Szafer, Konrad and Choudhry, Arjun and Cai, Yifu and Li, Shuo and Dubrawski, Artur , booktitle=. M

  3. [21]

    Proceedings of the 41st International Conference on Machine Learning , articleno =

    Liu, Yong and Zhang, Haoran and Li, Chenyu and Huang, Xiangdong and Wang, Jianmin and Long, Mingsheng , title =. Proceedings of the 41st International Conference on Machine Learning , articleno =. 2024 , publisher =

  4. [22]

    Yong Liu and Guo Qin and Xiangdong Huang and Jianmin Wang and Mingsheng Long , booktitle=. Timer-. 2025 , url=

  5. [23]

    Forty-third International Conference on Machine Learning Position Paper Track , year=

    Position: Time-Series Foundation Models Require Explicit Domain-Level Benchmarks , author=. Forty-third International Conference on Machine Learning Position Paper Track , year=

  6. [24]

    Proceedings of the 32nd ACM International Conference on Information and Knowledge Management , pages=

    Toward a foundation model for time series data , author=. Proceedings of the 32nd ACM International Conference on Information and Knowledge Management , pages=

  7. [25]

    The Fourteenth International Conference on Learning Representations , year=

    Understanding Transformers for Time Series: Rank Structure, Flow-of-ranks, and Compressibility , author=. The Fourteenth International Conference on Learning Representations , year=

  8. [26]

    Forty-second International Conference on Machine Learning , year=

    Sundial: A Family of Highly Capable Time Series Foundation Models , author=. Forty-second International Conference on Machine Learning , year=

  9. [27]

    The Thirteenth International Conference on Learning Representations , year=

    Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Experts , author=. The Thirteenth International Conference on Learning Representations , year=

  10. [28]

    The Thirty-ninth Annual Conference on Neural Information Processing Systems , year=

    TiRex: Zero-Shot Forecasting Across Long and Short Horizons with Enhanced In-Context Learning , author=. The Thirty-ninth Annual Conference on Neural Information Processing Systems , year=

  11. [29]

    Gifford and Chandra Reddy and Jayant Kalagnanam , booktitle=

    Vijay Ekambaram and Arindam Jati and Pankaj Dayama and Sumanta Mukherjee and Nam H Nguyen and Wesley M. Gifford and Chandra Reddy and Jayant Kalagnanam , booktitle=. Tiny Time Mixers (. 2024 , url=

  12. [30]

    2026 , url=

    Cheng HE and Xu Huang and Gangwei Jiang and Zhaoyi Li and Defu Lian and Hong Xie and Enhong Chen and xijie liang and Zhengzengrong and Patrick Lee , booktitle=. 2026 , url=

  13. [31]

    Yihang Wang and Yuying Qiu and Peng Chen and Yang Shu and Zhongwen Rao and Lujia Pan and Bin Yang and Chenjuan Guo , booktitle=. Light. 2025 , url=

  14. [32]

    Proceedings of the 41st International Conference on Machine Learning , articleno =

    Goswami, Mononito and Szafer, Konrad and Choudhry, Arjun and Cai, Yifu and Li, Shuo and Dubrawski, Artur , title =. Proceedings of the 41st International Conference on Machine Learning , articleno =. 2024 , publisher =

  15. [33]

    arXiv preprint arXiv:2602.06909 , year=

    Revisiting the Generic Transformer: Deconstructing a Strong Baseline for Time Series Foundation Models , author=. arXiv preprint arXiv:2602.06909 , year=

  16. [35]

    International Conference on Learning Representations , year =

    A Time Series is Worth 64 Words: Long-term Forecasting with Transformers , author =. International Conference on Learning Representations , year =

  17. [36]

    and Kaiser,

    Vaswani, Ashish and Shazeer, Noam and Parmar, Niki and Uszkoreit, Jakob and Jones, Llion and Gomez, Aidan N. and Kaiser,. Attention is all you need , year =. Proceedings of the 31st International Conference on Neural Information Processing Systems , pages =

  18. [37]

    International Conference on Learning Representations (ICLR) , year=

    iTransformer: Inverted transformers are effective for time series forecasting , author=. International Conference on Learning Representations (ICLR) , year=

  19. [38]

    International Conference on Learning Representations (ICLR) , year=

    Crossformer: Transformer utilizing cross-dimension dependency for multivariate time series forecasting , author=. International Conference on Learning Representations (ICLR) , year=

  20. [39]

    AAAI , year=

    Informer: Beyond efficient transformer for long sequence time-series forecasting , author=. AAAI , year=

  21. [40]

    International Conference on Learning Representations (ICLR) , year=

    TimesNet: Temporal 2D-variation modeling for general time series analysis , author=. International Conference on Learning Representations (ICLR) , year=

  22. [41]

    International Journal of Forecasting , volume=

    DeepAR: Probabilistic forecasting with autoregressive recurrent networks , author=. International Journal of Forecasting , volume=

  23. [42]

    International Journal of Forecasting , volume=

    Temporal fusion transformers for interpretable multi-horizon time series forecasting , author=. International Journal of Forecasting , volume=

  24. [43]

    International Conference on Learning Representations , year=

    Reversible Instance Normalization for Accurate Time-Series Forecasting against Distribution Shift , author=. International Conference on Learning Representations , year=

  25. [44]

    Neurocomputing , volume=

    Roformer: Enhanced transformer with rotary position embedding , author=. Neurocomputing , volume=. 2024 , publisher=

  26. [46]

    Long-term Forecasting with Ti

    Abhimanyu Das and Weihao Kong and Andrew Leach and Shaan K Mathur and Rajat Sen and Rose Yu , journal=. Long-term Forecasting with Ti. 2023 , url=

  27. [47]

    International conference on machine learning , pages=

    On layer normalization in the transformer architecture , author=. International conference on machine learning , pages=. 2020 , organization=

  28. [48]

    The Thirty-ninth Annual Conference on Neural Information Processing Systems , year=

    Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free , author=. The Thirty-ninth Annual Conference on Neural Information Processing Systems , year=

  29. [49]

    Journal of economic perspectives , volume=

    Quantile regression , author=. Journal of economic perspectives , volume=. 2001 , publisher=

  30. [51]

    arXiv preprint arXiv:2001.08361 , year=

    Scaling laws for neural language models , author=. arXiv preprint arXiv:2001.08361 , year=

  31. [53]

    International Conference on Machine Learning , pages=

    TimeFilter: Patch-Specific Spatial-Temporal Graph Filtration for Time Series Forecasting , author=. International Conference on Machine Learning , pages=. 2025 , organization=

  32. [55]

    The Landscape of Agentic Time Series Systems: Architectures, Reliability, and Frontiers , author=

  33. [57]

    2019 , publisher=

    Statistical Analysis with Missing Data , author=. 2019 , publisher=

  34. [58]

    Thirty-seventh Conference on Neural Information Processing Systems Datasets and Benchmarks Track , year=

    ClimateLearn: Benchmarking Machine Learning for Weather and Climate Modeling , author=. Thirty-seventh Conference on Neural Information Processing Systems Datasets and Benchmarks Track , year=

  35. [59]

    Xue, Siqiao and Zhu, Zhaoyang and Zhang, Wei and Cai, Rongyao and Wang, Rui and Mu, Yixiang and Zhou, Fan and Li, Jianguo and Di, Peng and Yu, Hang , journal=. Quito

  36. [60]

    Spyros Makridakis and Evangelos Spiliotis and Vassilios Assimakopoulos , journal=. The

  37. [61]

    Neural Information Processing Systems , year=

    Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting , author=. Neural Information Processing Systems , year=

  38. [62]

    AutoMixer for Improved Multivariate Time-Series Forecasting on Business and IT Observability Data , volume =

    Palaskar, Santosh and Ekambaram, Vijay and Jati, Arindam and Gantayat, Neelamadhav and Saha, Avirup and Nagar, Seema and Nguyen, Nam and Dayama, Pankaj and Sindhgatta, Renuka and Mohapatra, Prateeti and Kumar, Harshit and Kalagnanam, Jayant and Hemachandra, Nandyala and Rangar...

  39. [63]

    IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing , pages=

    Statistical characterization of business-critical workloads hosted in cloud datacenters , author=. IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing , pages=. 2015 , organization=

  40. [64]

    2017 , note =

    Addison Howard and Haruka Yui and Mark McDonald and Will Cukierski , title =. 2017 , note =

  41. [65]

    Expert Systems with Applications , volume=

    A machine learning approach for forecasting hierarchical time series , author=. Expert Systems with Applications , volume=. 2021 , publisher=

  42. [66]

    2015 , howpublished =

    Trindade, Artur , title =. 2015 , howpublished =

  43. [68]

    The International ACM SIGIR Conference on Research & Development in Information Retrieval , year=

    Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networks , author=. The International ACM SIGIR Conference on Research & Development in Information Retrieval , year=

  44. [69]

    The Conference on Neural Information Processing Systems Datasets and Benchmarks Track , year=

    Monash Time Series Forecasting Archive , author=. The Conference on Neural Information Processing Systems Datasets and Benchmarks Track , year=

  45. [71]

    Aksu, Taha and Woo, Gerald and Liu, Juncheng and Liu, Xu and Liu, Chenghao and Savarese, Silvio and Xiong, Caiming and Sahoo, Doyen , journal=. Gift-

  46. [74]

    Forecasting using sparse cointegration , journal =

    Ines Wilms and Christophe Croux , keywords =. Forecasting using sparse cointegration , journal =. 2016 , issn =. doi:https://doi.org/10.1016/j.ijforecast.2016.04.005 , url =

  47. [75]

    and Hyndman, Rob J

    Athanasopoulos, George and Ahmed, Roman A. and Hyndman, Rob J. , year=. Hierarchical forecasts for. International Journal of Forecasting , publisher=. doi:10.1016/j.ijforecast.2008.07.004 , number=

  48. [78]

    2025 , note =

    Ulrik Thyge Pedersen , title =. 2025 , note =

  49. [79]

    2025 , note =

    Nafay Un Noor , title =. 2025 , note =

  50. [80]

    2025 , note =

    Bushra Qurban , title =. 2025 , note =

  51. [81]

    2025 , note =

    AI Maverick , title =. 2025 , note =

  52. [82]

    2020 , note =

    lexis Cook and DanB and inversion and Ryan Holbrook , title =. 2020 , note =

  53. [83]

    2015 , howpublished =

    FlorianKnauer and Will Cukierski , title =. 2015 , howpublished =

  54. [84]

    2014 , howpublished =

    Walmart Competition Admin and Will Cukierski , title =. 2014 , howpublished =

  55. [85]

    2024 , howpublished =

    MichalKecera , title =. 2024 , howpublished =

  56. [86]

    2022 , howpublished =

  57. [87]

    Christiano and Martin Eichenbaum and Charles L

    Lawrence J. Christiano and Martin Eichenbaum and Charles L. Evans , keywords =. Monetary policy shocks: What have we learned and to what end? , series =. Handbook of Macroeconomics , volume =. 1999 , issn =. doi:https://doi.org/10.1016/S1574-0048(99)01005-8 , url =

  58. [88]

    Communications of the ACM , volume=

    How not to lie with statistics: the correct way to summarize benchmark results , author=. Communications of the ACM , volume=. 1986 , publisher=

  59. [89]

    Transactions on Machine Learning Research , year=

    Chronos: Learning the Language of Time Series , author=. Transactions on Machine Learning Research , year=

  60. [90]

    Version 2020-10-06 , author=

    Data Package Time series. Version 2020-10-06 , author=. 2020 , note=

  61. [91]

    Nature Energy , year =

    Staffell, Iain and Pfenninger, Stefan and Johnson, Nathan , title =. Nature Energy , year =. doi:10.1038/s41560-023-01341-5 , url =

  62. [92]

    Advances in neural information processing systems , volume=

    This time is different: An observability perspective on time series foundation models , author=. Advances in neural information processing systems , volume=

  63. [96]

    International Journal of Forecasting , volume=

    Global energy forecasting competition 2012 , author=. International Journal of Forecasting , volume=. 2014 , publisher=

  64. [97]

    2025 , note=

    Respiratory Viruses Weekly Data , author=. 2025 , note=

  65. [98]

    David, Etienne and Bellot, Jean and Corff, Sylvain Le , journal=. H

  66. [102]

    Matrix perturbation theory , author=. , year=

  67. [103]

    Walmart recruiting - store sales forecasting

    Walmart Competition Admin and Will Cukierski. Walmart recruiting - store sales forecasting. https://kaggle.com/competitions/walmart-recruiting-store-sales-forecasting, 2014. Kaggle

  68. [105]

    Gift-eval: A benchmark for general time series forecasting model evaluation

    Taha Aksu, Gerald Woo, Juncheng Liu, Xu Liu, Chenghao Liu, Silvio Savarese, Caiming Xiong, and Doyen Sahoo. Gift-eval: A benchmark for general time series forecasting model evaluation. arXiv preprint arXiv:2410.10393, 2024 b

  69. [106]

    Chronos: Learning the language of time series

    Abdul Fatir Ansari, Lorenzo Stella, Caner Turkmen, Xiyuan Zhang, Pedro Mercado, Huibin Shen, Oleksandr Shchur, Syama Sundar Rangapuram, Sebastian Pineda Arango, Shubham Kapoor, et al. Chronos: Learning the language of time series. Transactions on Machine Learning Research, 2024

  70. [107]

    Chronos-2: From univariate to universal forecasting

    Abdul Fatir Ansari, Oleksandr Shchur, Jaris K \"u ken, Andreas Auer, Boran Han, Pedro Mercado, Syama Sundar Rangapuram, Huibin Shen, Lorenzo Stella, Xiyuan Zhang, et al. Chronos-2: From univariate to universal forecasting. arXiv preprint arXiv:2510.15821, 2025

  71. [108]

    o ck, G \

    Andreas Auer, Patrick Podest, Daniel Klotz, Sebastian B \"o ck, G \"u nter Klambauer, and Sepp Hochreiter. Tirex: Zero-shot forecasting across long and short horizons with enhanced in-context learning. In The Thirty-ninth Annual Conference on Neural Information Processing Syst...

  72. [109]

    Recurrent neural networks for multivariate time series with missing values

    Zhengping Che, Sanjay Purushotham, Kyunghyun Cho, David Sontag, and Yan Liu. Recurrent neural networks for multivariate time series with missing values. Scientific reports, 8 0 (1): 0 6085, 2018

  73. [110]

    Time is not enough: Time-frequency based explanation for time-series black-box models

    Hyunseung Chung, Sumin Jo, Yeonsu Kwon, and Edward Choi. Time is not enough: Time-frequency based explanation for time-series black-box models. In Proceedings of the 33rd ACM International Conference on Information and Knowledge Management, pages 394--403, 2024

  74. [111]

    This time is different: An observability perspective on time series foundation models

    Ben Cohen, Emaad Khwaja, Youssef Doubli, Salahidine Lemaachi, Chris Lettieri, Charles Masson, Hugo Miccinilli, Elise Ram \'e , Qiqi Ren, Afshin Rostamizadeh, et al. This time is different: An observability perspective on time series foundation models. Advances in neural inform...

  75. [112]

    A decoder-only foundation model for time-series forecasting

    Abhimanyu Das, Weihao Kong, Rajat Sen, and Yichen Zhou. A decoder-only foundation model for time-series forecasting. In Proceedings of the 41st International Conference on Machine Learning, ICML'24. JMLR.org, 2024

  76. [113]

    Data package time series

    Open Power System Data. Data package time series. version 2020-10-06, 2020. https://doi.org/10.25832/time_series/2020-10-06

  77. [114]

    UK COVID-19 dashboard data

    UK COVID-19 data from official UK government sources. UK COVID-19 dashboard data. https://www.kaggle.com/datasets/happyadam73/uk-covid19-dashboard-data-sqlite-compressed, 2022. Kaggle

  78. [115]

    H ERMES : Hybrid error-corrector model with inclusion of external signals for nonstationary fashion time series

    Etienne David, Jean Bellot, and Sylvain Le Corff. H ERMES : Hybrid error-corrector model with inclusion of external signals for nonstationary fashion time series. arXiv preprint arXiv:2202.03224, 2022

  79. [116]

    De Vito , E

    S. De Vito , E. Massera, M. Piga, L. Martinotto, and G. Di Francia . On field calibration of an electronic nose for benzene estimation in an urban pollution monitoring scenario. Sensors and Actuators B: Chemical, 129 0 (2): 0 750--757, 2008. ISSN 0925-4005. doi:https://doi.org...

  80. [117]

    Respiratory viruses weekly data

    ECDC . Respiratory viruses weekly data. https://github.com/EU-ECDC/Respiratory_viruses_weekly_data/tree/main, 2025. Open data repository; weekly respiratory virus surveillance in the EU/EEA

  81. [118]

    Gifford, Chandra Reddy, and Jayant Kalagnanam

    Vijay Ekambaram, Arindam Jati, Pankaj Dayama, Sumanta Mukherjee, Nam H Nguyen, Wesley M. Gifford, Chandra Reddy, and Jayant Kalagnanam. Tiny time mixers ( TTM s): Fast pre-trained models for enhanced zero/few-shot forecasting of multivariate time series. In The Thirty-eighth A...

  82. [119]

    How not to lie with statistics: the correct way to summarize benchmark results

    Philip J Fleming and John J Wallace. How not to lie with statistics: the correct way to summarize benchmark results. Communications of the ACM, 29 0 (3): 0 218--221, 1986

  83. [120]

    Rossmann store sales

    FlorianKnauer and Will Cukierski. Rossmann store sales. https://kaggle.com/competitions/rossmann-store-sales, 2015. Kaggle

  84. [121]

    Webb, Rob Hyndman, and Pablo Montero-Manso

    Rakshitha Wathsadini Godahewa, Christoph Bergmeir, Geoffrey I. Webb, Rob Hyndman, and Pablo Montero-Manso. Monash time series forecasting archive. In The Conference on Neural Information Processing Systems Datasets and Benchmarks Track, 2021. https://openreview.net/forum?id=wEc1mgAjU-

  85. [122]

    Moment: a family of open time-series foundation models

    Mononito Goswami, Konrad Szafer, Arjun Choudhry, Yifu Cai, Shuo Li, and Artur Dubrawski. Moment: a family of open time-series foundation models. In Proceedings of the 41st International Conference on Machine Learning, ICML'24. JMLR.org, 2024 a

  86. [123]

    M OMENT : A family of open time-series foundation models

    Mononito Goswami, Konrad Szafer, Arjun Choudhry, Yifu Cai, Shuo Li, and Artur Dubrawski. M OMENT : A family of open time-series foundation models. In International Conference on Machine Learning, 2024 b

  87. [124]

    o ge, Oscar Key, Felix Birkel, Philipp Jund, Brendan Roof, Mihir Manium, Shi Bin Hoo, Magnus B \

    L \'e o Grinsztajn, Klemens Fl \"o ge, Oscar Key, Felix Birkel, Philipp Jund, Brendan Roof, Mihir Manium, Shi Bin Hoo, Magnus B \"u hler, Anurag Garg, et al. Tabpfn-3: Technical report. arXiv preprint arXiv:2605.13986, 2026

  88. [125]

    GTM : A general time-series model for enhanced representation learning of time-series data

    Cheng HE, Xu Huang, Gangwei Jiang, Zhaoyi Li, Defu Lian, Hong Xie, Enhong Chen, xijie liang, Zhengzengrong, and Patrick Lee. GTM : A general time-series model for enhanced representation learning of time-series data. In The Fourteenth International Conference on Learning Repre...

  89. [126]

    Global energy forecasting competition 2012

    Tao Hong, Pierre Pinson, and Shu Fan. Global energy forecasting competition 2012. International Journal of Forecasting, 30 0 (2): 0 357--363, 2014

  90. [127]

    From tables to time: Extending tabpfn-v2 to time series forecasting

    Shi Bin Hoo, Samuel M \"u ller, David Salinas, and Frank Hutter. From tables to time: Extending tabpfn-v2 to time series forecasting. arXiv preprint arXiv:2501.02945, 2025

  91. [128]

    Recruit restaurant visitor forecasting

    Addison Howard, Haruka Yui, Mark McDonald, and Will Cukierski. Recruit restaurant visitor forecasting. https://kaggle.com/competitions/recruit-restaurant-visitor-forecasting, 2017. Kaggle

  92. [129]

    The landscape of agentic time series systems: Architectures, reliability, and frontiers

    Yifan Hu, Jie Yang, Xilin Dai, Wanxu Cai, Kuiye Ding, Yuante Li, Qinghua Liu, Enze Ma, Zhiyuan Qu, Yixin Wang, et al. The landscape of agentic time series systems: Architectures, reliability, and frontiers

  93. [130]

    Adaptive multi-scale decomposition framework for time series forecasting

    Yifan Hu, Peiyuan Liu, Peng Zhu, Dawei Cheng, and Tao Dai. Adaptive multi-scale decomposition framework for time series forecasting. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 39, pages 17359--17367, 2025 a

  94. [131]

    Bridging past and future: Distribution-aware alignment for time series forecasting

    Yifan Hu, Jie Yang, Tian Zhou, Peiyuan Liu, Yujin Tang, Rong Jin, and Liang Sun. Bridging past and future: Distribution-aware alignment for time series forecasting. arXiv preprint arXiv:2509.14181, 2025 b

  95. [132]

    Timefilter: Patch-specific spatial-temporal graph filtration for time series forecasting

    Yifan Hu, Guibin Zhang, Peiyuan Liu, Disen Lan, Naiqi Li, Dawei Cheng, Tao Dai, Shu-Tao Xia, and Shirui Pan. Timefilter: Patch-specific spatial-temporal graph filtration for time series forecasting. In International Conference on Machine Learning, pages 24893--24911. PMLR, 2025 c

  96. [133]

    Existence precedes value: Joint modeling of observational existence and evolving states in time series forecasting

    Yifan Hu, Hongzhou Chen, Peiyuan Liu, Yiding Liu, Zewei Dong, and Jiang-Ming Yang. Existence precedes value: Joint modeling of observational existence and evolving states in time series forecasting. arXiv preprint arXiv:2606.13571, 2026

  97. [134]

    No other representation component is needed: Diffusion transformers can provide representation guidance by themselves

    Dengyang Jiang, Mengmeng Wang, Liuzhuozheng Li, Lei Zhang, Haoyu Wang, Wei Wei, Guang Dai, Yanning Zhang, and Jingdong Wang. No other representation component is needed: Diffusion transformers can provide representation guidance by themselves. arXiv preprint arXiv:2505.02831, 2025

  98. [135]

    Toto 2.0: Time series forecasting enters the scaling era

    Emaad Khwaja, Chris Lettieri, Gerald Woo, Eden Belouadah, Marc Cenac, Guillaume Jarry, Enguerrand Paquin, Xunyi Zhao, Viktoriya Zhukov, Othmane Abou-Amal, et al. Toto 2.0: Time series forecasting enters the scaling era. arXiv preprint arXiv:2605.20119, 2026

  99. [136]

    Reversible instance normalization for accurate time-series forecasting against distribution shift

    Taesung Kim, Jinhee Kim, Yunwon Tae, Cheonbok Park, Jang-Ho Choi, and Jaegul Choo. Reversible instance normalization for accurate time-series forecasting against distribution shift. In International Conference on Learning Representations, 2022. https://openreview.net/forum?id=...

  100. [137]

    Quantile regression

    Roger Koenker and Kevin F Hallock. Quantile regression. Journal of economic perspectives, 15 0 (4): 0 143--156, 2001

  101. [138]

    Foundation models for time series: A survey

    Siva Rama Krishna Kottapalli, Karthik Hubli, Sandeep Chandrashekhara, Garima Jain, Sunayana Hubli, Gayathri Botla, and Ramesh Doddaiah. Foundation models for time series: A survey. arXiv preprint arXiv:2504.04011, 2025

  102. [139]

    Modeling long- and short-term temporal patterns with deep neural networks

    Guokun Lai, Wei-Cheng Chang, Yiming Yang, and Hanxiao Liu. Modeling long- and short-term temporal patterns with deep neural networks. In The International ACM SIGIR Conference on Research & Development in Information Retrieval, 2017. https://api.semanticscholar.org/CorpusID:4922476

  103. [140]

    Store sales -- time series forecasting

    lexis Cook, DanB, inversion, and Ryan Holbrook. Store sales -- time series forecasting. https://www.kaggle.com/competitions/store-sales-time-series-forecasting, 2020. Kaggle

  104. [141]

    Foundation models for time series analysis: A tutorial and survey

    Yuxuan Liang, Haomin Wen, Yuqi Nie, Yushan Jiang, Ming Jin, Dongjin Song, Shirui Pan, and Qingsong Wen. Foundation models for time series analysis: A tutorial and survey. In Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, KDD ’24, page 655...

  105. [142]

    Temporal fusion transformers for interpretable multi-horizon time series forecasting

    Bryan Lim, Sercan \"O Ar k, Nicolas Loeff, and Tomas Pfister. Temporal fusion transformers for interpretable multi-horizon time series forecasting. International Journal of Forecasting, 37 0 (4): 0 1748--1764, 2021

  106. [143]

    Moirai 2.0: When less is more for time series forecasting

    Chenghao Liu, Taha Aksu, Juncheng Liu, Xu Liu, Hanshu Yan, Quang Pham, Silvio Savarese, Doyen Sahoo, Caiming Xiong, and Junnan Li. Moirai 2.0: When less is more for time series forecasting. arXiv preprint arXiv:2511.11698, 2025 a

  107. [144]

    Falcon-x: A time series foundation model for heterogeneous multivariate modeling

    Yiding Liu, Yifan Hu, Hongjie Xia, Peiyuan Liu, Hongzhou Chen, Xilin Dai, Zewei Dong, and Jiang-Ming Yang. Falcon-x: A time series foundation model for heterogeneous multivariate modeling. arXiv preprint arXiv:2605.27286, 2026 a

  108. [145]

    itransformer: Inverted transformers are effective for time series forecasting

    Yong Liu, Tengge Hu, Haoran Zhang, Chenyu Wu, Shiyu Wang, Lintao Ma, and Mingsheng Long. itransformer: Inverted transformers are effective for time series forecasting. International Conference on Learning Representations (ICLR), 2024 a

  109. [146]

    Timer: generative pre-trained transformers are large time series models

    Yong Liu, Haoran Zhang, Chenyu Li, Xiangdong Huang, Jianmin Wang, and Mingsheng Long. Timer: generative pre-trained transformers are large time series models. In Proceedings of the 41st International Conference on Machine Learning, ICML'24. JMLR.org, 2024 b

  110. [147]

    Timer- XL : Long-context transformers for unified time series forecasting

    Yong Liu, Guo Qin, Xiangdong Huang, Jianmin Wang, and Mingsheng Long. Timer- XL : Long-context transformers for unified time series forecasting. In The Thirteenth International Conference on Learning Representations, 2025 b . https://openreview.net/forum?id=KMCJXjlDDr

  111. [148]

    Sundial: A family of highly capable time series foundation models

    Yong Liu, Guo Qin, Zhiyuan Shi, Zhi Chen, Caiyin Yang, Xiangdong Huang, Jianmin Wang, and Mingsheng Long. Sundial: A family of highly capable time series foundation models. In Forty-second International Conference on Machine Learning, 2025 c . https://openreview.net/forum?id=L...

  112. [149]

    Timer-s1: A billion-scale time series foundation model with serial scaling

    Yong Liu, Xingjian Su, Shiyu Wang, Haoran Zhang, Haixuan Liu, Yuxuan Wang, Zhou Ye, Yang Xiang, Jianmin Wang, and Mingsheng Long. Timer-s1: A billion-scale time series foundation model with serial scaling. arXiv preprint arXiv:2603.04791, 2026 b

  113. [150]

    Decoupled weight decay regularization

    Ilya Loshchilov and Frank Hutter. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101, 2017

  114. [151]

    The M 4 competition: Results, findings, conclusion and way forward

    Spyros Makridakis, Evangelos Spiliotis, and Vassilios Assimakopoulos. The M 4 competition: Results, findings, conclusion and way forward. International Journal of Forecasting, 2018

  115. [152]

    M5 accuracy competition: Results, findings, and conclusions

    Spyros Makridakis, Evangelos Spiliotis, and Vassilios Assimakopoulos. M5 accuracy competition: Results, findings, and conclusions. International Journal of Forecasting, 38 0 (4): 0 1346--1364, 2022. ISSN 0169-2070. doi:https://doi.org/10.1016/j.ijforecast.2021.11.013. https://...

  116. [153]

    A machine learning approach for forecasting hierarchical time series

    Paolo Mancuso, Veronica Piccialli, and Antonio M Sudoso. A machine learning approach for forecasting hierarchical time series. Expert Systems with Applications, 182: 0 115102, 2021

  117. [154]

    McCracken and Serena Ng

    Michael W. McCracken and Serena Ng. F RED-MD : A monthly database for macroeconomic research. Journal of Business & Economic Statistics, 34 0 (4): 0 574--589, 2016. doi:10.1080/07350015.2015.1086655. https://doi.org/10.1080/07350015.2015.1086655

  118. [155]

    McCracken and Serena Ng

    Michael W. McCracken and Serena Ng. F RED-QD : A quarterly database for macroeconomic research. Review, 103 0 (1): 0 1--44, January 2021. doi:10.20955/r.103.1-44. https://ideas.repec.org/a/fip/fedlrv/90588.html

  119. [156]

    Rohlik sales forecasting challenge

    MichalKecera. Rohlik sales forecasting challenge. https://kaggle.com/competitions/rohlik-sales-forecasting-challenge-v2, 2024. Kaggle

  120. [157]

    Compilation, revision and updating of the global var (gvar) database

    Kamiar Mohaddes and Mehdi Raissi. Compilation, revision and updating of the global var (gvar) database. Mendeley Data, Version 1, 2024. https://doi.org/10.17632/kfp5fhgkvf.1

  121. [158]

    Nguyen, Phanwadee Sinthong, and Jayant Kalagnanam

    Yuqi Nie, Nam H. Nguyen, Phanwadee Sinthong, and Jayant Kalagnanam. A time series is worth 64 words: Long-term forecasting with transformers. In International Conference on Learning Representations, 2023

  122. [159]

    Riyadh hospital admissions dataset (2020–2024)

    General Directorate of Health Affairs and Saudi Arabia Ministry of Health. Riyadh hospital admissions dataset (2020–2024). https://www.kaggle.com/dsv/9992619, 2024

  123. [160]

    Automixer for improved multivariate time-series forecasting on business and it observability data

    Santosh Palaskar, Vijay Ekambaram, Arindam Jati, Neelamadhav Gantayat, Avirup Saha, Seema Nagar, Nam Nguyen, Pankaj Dayama, Renuka Sindhgatta, Prateeti Mohapatra, Harshit Kumar, Jayant Kalagnanam, Nandyala Hemachandra, and Narayan Rangaraj. Automixer for improved multivariate ...

  124. [161]

    u rger, Levente Z \'o lyomi, Bernhard Voggenberger, Wilhelm Berghammer, Daniel Klotz, Sebastian B \

    Patrick Podest, Marco Pichler, Elias B \"u rger, Levente Z \'o lyomi, Bernhard Voggenberger, Wilhelm Berghammer, Daniel Klotz, Sebastian B \"o ck, G \"u nter Klambauer, and Sepp Hochreiter. Tirex-2: Generalizing tirex to multivariate data and streaming. arXiv preprint arXiv:26...

  125. [162]

    Gated attention for large language models: Non-linearity, sparsity, and attention-sink-free

    Zihan Qiu, Zekun Wang, Bo Zheng, Zeyu Huang, Kaiyue Wen, Songlin Yang, Rui Men, Le Yu, Fei Huang, Suozhi Huang, Dayiheng Liu, Jingren Zhou, and Junyang Lin. Gated attention for large language models: Non-linearity, sparsity, and attention-sink-free. In The Thirty-ninth Annual ...

  126. [163]

    Exploring progress in multivariate time series forecasting: Comprehensive benchmarking and heterogeneity analysis

    Zezhi Shao, Fei Wang, Yongjun Xu, Wei Wei, Chengqing Yu, Zhao Zhang, Di Yao, Tao Sun, Guangyin Jin, Xin Cao, et al. Exploring progress in multivariate time series forecasting: Comprehensive benchmarking and heterogeneity analysis. IEEE Transactions on Knowledge and Data Engine...

  127. [164]

    Heterogeneity in multivariate time series: Comprehensive analysis and adaptive modeling

    Zezhi Shao, Chengqing Yu, and Fei Wang. Heterogeneity in multivariate time series: Comprehensive analysis and adaptive modeling. In Proceedings of the 19th International Symposium on Spatial and Temporal Data, pages 76--79, 2025

  128. [165]

    Glu variants improve transformer

    Noam Shazeer. Glu variants improve transformer. arXiv preprint arXiv:2002.05202, 2020

  129. [166]

    fev-bench: A realistic benchmark for time series forecasting

    Oleksandr Shchur, Abdul Fatir Ansari, Caner Turkmen, Lorenzo Stella, Nick Erickson, Pablo Guerron, Michael Bohlke-Schneider, and Yuyang Wang. fev-bench: A realistic benchmark for time series forecasting. arXiv preprint arXiv:2509.26468, 2025

  130. [167]

    Statistical characterization of business-critical workloads hosted in cloud datacenters

    Siqi Shen, Vincent Van Beek, and Alexandru Iosup. Statistical characterization of business-critical workloads hosted in cloud datacenters. In IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, pages 465--474. IEEE, 2015

  131. [168]

    Time-moe: Billion-scale time series foundation models with mixture of experts

    Xiaoming Shi, Shiyu Wang, Yuqi Nie, Dianqi Li, Zhou Ye, Qingsong Wen, and Ming Jin. Time-moe: Billion-scale time series foundation models with mixture of experts. In The Thirteenth International Conference on Learning Representations, 2025. https://openreview.net/forum?id=e1wDDFmlVu

  132. [169]

    Megatron-lm: Training multi-billion parameter language models using model parallelism

    Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, and Bryan Catanzaro. Megatron-lm: Training multi-billion parameter language models using model parallelism. arXiv preprint arXiv:1909.08053, 2019

  133. [170]

    Matrix perturbation theory

    Gilbert W Stewart and Ji-guang Sun. Matrix perturbation theory. 1990

  134. [171]

    Roformer: Enhanced transformer with rotary position embedding

    Jianlin Su, Murtadha Ahmed, Yu Lu, Shengfeng Pan, Wen Bo, and Yunfeng Liu. Roformer: Enhanced transformer with rotary position embedding. Neurocomputing, 568: 0 127063, 2024

  135. [172]

    Position: Time-series foundation models require explicit domain-level benchmarks

    Md Asif Bin Syed, Md Younus Ahamed, and Azmine Toushik Wasi. Position: Time-series foundation models require explicit domain-level benchmarks. In Forty-third International Conference on Machine Learning Position Paper Track, 2026. https://openreview.net/forum?id=W2eEMPjzIQ

  136. [173]

    ElectricityLoadDiagrams20112014

    Artur Trindade. ElectricityLoadDiagrams20112014 . UCI Machine Learning Repository, 2015. DOI : https://doi.org/10.24432/C58C86

  137. [174]

    Why TPC is not enough: An analysis of the amazon redshift fleet

    Alexander van Renen, Dominik Horn, Pascal Pfeil, Kapil Vaidya, Wenjian Dong, Murali Narayanaswamy, Zhengchun Liu, Gaurav Saxena, Andreas Kipf, and Tim Kraska. Why TPC is not enough: An analysis of the amazon redshift fleet. Proc. VLDB Endow., 17 0 (11): 0 3694–3706, July 2024....

  138. [175]

    Towards efficient and comprehensive urban spatial-temporal prediction: A unified library and performance benchmark

    Jingyuan Wang, Jiawei Jiang, Wenjun Jiang, Chengkai Han, and Wayne Xin Zhao. Towards efficient and comprehensive urban spatial-temporal prediction: A unified library and performance benchmark. arXiv preprint arXiv:2304.14343, 2023

  139. [176]

    Unified training of universal time series forecasting transformers

    Gerald Woo, Chenghao Liu, Akshat Kumar, Caiming Xiong, Silvio Savarese, and Doyen Sahoo. Unified training of universal time series forecasting transformers. In Proceedings of the 41st International Conference on Machine Learning, ICML'24. JMLR.org, 2024

  140. [177]

    Autoformer: Decomposition transformers with auto-correlation for long-term series forecasting

    Haixu Wu, Jiehui Xu, Jianmin Wang, and Mingsheng Long. Autoformer: Decomposition transformers with auto-correlation for long-term series forecasting. In Neural Information Processing Systems, 2021. https://api.semanticscholar.org/CorpusID:235623791

  141. [178]

    Quito B ench: A high-quality open time series forecasting benchmark

    Siqiao Xue, Zhaoyang Zhu, Wei Zhang, Rongyao Cai, Rui Wang, Yixiang Mu, Fan Zhou, Jianguo Li, Peng Di, and Hang Yu. Quito B ench: A high-quality open time series forecasting benchmark. arXiv preprint arXiv:2603.26017, 2026

  142. [179]

    Toward a foundation model for time series data

    Chin-Chia Michael Yeh, Xin Dai, Huiyuan Chen, Yan Zheng, Yujie Fan, Audrey Der, Vivian Lai, Zhongfang Zhuang, Junpeng Wang, Liang Wang, et al. Toward a foundation model for time series data. In Proceedings of the 32nd ACM International Conference on Information and Knowledge M...

  143. [180]

    Maddix, Boran Han, Xiyuan Zhang, Abdul Fatir Ansari, Oleksandr Shchur, Christos Faloutsos, Andrew Gordon Wilson, Michael W

    Annan Yu, Danielle C. Maddix, Boran Han, Xiyuan Zhang, Abdul Fatir Ansari, Oleksandr Shchur, Christos Faloutsos, Andrew Gordon Wilson, Michael W. Mahoney, and Bernie Wang. Understanding transformers for time series: Rank structure, flow-of-ranks, and compressibility. In The Fo...

  144. [181]

    Self-supervised contrastive pre-training for time series via time-frequency consistency

    Xiang Zhang, Ziyuan Zhao, Theodoros Tsiligkaridis, and Marinka Zitnik. Self-supervised contrastive pre-training for time series via time-frequency consistency. Advances in neural information processing systems, 35: 0 3988--4003, 2022

  145. [182]

    Informer: Beyond efficient transformer for long sequence time-series forecasting

    Haoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang, Jianxin Li, Hui Xiong, and Wancai Zhang. Informer: Beyond efficient transformer for long sequence time-series forecasting. AAAI, 2021

  146. [183]

    S DWPF : A dataset for spatial dynamic wind power forecasting over a large turbine array

    Jingbo Zhou, Xinjiang Lu, Yixiong Xiao, Jian Tang, Jiantao Su, Yu Li, Ji Liu, Junfu Lyu, Yanjun Ma, and Dejing Dou. S DWPF : A dataset for spatial dynamic wind power forecasting over a large turbine array. Scientific Data, 11 0 (1): 0 649, 2024. doi:10.1038/s41597-024-03427-5....

  147. [184]

    Fedformer: Frequency enhanced decomposed transformer for long-term series forecasting

    Tian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang, Liang Sun, and Rong Jin. Fedformer: Frequency enhanced decomposed transformer for long-term series forecasting. In International conference on machine learning, pages 27268--27286. PMLR, 2022

Pith tools

Reviewed August 14, 2026 · model on record in the stance chip above.