REVIEW 10 cited by
A Survey of Deep Learning and Foundation Models for Time Series Forecasting
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
A Survey of Deep Learning and Foundation Models for Time Series Forecasting
read the original abstract
Deep Learning has been successfully applied to many application domains, yet its advantages have been slow to emerge for time series forecasting. For example, in the well-known Makridakis (M) Competitions, hybrids of traditional statistical or machine learning techniques have only recently become the top performers. With the recent architectural advances in deep learning being applied to time series forecasting (e.g., encoder-decoders with attention, transformers, and graph neural networks), deep learning has begun to show significant advantages. Still, in the area of pandemic prediction, there remain challenges for deep learning models: the time series is not long enough for effective training, unawareness of accumulated scientific knowledge, and interpretability of the model. To this end, the development of foundation models (large deep learning models with extensive pre-training) allows models to understand patterns and acquire knowledge that can be applied to new related problems before extensive training data becomes available. Furthermore, there is a vast amount of knowledge available that deep learning models can tap into, including Knowledge Graphs and Large Language Models fine-tuned with scientific domain knowledge. There is ongoing research examining how to utilize or inject such knowledge into deep learning models. In this survey, several state-of-the-art modeling techniques are reviewed, and suggestions for further work are provided.
Forward citations
Cited by 10 Pith papers
-
DeepL\'evy: Learning Heavy-Tailed Uncertainty in Highly Volatile Time Series
DeepLévy learns context-adaptive mixtures of Lévy stable distributions for multi-horizon probabilistic forecasting by minimizing empirical-parametric characteristic function discrepancies.
-
DeepL\'evy: Learning Heavy-Tailed Uncertainty in Highly Volatile Time Series
DeepLévy learns mixtures of Lévy stable distributions for heavy-tailed time series forecasting by minimizing discrepancies between empirical and parametric characteristic functions, outperforming prior methods on tail...
-
DeepL\'evy: Learning Heavy-Tailed Uncertainty in Highly Volatile Time Series
DeepLévy learns context-dependent mixtures of Lévy stable distributions for multi-horizon time series forecasting by matching empirical and parametric characteristic functions, yielding improved tail risk metrics over...
-
Graph Retention Networks for Dynamic Graphs
Graph Retention Networks extend retention to dynamic graphs to enable parallelizable training, O(1) inference, and chunkwise long-term training while delivering competitive performance with major efficiency gains.
-
Forecasting Realized Volatility with Time Series Foundation Models: A Comparison with Econometric Benchmarks
Zero-shot time series foundation models largely fail to beat econometric benchmarks for realized volatility forecasting, with only TTM achieving a narrow, calibration-driven edge.
-
Towards Unified and Data-Efficient Prognostics and Health Management with Tabular Foundation Models
Tabular foundation models applied to PHM via signal-to-table conversion achieve the best average ranks across prognostic and diagnostic tasks and remain competitive in low-data regimes.
-
Foundation Models Defining A New Era In Sensor-based Human Activity Recognition: A Survey And Outlook
The survey organizes foundation models for sensor-based HAR into a lifecycle taxonomy and identifies three trajectories: HAR-specific models from scratch, adaptation of general time-series models, and integration with...
-
Empirical Assessment of Time-Series Foundation Models For Power System Forecasting Applications
The paper benchmarks foundation models like TimesFM and Chronos against baselines on eight forecasting capabilities for power system time series.
-
Foundation vs. Specialized Models: Evaluating Catastrophic Forgetting in Continual Time Series Forecasting
Fine-tuning TimesFM sequentially on new synthetic time-series data causes measurable forgetting of earlier tasks, with higher learning rates producing stronger forgetting.
-
Koopman operator theory: fundamentals, control, and applications
Tutorial on Koopman operator theory, data-driven methods such as EDMD, and their use in controller design for nonlinear systems with provided simulations and code.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.