REVIEW 11 cited by
Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting
read the original abstract
Extending the forecasting time is a critical demand for real applications, such as extreme weather early warning and long-term energy consumption planning. This paper studies the long-term forecasting problem of time series. Prior Transformer-based models adopt various self-attention mechanisms to discover the long-range dependencies. However, intricate temporal patterns of the long-term future prohibit the model from finding reliable dependencies. Also, Transformers have to adopt the sparse versions of point-wise self-attentions for long series efficiency, resulting in the information utilization bottleneck. Going beyond Transformers, we design Autoformer as a novel decomposition architecture with an Auto-Correlation mechanism. We break with the pre-processing convention of series decomposition and renovate it as a basic inner block of deep models. This design empowers Autoformer with progressive decomposition capacities for complex time series. Further, inspired by the stochastic process theory, we design the Auto-Correlation mechanism based on the series periodicity, which conducts the dependencies discovery and representation aggregation at the sub-series level. Auto-Correlation outperforms self-attention in both efficiency and accuracy. In long-term forecasting, Autoformer yields state-of-the-art accuracy, with a 38% relative improvement on six benchmarks, covering five practical applications: energy, traffic, economics, weather and disease. Code is available at this repository: \url{https://github.com/thuml/Autoformer}.
Forward citations
Cited by 11 Pith papers
-
TelecomTS: A Multi-Modal Observability Dataset for Time Series and Language Analysis
TelecomTS is a new observability dataset from 5G networks that preserves absolute scale and supports multi-modal tasks, showing that current time series and language models struggle with abrupt noisy dynamics.
-
Dynamic Linear Coregionalization for Realistic Synthetic Multivariate Time Series
DynLMC creates synthetic multivariate time series with dynamic inter-channel correlations that improve zero-shot forecasting performance when used to fine-tune foundation models across nine benchmarks.
-
Dynamic Linear Coregionalization for Realistic Synthetic Multivariate Time Series
DynLMC creates synthetic time series data with dynamic inter-channel correlations that improve zero-shot forecasting in foundation models across multiple benchmarks.
-
Neural CDEs as Correctors for Learned Time Series Models
Neural CDEs serve as correctors that reduce error accumulation in multi-step forecasts from learned time-series models across synthetic, physics, and real-world data.
-
RhyMix: A Lightweight Adaptive Multi-Rhythm Network for Long-Term Time Series Forecasting
RhyMix reaches state-of-the-art long-term multivariate forecasting on 10 of 12 public benchmarks with a ~40K-parameter dual-path adaptive architecture of linear complexity.
-
Exogenous Dropout: A Simple, Strong Baseline for Corruption-Robust Time Series Forecasting with Covariates
Exogenous dropout, a model-agnostic whole-channel training mask, restores corruption robustness better than a deliberately bounded gated-FiLM architecture across three forecasting domains.
-
MSTN: A Lightweight and Fast Model for General TimeSeries Analysis
MSTN introduces a lightweight multi-scale temporal network using convolutional encoding, recurrent or attention-based modeling, and gated fusion to achieve claimed state-of-the-art results on 21 of 27 time series benc...
-
Characteristic Root Analysis and Regularization for Linear Time Series Forecasting
Characteristic roots govern dynamics in linear forecasting models but noise induces spurious roots; rank reduction and Root Purge regularization mitigate this for more robust predictions.
-
MR-ImagenTime: Multi-Resolution Time Series Generation through Dual Image Representations
MR-CDM uses hierarchical multi-resolution decomposition and multi-scale conditional diffusion to generate forecasts that reduce MAE and RMSE by 6-10% versus baselines like CSDI and Informer on four datasets.
-
MSTN: A Lightweight and Fast Model for General TimeSeries Analysis
MSTN is a lightweight hybrid model that reports new state-of-the-art results on 33 of 40 time series benchmarks for imputation, forecasting, and classification while using under one million parameters and sub-second i...
-
Signed Dual Attention: Capturing Signed Dependencies in Time Series Forecasting
Signed Dual Attention is a parameter-free attention module that models signed dependencies in time series via dual message passing to achieve two-head expressiveness in one block.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.