REVIEW 9 cited by
AutoTimes: Autoregressive Time Series Forecasters via Large Language Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
AutoTimes: Autoregressive Time Series Forecasters via Large Language Models
read the original abstract
Foundation models of time series have not been fully developed due to the limited availability of time series corpora and the underexploration of scalable pre-training. Based on the similar sequential formulation of time series and natural language, increasing research demonstrates the feasibility of leveraging large language models (LLM) for time series. Nevertheless, the inherent autoregressive property and decoder-only architecture of LLMs have not been fully considered, resulting in insufficient utilization of LLM abilities. To fully revitalize the general-purpose token transition and multi-step generation capability of large language models, we propose AutoTimes to repurpose LLMs as autoregressive time series forecasters, which projects time series into the embedding space of language tokens and autoregressively generates future predictions with arbitrary lengths. Compatible with any decoder-only LLMs, the consequent forecaster exhibits the flexibility of the lookback length and scalability with larger LLMs. Further, we formulate time series as prompts, extending the context for prediction beyond the lookback window, termed in-context forecasting. By introducing LLM-embedded textual timestamps, AutoTimes can utilize chronological information to align multivariate time series. Empirically, AutoTimes achieves state-of-the-art with 0.1% trainable parameters and over $5\times$ training/inference speedup compared to advanced LLM-based forecasters. Code is available at this repository: https://github.com/thuml/AutoTimes.
Forward citations
Cited by 9 Pith papers
-
Deep Time Series Models: A Comprehensive Survey and Benchmark
This survey and benchmark of deep time series models using the released TSLib library finds that models with specific structures perform well only on distinct analysis tasks.
-
A Cost-Effective Multimodal LLM Reasoning Framework for Question Answering over Irregular Clinical Time Series
ClinPRISM reaches 49.83% average accuracy on CLIR-Bench irregular clinical time-series QA using a 4B LLM, 16 temporal tokens, and 0.15 s/question.
-
CLIR-Bench: Benchmarking Multimodal Question Answering over Irregular Clinical Time Series
CLIR-Bench shows generalist and time-series LLMs struggle to ground clinical answers in sparse irregular ICU evidence, with top accuracy near 50% and weak causal evidence use.
-
LLM-Guided Task-Semantic Field Factorization for Industrial Process Forecasting
Offline LLM-built variable-semantic directions, activated by each numerical window via a dual-path adapter, cut industrial forecasting MAE up to 25.5% with ~2–3k extra parameters.
-
LLM-Guided Measurement Credibility Correction for Trustworthy Industrial Process Inference
LLM-derived measurement semantics enable a lightweight pre-inference correction step that reduces industrial prediction MAE by 30.7% on real tests and 80.3% under controlled sensor corruption.
-
From Time Series Analysis to Question Answering: A Survey in the LLM Era
A survey proposing a taxonomy of Injective, Bridging, and Internal Alignment paradigms to evolve TSA into user-driven Time Series Question Answering with LLMs.
-
Zeus: Towards Tuning-Free Foundation Model for Time Series Analysis
Zeus proposes a multi-scale Transformer with point-wise tokenization and Multi-Objective Temporal Masking to enable tuning-free performance on forecasting, interpolation, and other time series tasks.
-
Once-for-All: Scalable Simultaneous Forecasting via Equilibrium State Estimation
ESE enables simultaneous forecasting of multiple interacting systems by estimating an equilibrium state in a single pass, matching SOTA accuracy with 10-70x speedup and linear complexity.
-
LLM-Guided Task-Semantic Field Factorization for Industrial Process Forecasting
TSF converts process variable documents into frozen semantic vectors that scale the numerical input window before a time-series backbone, yielding average MAE reductions of 2.9–3.6% across industrial forecasting tasks.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.