Pith. sign in

REVIEW 9 cited by

AutoTimes: Autoregressive Time Series Forecasters via Large Language Models

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2402.02370 v4 pith:WTNLGZXK submitted 2024-02-04 cs.LG cs.CL

AutoTimes: Autoregressive Time Series Forecasters via Large Language Models

classification cs.LG cs.CL
keywords seriestimeautotimeslanguagellmsmodelsautoregressiveforecasters
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

Foundation models of time series have not been fully developed due to the limited availability of time series corpora and the underexploration of scalable pre-training. Based on the similar sequential formulation of time series and natural language, increasing research demonstrates the feasibility of leveraging large language models (LLM) for time series. Nevertheless, the inherent autoregressive property and decoder-only architecture of LLMs have not been fully considered, resulting in insufficient utilization of LLM abilities. To fully revitalize the general-purpose token transition and multi-step generation capability of large language models, we propose AutoTimes to repurpose LLMs as autoregressive time series forecasters, which projects time series into the embedding space of language tokens and autoregressively generates future predictions with arbitrary lengths. Compatible with any decoder-only LLMs, the consequent forecaster exhibits the flexibility of the lookback length and scalability with larger LLMs. Further, we formulate time series as prompts, extending the context for prediction beyond the lookback window, termed in-context forecasting. By introducing LLM-embedded textual timestamps, AutoTimes can utilize chronological information to align multivariate time series. Empirically, AutoTimes achieves state-of-the-art with 0.1% trainable parameters and over $5\times$ training/inference speedup compared to advanced LLM-based forecasters. Code is available at this repository: https://github.com/thuml/AutoTimes.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 9 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Deep Time Series Models: A Comprehensive Survey and Benchmark

    cs.LG 2024-07 unverdicted novelty 7.0

    This survey and benchmark of deep time series models using the released TSLib library finds that models with specific structures perform well only on distinct analysis tasks.

  2. A Cost-Effective Multimodal LLM Reasoning Framework for Question Answering over Irregular Clinical Time Series

    cs.AI 2026-07 conditional novelty 6.0

    ClinPRISM reaches 49.83% average accuracy on CLIR-Bench irregular clinical time-series QA using a 4B LLM, 16 temporal tokens, and 0.15 s/question.

  3. CLIR-Bench: Benchmarking Multimodal Question Answering over Irregular Clinical Time Series

    cs.CL 2026-07 conditional novelty 6.0

    CLIR-Bench shows generalist and time-series LLMs struggle to ground clinical answers in sparse irregular ICU evidence, with top accuracy near 50% and weak causal evidence use.

  4. LLM-Guided Task-Semantic Field Factorization for Industrial Process Forecasting

    cs.LG 2026-07 conditional novelty 6.0

    Offline LLM-built variable-semantic directions, activated by each numerical window via a dual-path adapter, cut industrial forecasting MAE up to 25.5% with ~2–3k extra parameters.

  5. LLM-Guided Measurement Credibility Correction for Trustworthy Industrial Process Inference

    eess.SY 2026-07 conditional novelty 6.0

    LLM-derived measurement semantics enable a lightweight pre-inference correction step that reduces industrial prediction MAE by 30.7% on real tests and 80.3% under controlled sensor corruption.

  6. From Time Series Analysis to Question Answering: A Survey in the LLM Era

    cs.LG 2025-06 accept novelty 6.0

    A survey proposing a taxonomy of Injective, Bridging, and Internal Alignment paradigms to evolve TSA into user-driven Time Series Question Answering with LLMs.

  7. Zeus: Towards Tuning-Free Foundation Model for Time Series Analysis

    cs.LG 2026-07 unverdicted novelty 5.0

    Zeus proposes a multi-scale Transformer with point-wise tokenization and Multi-Objective Temporal Masking to enable tuning-free performance on forecasting, interpolation, and other time series tasks.

  8. Once-for-All: Scalable Simultaneous Forecasting via Equilibrium State Estimation

    cs.LG 2026-06 unverdicted novelty 5.0

    ESE enables simultaneous forecasting of multiple interacting systems by estimating an equilibrium state in a single pass, matching SOTA accuracy with 10-70x speedup and linear complexity.

  9. LLM-Guided Task-Semantic Field Factorization for Industrial Process Forecasting

    cs.LG 2026-07 conditional novelty 4.0

    TSF converts process variable documents into frozen semantic vectors that scale the numerical input window before a time-series backbone, yielding average MAE reductions of 2.9–3.6% across industrial forecasting tasks.