REVIEW 6 cited by
TimeDiT: General-purpose Diffusion Transformers for Time Series Foundation Model
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Foundation models, particularly Large Language Models (LLMs), have revolutionized text and video processing, yet time series data presents distinct challenges for such approaches due to domain-specific features such as missing values, multi-resolution characteristics, etc. Furthermore, the de-facto autoregressive transformers tend to learn deterministic temporal dependencies within pre-trained data while overlooking inherent uncertainties and lacking integration of physical constraints. In this paper, we introduce TimeDiT, a diffusion transformer model that synergistically combines transformer-based temporal dependency learning with diffusion-based probabilistic sampling. TimeDiT employs a unified masking mechanism to harmonize the training and inference process across diverse tasks while introducing a theoretically grounded, finetuning-free model editing strategy that enables flexible integration of external knowledge during sampling. Acknowledging the challenges of unifying multiple downstream tasks under a single model, our systematic evaluation demonstrates TimeDiT's effectiveness both in fundamental tasks, i.e., forecasting and imputation, through zero-shot/fine-tuning; and in domain tasks, i.e., multi-resolution forecasting, anomaly detection, and data generation, establishing it as a \textit{proto-foundation model} that bridges the gap between general-purpose and domain-specific models.
Forward citations
Cited by 6 Pith papers
-
Time Series Generation Under Data Scarcity: A Unified Generative Modeling Approach
A pre-trained diffusion model with dynamic channel adaptation and dataset tokens generates time series from a few examples and outperforms from-scratch baselines on a 12-dataset few-shot benchmark.
-
Physics-informed Temporal Alignment for Auto-regressive PDE Foundation Models
A self-supervised framework that discovers governing equations from short observed data windows and uses them to regularize autoregressive PDE foundation models, improving long-term forecast accuracy.
-
T2S: High-resolution Time Series Generation with Text-to-Series Diffusion Models
T2S uses a length-adaptive VAE and flow-matching diffusion transformer to generate variable-length time series from text captions, trained on a new fragment-level caption dataset.
-
A Survey of Reasoning and Agentic Systems in Time Series with Large Language Models
The authors organize LLM-based time series reasoning into three exclusive topologies (direct, chain, branch) crossed with four objectives, and use them to label 125 papers, benchmarks, and resources.
-
Foundation Time-Series AI Model for Realized Volatility Forecasting
Incremental fine-tuning of the TimesFM foundation model improves one-day-ahead realized volatility forecasts and beats HAR, ARFIMA, CHAR, and RGARCH benchmarks on average losses across 21 global equity indices.
-
Foundation Models for Demand Forecasting via Dual-Strategy Ensembling
A dual ensemble of hierarchical partitions and diverse backbones improves foundation-model sales forecasts on M5 and three external datasets, though the zero-shot protocol is under-specified.
Discussion (0). Continue with ORCID to comment.