REVIEW 7 cited by
TSLANet: Rethinking Transformers for Time Series Representation Learning
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
TSLANet: Rethinking Transformers for Time Series Representation Learning
read the original abstract
Time series data, characterized by its intrinsic long and short-range dependencies, poses a unique challenge across analytical applications. While Transformer-based models excel at capturing long-range dependencies, they face limitations in noise sensitivity, computational efficiency, and overfitting with smaller datasets. In response, we introduce a novel Time Series Lightweight Adaptive Network (TSLANet), as a universal convolutional model for diverse time series tasks. Specifically, we propose an Adaptive Spectral Block, harnessing Fourier analysis to enhance feature representation and to capture both long-term and short-term interactions while mitigating noise via adaptive thresholding. Additionally, we introduce an Interactive Convolution Block and leverage self-supervised learning to refine the capacity of TSLANet for decoding complex temporal patterns and improve its robustness on different datasets. Our comprehensive experiments demonstrate that TSLANet outperforms state-of-the-art models in various tasks spanning classification, forecasting, and anomaly detection, showcasing its resilience and adaptability across a spectrum of noise levels and data sizes. The code is available at https://github.com/emadeldeen24/TSLANet.
Forward citations
Cited by 7 Pith papers
-
Prototype-Guided Classification Sub-Task Decoupling Framework: Enhancing Generalization and Interpretability for Multivariate Time Series
PDFTime reformulates multivariate time series classification as a multi-stage prototype-based decision process, claiming SOTA results on UCR and UEA benchmarks.
-
From Observations to States: Latent Time Series Forecasting
LatentTSF improves time series forecasting accuracy and representation quality by shifting prediction from observation space to a learned latent state space via autoencoding.
-
See the Emotion: A Facial Emoji Proxy Modeling for EEG Emotion Recognition
EEG can be mapped to identity-anonymized facial emojis that act as a semantic regularizer, yielding SOTA EEG-only emotion accuracy and human-interpretable animations.
-
Modular Retrieval-Augmented Generalization for Human Action Recognition
MoRA is a new retrieval-augmented module for IMU-based human activity recognition that uses uncertainty-adaptive fusion of retrieved motion patterns to improve model performance.
-
Fed-REACT: Federated Representation Learning for Heterogeneous and Evolving Data
Fed-REACT first trains a shared encoder, then repeatedly clusters clients by smoothed task-model weights, improving federated learning accuracy on heterogeneous, non-stationary time series.
-
PMDformer: Patch-Mean Decoupling Information Transformer for Long-term Forecasting
PMDformer uses patch-mean decoupling, trend restoration attention, and proximal variable attention to improve accuracy and stability in long-term time series forecasting benchmarks.
-
Characteristic Root Analysis and Regularization for Linear Time Series Forecasting
Characteristic roots govern dynamics in linear forecasting models but noise induces spurious roots; rank reduction and Root Purge regularization mitigate this for more robust predictions.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.