TranAD: Deep Transformer Networks for Anomaly Detection in Multivariate Time Series Data
Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:76AE5XY2record.jsonopen to challenge →
read the original abstract
Efficient anomaly detection and diagnosis in multivariate time-series data is of great importance for modern industrial applications. However, building a system that is able to quickly and accurately pinpoint anomalous observations is a challenging problem. This is due to the lack of anomaly labels, high data volatility and the demands of ultra-low inference times in modern applications. Despite the recent developments of deep learning approaches for anomaly detection, only a few of them can address all of these challenges. In this paper, we propose TranAD, a deep transformer network based anomaly detection and diagnosis model which uses attention-based sequence encoders to swiftly perform inference with the knowledge of the broader temporal trends in the data. TranAD uses focus score-based self-conditioning to enable robust multi-modal feature extraction and adversarial training to gain stability. Additionally, model-agnostic meta learning (MAML) allows us to train the model using limited data. Extensive empirical studies on six publicly available datasets demonstrate that TranAD can outperform state-of-the-art baseline methods in detection and diagnosis performance with data and time-efficient training. Specifically, TranAD increases F1 scores by up to 17%, reducing training times by up to 99% compared to the baselines.
This paper has not been read by Pith yet.
Forward citations
Cited by 5 Pith papers
-
ECoLAD: Deployment-Oriented Evaluation for Automotive Time-Series Anomaly Detection
ECoLAD shows classical anomaly detectors maintain coverage and accuracy lift under automotive compute limits while several deep methods lose feasibility first.
-
Modeling Normal Is All You Need: Joint Latent Clustering for Anomaly Detection in Multimodal Cyber-Physical Systems
A VaDE-based latent clustering detector that drops reconstruction wins a fair, difficulty-stratified anomaly detection protocol on three CPS datasets, with margins tracking dataset multimodality.
-
Causally-Constrained Probabilistic Forecasting for Time-Series Anomaly Detection
A transformer model guided by a causal graph prior achieves state-of-the-art anomaly detection and root-cause attribution on ASD and SMD benchmarks by restricting main predictions to graph-supported causes while using...
-
Modeling Spectral Energy Shifts in Spatio-Temporal Graph Anomaly Detection
Introduces a node-level spectral energy formulation and energy-aware message passing framework to detect camouflaged anomalies with decreased spectral variation in static and time-series graphs.
-
Learning Unified Representations of Normalcy for Time Series Anomaly Detection
U²AD learns unified normal data representations via score-based generative modeling and a novel time-dependent score network to outperform prior methods in accuracy and early anomaly detection for multivariate time series.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.