REVIEW 11 cited by
NetGPT: Generative Pretrained Transformer for Network Traffic
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
NetGPT: Generative Pretrained Transformer for Network Traffic
read the original abstract
All data on the Internet are transferred by network traffic, thus accurately modeling network traffic can help improve network services quality and protect data privacy. Pretrained models for network traffic can utilize large-scale raw data to learn the essential characteristics of network traffic, and generate distinguishable results for input traffic without considering specific downstream tasks. Effective pretrained models can significantly optimize the training efficiency and effectiveness of downstream tasks, such as application classification, attack detection and traffic generation. Despite the great success of pretraining in natural language processing, there is no work in the network field. Considering the diverse demands and characteristics of network traffic and network tasks, it is non-trivial to build a pretrained model for network traffic and we face various challenges, especially the heterogeneous headers and payloads in the multi-pattern network traffic and the different dependencies for contexts of diverse downstream network tasks. To tackle these challenges, in this paper, we make the first attempt to provide a generative pretrained model NetGPT for both traffic understanding and generation tasks. We propose the multi-pattern network traffic modeling to construct unified text inputs and support both traffic understanding and generation tasks. We further optimize the adaptation effect of the pretrained model to diversified tasks by shuffling header fields, segmenting packets in flows, and incorporating diverse task labels with prompts. With diverse traffic datasets from encrypted software, DNS, private industrial protocols and cryptocurrency mining, expensive experiments demonstrate the effectiveness of our NetGPT in a range of traffic understanding and generation tasks on traffic datasets, and outperform state-of-the-art baselines by a wide margin.
Forward citations
Cited by 11 Pith papers
-
CENTILE: A Telemetry Foundation Model Evaluated by the Decisions It Drives
One pretrained telemetry model, CENTILE, improves both HPC backfilling and ISP capacity provisioning decisions under replay, with zero-shot transfer across months and domains.
-
Contrastive Learning and Correlation Clustering for Sequences of Network Telescope Data
A contrastive learning transformer embeds network flow sequences to enable correlation clustering that groups scanner sources consistently with labels.
-
Protocol-Aware Tokenization and Architecture Co-Design for Wireless Packet Foundation Models
Protocol-aware tokenization is the primary performance driver for wireless packet foundation models, delivering 32-point accuracy gains while architecture changes yield only 2 points in a controlled 2x2 comparison.
-
MambaNetBurst: Direct Byte-level Network Traffic Classification without Tokenization or Pretraining
A compact Mamba-2 model performs end-to-end byte-level network traffic classification without tokenization or pre-training and remains competitive with substantially larger pre-trained systems.
-
Versatile yet Efficient Network Traffic Analysis: Offloading Network Foundation Model to SmartNIC
Nepco offloads network foundation models to SmartNICs using localized byte-sequence modeling and a pattern-aware convolutional architecture to achieve competitive macro F1 scores with 328x lower end-to-end latency tha...
-
NetVAD: Foundation-Model Representation Learning for Identifier-Free Unsupervised Intrusion Detection
NetVAD uses a strictly identifier-free VAE on frozen foundation model embeddings, trained solely on benign traffic, to achieve 98% micro F1 and 96% macro F1 on ToN-IoT for unsupervised intrusion detection.
-
NetVAD: Foundation-Model Representation Learning for Identifier-Free Unsupervised Intrusion Detection
NetVAD is a strictly identifier-free VAE that projects frozen foundation-model network representations into a latent space trained solely on benign traffic, reporting 98% micro F1 and 96% macro F1 on ToN-IoT.
-
UniAlign: A Model-Agnostic Framework for Robust Network Traffic Classification under Distribution Shifts
UniAlign improves robustness of deep learning NTC models under distribution shifts via domain alignment fine-tuning and stable ensembling, yielding 2.51% accuracy and 2.71% F1 gains over standard training on three pub...
-
Improving DNS Exfiltration Detection via Transformer Pretraining
In-domain BERT pretraining yields better low-FPR detection of DNS exfiltration than random initialization, with larger gains when more labeled fine-tuning data is available.
-
Traffic-MoE: A Sparse Foundation Model for Network Traffic Security Analysis
Traffic-MoE is a mixture-of-experts traffic transformer that claims up to 12.38% better detection Macro-F1 than dense pre-trained baselines while roughly doubling throughput and cutting latency by roughly half.
-
A Comprehensive Survey on Network Traffic Synthesis: From Statistical Models to Deep Learning
A survey reviewing statistical and deep learning approaches to synthetic network traffic generation, with comparisons, an AI comparison tool, open challenges, and future directions.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.