Pith. sign in

REVIEW 4 major objections 5 minor 66 references

One task to rule them all: A closer look at traffic classification generalizability

T0 review · 4 major / 5 minor · reviewed 2026-08-06 · deepseek-v4-flash

Pith's one-line read The paper shows that traffic classifiers trained on one real network's TLS traffic transfer poorly to another network's traffic on the identical 25-way service-identification task, with the best model reaching only 35% accuracy while a…

desk verdict A genuinely useful cross-network transfer study whose qualitative conclusion holds even though the headline 30-40% number is conditional on a curated 25-class task. read the letter →

arxiv 2507.06430 v1 pith:IHVYW7OT submitted 2025-07-08 cs.NI

classification cs.NI
keywords trafficclassificationwebsitefingerprintinggeneralizabilitydistributionshiftTLSserviceidentificationtransferlearningtime-seriesmodels
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Existing traffic classification and website fingerprinting methods report near-perfect accuracy, but this paper sets out to show that those numbers are tied to the dataset the method was designed on. It builds an evaluation framework from two large real-world TLS traffic collections gathered from different national networks in the same month, aligned to one identical task: predicting one of 25 destination services from the first 30 packets of a flow. Even with abundant labels and no concept drift between the collections, the best transferred accuracy is about 0.35, and a simple 1-Nearest-Neighbor classifier is close behind, so the paper's central claim is that distribution shift alone, not task difficulty, explains the gap. The paper concludes that evaluation choices, data-selection cutoffs, hyperparameters and training-process details, rather than model architecture, determine most of what is currently reported as classifier performance.

What carries the argument

The evaluation framework is the load-bearing object. It consists of two contemporaneous real-world TLS datasets, collected from large-scale networks in different countries (named CESNET and Orange in the paper), aligned to the identical 25-class service-identification task with matching input representations: inter-arrival times, payload sizes, and directions for the first 30 non-empty packets per flow, normalized so that the same preprocessing applies to both. Transfer is measured as the accuracy of a model trained on one network and evaluated on the other, with a same-dataset split as the reference point, and the framework controls for concept drift by using collections from the same time window. The surrounding analysis is carried by three mechanisms: the method-versus-model distinction (a 'method' is a recipe, a 'model' a trained artifact), a sweep of transformer architectures and learning-rate schedules, and a comparison of transferred versus same-dataset performance across multiple runs to separate model choice from training-process choice.

What would settle it

Collect a third TLS traffic dataset from a different large network covering the same 25 services in the same period, train on CESNET, and transfer: if the best transferred accuracy exceeds roughly 50%, well above the 30–40% band, the reported collapse would not be the general rule. Alternatively, measure real Encrypted-Client-Hello (ECH) traffic and compare flow timeseries features with non-ECH traffic; if ESNI/ECH changes handshake sizes, retransmissions, or packet timing, the framework's simulated safe area is not the deployment scenario it claims to model.

Watch

Extended reading notes

Core claim

On aligned real-world traffic from two independent networks, trained classifiers generalize poorly: UWTransformer's best transferred accuracy from one network's traffic to the other is 0.35, Flowpic's is 0.31, and DFattack's is below that, while the same models reach roughly 0.85–0.91 when tested on a held-out split of the training network's traffic. Because both traffic collections were made in the same period, the framework excludes concept drift, so the gap is attributed to distribution shift between networks. The paper also finds that larger, over-parameterized transformers transfer somewhat better than smaller ones and that the best deep model only slightly beats classical baselines (XGBoost and 1-NN), while the spread of results caused by different learning-rate schedules and normalization choices exceeds the spread between architectures. These results support the paper's central claim: high same-dataset performances in the literature are inflated by dataset-specific and model-specific properties, and a fair representation of a traffic classifier requires average-case, cross-dataset evaluation.

Load-bearing premise

The framework's realism rests on the assumption that the privacy difference between the two simulated areas, one with encrypted SNI and one without, would not change flow timeseries features such as TCP payload sizes, packet sequence, or timing, an assumption the paper does not test against real ESNI/ECH traffic.

Editorial extensions

If this is right

  • Published near-perfect accuracies on a single dataset do not predict performance in another real network, so a cross-network transfer test should precede any practical deployment of a traffic classifier.
  • Distribution shift alone, without concept drift, can cut accuracy by more than half, meaning retraining on newer data is not enough; the training distribution itself needs to match the deployment context.
  • Classical baselines such as 1-NN and XGBoost should be reported alongside deep models, because the best transformer in this study only slightly outranks them under distribution shift.
  • Performance differences between training processes (learning-rate schedules, normalization) exceed differences between architectures, so single-run accuracy numbers should be replaced by the full range of observed performances.
  • Larger over-parameterized models transfer slightly better, but the gain is small relative to the transfer gap, so architecture search is secondary to evaluation design.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If Encrypted SNI is widely deployed, a classifier trained on today's clear-SNI traffic from one region may be nearly useless on another region's encrypted traffic, implying that ISPs would need per-network labeled calibration or adaptation, not just a better model.
  • The framework can be extended into a transfer benchmark: adding a third independently collected TLS dataset and reporting both pairwise transfer directions would let the field rank methods by average transfer accuracy instead of single-dataset accuracy.
  • Since training-process variance exceeds model variance, many published comparisons may be unrepeatable even with the same datasets; reporting learning curves and pinned learning-rate schedules would sharpen future comparisons.
  • A testable extension is whether a small amount of labeled target-network traffic restores accuracy through fine-tuning; if it does, the practical prescription is adaptation strategies rather than new architectures.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. The paper studies whether traffic classification models generalize across independently collected networks when the task is identical and concept drift is absent. It first revisits three published time-series classifiers (DFattack, Flowpic, UWTransformer) on each other's datasets, finding that each performs best on its original evaluation dataset. It then constructs a transfer-learning benchmark from two real-world TLS datasets (CESNET and Orange, June and October 2021), aligning labels by applying CESNET's labeling function to Orange SNIs and selecting 25 shared classes, and aligning inputs to the first 30 non-empty packets per flow. On this benchmark, the best transferred accuracy is roughly 30-40%, with a 1-NN baseline close behind. The paper further examines the effect of architecture size, learning-rate schedules, and class-grouping on transfer performance.

Significance. If the findings are robust, the paper provides a valuable counterpoint to the high same-dataset accuracies in the traffic-classification literature and a reusable evaluation framework for distribution-shift studies. Strengths include the use of two large-scale real-world datasets collected at overlapping times, explicit alignment of labels and input features, a wide range of compared models including classical baselines, and released artifacts. The result that a simple 1-NN is competitive with trained deep models is a stark and useful observation. However, the headline numbers depend on several post hoc choices whose influence is not fully quantified.

major comments (4)
  1. [Section 5.2.3 / Section 5.1 Assumption 2] The 25-class label set is selected as the classes most frequent in both CESNET and Orange; because the selection is made after looking at the target dataset, the measured transfer accuracy is conditional on a curated classification problem that may not reflect the full label distribution an operator faces. The paper's Assumption 2 in Section 5.1 asserts that the class count is constrained to 25 in the intended deployment scenario, but no evidence is given from either dataset or from the cited IP-based constraint literature. Please report results on the full label set (e.g., the 103 classes observed in Orange under CESNET labels) or at least on a label set selected using only source information, and include per-class accuracy for rare classes. Without this, the 30-40% headline cannot be read as a statement about practical ESNI identification.
  2. [Section 6.2.1 / Figure 5 / Table 8] The reported best transferred accuracy is inconsistent across the paper. Section 6.2.1 states that UWTransformer's best transferred accuracy is 0.35 on Orange October, and Figure 5 shows this value, while Table 8 reports 0.2767 for the Full Model (UWTransformer) on the same target under the MinMax normalization used for all models in that table. The text explains that Figure 5 uses a Box-Cox IAT normalization selected on source validation, but the abstract's 'between 30% and 40%' is not clearly tied to either evaluation. Please unify the reported numbers, state which configuration the headline refers to, and discuss the effect of normalization on the headline range.
  3. [Section 6.2 / Figure 5 / Table 8] Transferred accuracies in Figure 5 are computed from only two training runs ('Each model was trained twice'), and Table 8 lists single point estimates without error bars. Given the paper's own demonstration that learning-rate schedules can change validation accuracy from 0.44 to 0.85 (Section 6.1.2, Figure 4), run-to-run variability is a plausible confound for the small differences between models (e.g., 0.35 vs 0.31). Please provide means and standard deviations (or individual runs) for at least the headline results, and for the Table 8 entries.
  4. [Section 5.1 Assumption 1] Assumption 1 states that ESNI/ECH adoption does not change flow time-series features such as TCP payload sizes and packet ordering; this is essential for the simulation's realism but is not validated against any ESNI/ECH traffic. Since ESNI changes the ClientHello size and may alter retransmission or timing behaviour, please provide evidence or a sensitivity analysis, or clearly present the result as a lower-bound simulation that abstracts away protocol-level changes.
minor comments (5)
  1. [Figure 5] The model name 'UWTranformer' is misspelled, and the bars do not include numeric values, making it hard to reconcile the figure with Table 8.
  2. [Section 4.2.3] 'Incidently' should be 'Incidentally'.
  3. [Section 5.2.3] The phrase 'the 25 classes that happened to be the most frequent in both datasets' should specify the exact criterion (e.g., minimum number of flows per class) and report how many classes were excluded because of low support.
  4. [Section 6.1.2] The footnote about CESNET time-series durations not reflecting entire flow durations is confusing; please state the timeout value and how truncated flows are handled in the feature extraction.
  5. [Table 2] The CESNET-25 size is listed as '1 million' but Table 6 reports 1.2 million selected flows; please reconcile these numbers.

Circularity Check

0 steps flagged · score 1.0 of 10

No derivation-level circularity: transfer accuracy is measured on held-out Orange data with source-only model selection; class-selection and ESNI-assumption concerns are validity risks, not circular reductions.

full rationale

The paper's central claim (best transferred accuracy of 30-40% from CESNET to Orange) is a direct measurement on a target dataset that was never used for model selection. Section 6.2.1 explicitly states that the reported results are "the best results seen for each model" and that "the adjustments were made only considering same-dataset performance, to avoid using information that would not be available at training time in practice." No parameter is fitted to the Orange target and then renamed as a prediction; learning-rate schedules, normalizations, window sizes, and architectures were all chosen using CESNET validation only (Sections 6.1, 6.2.1, Table 8, Figure 6). The reliance on the authors' own UWTransformer [4] is not load-bearing: the low transfer range holds for DFattack (0.31), Flowpic, XGBoost (0.22-0.23), and 1-NN (0.25), so the headline does not reduce to a self-citation chain. Two reviewer concerns are validity risks, not circularities. First, Section 5.2.3's selection of "the 25 classes that happened to be the most frequent in both datasets" conditions the reported 0.35 on a label set chosen post hoc on the target distribution; this could bias the headline in either direction, but the measured performance is still computed on held-out Orange flows under the paper's declared Assumption 2 (25-constrained task), so it is not a self-definitional reduction. Second, Assumptions 1 and 2 of Section 5.1 (ESNI/ECH does not alter timeseries features; 25 classes suffice) are asserted, not validated against real ESNI traffic, which limits realism but does not make the derivation equivalent to its inputs. No equation in the paper equates its output to its input, so no circular step can be exhibited; the correct finding is a near-zero circularity score with a minor, non-load-bearing self-citation.

Assumptions & free parameters 5 free parameters · 4 assumptions · 0 invented entities

The central claim rests primarily on domain assumptions about the ESNI scenario and on dataset alignment choices, plus a handful of hand-picked preprocessing and training hyperparameters. No new physical or computational entities are introduced. The free parameters are mostly standard machine-learning choices, but the 25-class selection and the 5-second IAT bound are consequential for the reported transfer numbers.

free parameters (5)
  • IAT upper bound = 5 seconds
    Chosen based on the shape of the CESNET IAT distribution (Section 5.2.5) and applied to both datasets. It defines the input features and can affect cross-dataset transfer results.
  • Flowpic window_size = 500 ms for transfer experiments; 60 s and 240 s for other evaluations
    Window size controls the information content of each snapshot and strongly changes Flowpic's accuracy (Table 4: 0.12 to 0.63). In Section 6.2.1, the transfer value of 500 ms was chosen between CESNET's 50th and 75th flow-duration percentiles.
  • Box-Cox IAT normalization transform = Lambda fitted on CESNET
    Used for UWTransformer's best transferred performance in Section 6.2.1. The transform is fitted to the source dataset, so it is a fitted parameter rather than a fixed preprocessing step.
  • Selected 25 most frequent classes = 25 SNI classes
    Section 5.2.3: after applying CESNET's labeling function to Orange, the 25 classes most frequent in both datasets were selected. The headline 30-40% transfer accuracy is specific to this class set.
  • Learning rate schedules = Custom sequences, e.g., [10^-3, 10^-4, 10^-5, 10^-6, 10^-7]
    Each model was trained with schedules chosen to maximize same-dataset validation accuracy (Section 6.1.2). These choices affect which architecture appears most generalizable in Table 8 and Figure 6.
assumptions (4)
  • domain assumption ESNI/ECH deployment does not alter flow time-series features such as packet sizes, sequences, and timing
    Section 5.1, Assumption 1. This is the core scenario assumption for the 'safe area' simulation; if false, the framework does not model real Encrypted SNI traffic.
  • domain assumption The two datasets, after alignment, represent the same classification task
    Sections 5.2.3-5.2.4: label and input alignment procedures are intended to make CESNET and Orange represent the same 25-way service identification task; any residual mismatch is attributed to distribution shift.
  • ad hoc to paper Only time-series features are available in the safe area; labels come from unsafe area
    Section 5.1, Assumptions 2-3: the task model constrains labels to 25 by IP addresses and supposes abundant labeled data in the unsafe area. These are scenario simplifications, not empirically verified.
  • domain assumption Concept drift is absent because CESNET and Orange October were collected around the same time
    Section 5: 'collected from different large-scale networks, but around the same time.' This justifies attributing the transfer gap to distribution shift rather than concept drift; it is not directly verified (e.g., via timestamps or protocol version checks).

how reviews work

0 comments
Cite this review

Pith. "Pith review of One task to rule them all: A closer look at traffic classification generalizability." pith.science (2026). https://pith.science/paper/IHVYW7OT

@misc{pith2026250706430,
  author       = {Pith},
  title        = {Pith review of: One task to rule them all: A closer look at traffic classification generalizability},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/IHVYW7OT}},
  note         = {Machine review of arXiv:2507.06430}
}
read the original abstract

Existing website fingerprinting and traffic classification solutions do not work well when the evaluation context changes, as their performances often heavily rely on context-specific assumptions. To clarify this problem, we take three prior solutions presented for different but similar traffic classification and website fingerprinting tasks, and apply each solution's model to another solution's dataset. We pinpoint dataset-specific and model-specific properties that lead each of them to overperform in their specific evaluation context. As a realistic evaluation context that takes practical labeling constraints into account, we design an evaluation framework using two recent real-world TLS traffic datasets from large-scale networks. The framework simulates a futuristic scenario in which SNIs are hidden in some networks but not in others, and the classifier's goal is to predict destination services in one network's traffic, having been trained on a labelled dataset collected from a different network. Our framework has the distinction of including real-world distribution shift, while excluding concept drift. We show that, even when abundant labeled data is available, the best solutions' performances under distribution shift are between 30% and 40%, and a simple 1-Nearest Neighbor classifier's performance is not far behind. We depict all performances measured on different models, not just the best ones, for a fair representation of traffic models in practice.

Figures

Figures reproduced from arXiv: 2507.06430 by the authors.

Figure 1
Figure 1. DFattack’s performance on Undefended with [PITH_FULL_IMAGE:figures/full_fig_p007_1.png] view at source ↗
Figure 2
Figure 2. Sequence lengths in Undefended and Orange [PITH_FULL_IMAGE:figures/full_fig_p008_2.png] view at source ↗
Figure 3
Figure 3. Label frequencies in Orange datasets 5.2.4 Input alignment. The original CESNET dataset includes time series sequences only for the first 30 packets of a flow that have a payload. The sequence includes inter-arrival time, direction, and payload size for each non-empty packet. In contrast, Orange timeseries features originally include all packets in a flow, and sizes in the time series reflect packet sizes. Since Ora… view at source ↗
Figures from the paper (3 more)
Figure 4
Figure 4. Figure 4: Effect of learning rate on First Model’s train [PITH_FULL_IMAGE:figures/full_fig_p011_4.png]
Figure 5
Figure 5. Figure 5: Best CESNET to Orange October performance [PITH_FULL_IMAGE:figures/full_fig_p012_5.png]
Figure 7
Figure 7. Figure 7: Model performances on tasks with different [PITH_FULL_IMAGE:figures/full_fig_p013_7.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

66 extracted references · 51 canonical work pages

  1. [1]

    Giuseppe Aceto, Domenico Ciuonzo, et al. 2019. Mobile encrypted traffic classification using deep learning: Experimental evaluation, lessons learned, and challenges. IEEE Transactions on Network and Service Management 16, 2 (2019), 445–458

  2. [2]

    Giuseppe Aceto, Domenico Ciuonzo, Antonio Montieri, and Antonio Pescapè. 2019. MIMETIC: Mobile encrypted traffic classification using multimodal deep learning. In Computer networks, Vol. 165. Elsevier, 106944

  3. [3]

    Giuseppe Aceto, Domenico Ciuonzo, Antonio Montieri, and Antonio Pescapé. 2020. Toward effective mobile encrypted traffic classification through deep learning. Neurocomputing 409 (2020), 306–315

  4. [4]

    Tahmid, Navid Malekghaeini, M.A

    Elham Akbari, Sheikh A. Tahmid, Navid Malekghaeini, M.A. Salahud- din, Noura Limam, Raouf Boutaba, et al . 2023. A Critical Study of Few-shot Learning for Encrypted Traffic Classification. In Proceedings of 19th International Conference on Service and Network Management

  5. [5]

    Iman Akbari, Mohammad A Salahuddin, Leni Ven, Noura Limam, Raouf Boutaba, Bertrand Mathieu, Stephanie Moteau, and Stephane Tuffin. 2021. A look behind the curtain: traffic classification in an increasingly encrypted web. Proceedings of the ACM on Measurement and Analysis of Computing Systems 5, 1 (2021), 1–26

  6. [6]

    Blake Anderson and David McGrew. 2017. Machine learning for en- crypted malware traffic classification: accounting for noisy labels and non-stationarity. In Proceedings of the 23rd ACM SIGKDD International Conference on knowledge discovery and data mining . 1723–1732

  7. [7]

    Martin Arjovsky, Léon Bottou, Ishaan Gulrajani, and David Lopez-Paz

  8. [8]

    Daniel Arp, Erwin Quiring, Feargus Pendlebury, Alexander Warnecke, Fabio Pierazzi, Christian Wressnegger, Lorenzo Cavallaro, and Konrad Rieck. 2022. Dos and don’ts of machine learning in computer security. In 31st USENIX Security Symposium (USENIX Security 22) . 3971–3988

Show all 66 references
  1. [9]

    Roman Beltiukov, Wenbo Guo, Arpit Gupta, and Walter Willinger

  2. [10]

    Francesco Bronzino, Paul Schmitt, Sara Ayoubi, Guilherme Martins, Renata Teixeira, and Nick Feamster. 2019. Inferring streaming video quality from encrypted traffic: Practical models and deployment ex- perience. Proceedings of the ACM on Measurement and Analysis of Computing S...

  3. [11]

    Tianqi Chen and Carlos Guestrin. 2016. Xgboost: A scalable tree boosting system. (2016), 785–794

  4. [12]

    Alexander D’Amour, Katherine Heller, Dan Moldovan, Ben Adlam, Babak Alipanahi, Alex Beutel, Christina Chen, Jonathan Deaton, Ja- cob Eisenstein, Matthew D Hoffman, et al. 2022. Underspecification presents challenges for credibility in modern machine learning. The Journal of Ma...

  5. [13]

    Shai Ben David, Tyler Lu, Teresa Luu, and Dávid Pál. 2010. Impossibil- ity theorems for domain adaptation. In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics . JMLR Workshop and Conference Proceedings, 129–136

  6. [14]

    Xinhao Deng, Qilei Yin, Zhuotao Liu, Xiyuan Zhao, Qi Li, Mingwei Xu, Ke Xu, and Jianping Wu. 2023. Robust Multi-tab Website Finger- printing Attacks in the Wild. In 2023 IEEE Symposium on Security and Privacy (SP). 1005–1022. doi:10.1109/SP46215.2023.10179464

  7. [15]

    Gerard Draper-Gil, Arash Habibi Lashkari, Mohammad Saiful Islam Mamun, and Ali A Ghorbani. 2016. Characterization of encrypted and vpn traffic using time-related. In Proceedings of the 2nd international 14 One Task to Rule Them All: A Closer Look at Traffic Classification Gene...

  8. [16]

    Tongtong Fang, Nan Lu, Gang Niu, and Masashi Sugiyama. 2020. Rethinking importance weighting for deep learning under distribution shift. Advances in neural information processing systems 33 (2020), 11996–12007

  9. [17]

    Alessandro Finamore, Chao Wang, Jonatan Krolikowski, Jose M Navarro, Fuxing Chen, and Dario Rossi. 2023. Replication: Contrastive learning and data augmentation in traffic classification using a Flow- pic input representation. In Proceedings of the 2023 ACM on internet measure...

  10. [18]

    Pierre Foret, Ariel Kleiner, Hossein Mobahi, and Behnam Neyshabur

  11. [19]

    Saurabh Garg, Sivaraman Balakrishnan, Zachary C Lipton, Behnam Neyshabur, and Hanie Sedghi. 2022. Leveraging unlabeled data to pre- dict out-of-distribution performance. arXiv preprint arXiv:2201.04234 (2022)

  12. [20]

    Robert Geirhos, Jörn-Henrik Jacobsen, Claudio Michaelis, Richard Zemel, Wieland Brendel, Matthias Bethge, and Felix A Wichmann

  13. [21]

    Jingyu Guo et al. 2022. Global-Aware Prototypical Network for Few- Shot Encrypted Traffic Classification. In 2022 IFIP Networking Confer- ence (IFIP Networking). IEEE, 1–9

  14. [22]

    Satyandra Guthula, Navya Battula, Roman Beltiukov, Wenbo Guo, and Arpit Gupta. 2023. netFound: Foundation Model for Network Security. arXiv preprint arXiv:2310.17025 (2023)

  15. [23]

    Dominik Herrmann, Rolf Wendolsky, and Hannes Federrath. 2009. Website fingerprinting: attacking popular privacy enhancing tech- nologies with the multinomial naïve-bayes classifier. In Proceedings of the 2009 ACM workshop on Cloud computing security

  16. [24]

    Nature Machine Intelligence 2, 11 (2020), 665–673

    Shortcut learning in deep neural networks. Nature Machine Intelligence 2, 11 (2020), 665–673

  17. [25]

    Jordan Holland, Paul Schmitt, Nick Feamster, and Prateek Mittal. 2021. New directions in automated traffic analysis. InProceedings of the 2021 ACM SIGSAC Conference on Computer and Communications Security . 3366–3383

  18. [26]

    Eyal Horowicz, Tal Shapira, and Yuval Shavitt. 2022. A few shots traffic classification with mini-FlowPic augmentations. In Proceedings of the 22nd ACM Internet Measurement Conference . 647–654

  19. [27]

    Ting-Li Huoh, Yan Luo, Peilong Li, and Tong Zhang. 2023. Flow- Based Encrypted Network Traffic Classification With Graph Neural Networks. IEEE Transactions on Network and Service Management 20, 2 (2023), 1224–1237. doi:10.1109/TNSM.2022.3227500

  20. [28]

    Nguyen Phong Hoang, Arian Akhavan Niaki, Nikita Borisov, Phillipa Gill, and Michalis Polychronakis. 2020. Assessing the privacy benefits of domain name encryption. In Proceedings of the 15th ACM Asia Conference on Computer and Communications Security . 290–304

  21. [29]

    2010.{YAF}: Yet Another Flowmeter

    Christopher M Inacio and Brian Trammell. 2010.{YAF}: Yet Another Flowmeter. In24th Large Installation System Administration Conference (LISA 10)

  22. [30]

    Arthur S Jacobs, Roman Beltiukov, Walter Willinger, Ronaldo A Fer- reira, Arpit Gupta, and Lisandro Z Granville. 2022. Ai/ml for network security: The emperor has no clothes. In Proceedings of the 2022 ACM SIGSAC Conference on Computer and Communications Security . 1537– 1551

  23. [31]

    Yiding Jiang, Behnam Neyshabur, Hossein Mobahi, Dilip Krishnan, and Samy Bengio. 2019. Fantastic generalization measures and where to find them. arXiv preprint arXiv:1912.02178 (2019)

  24. [32]

    Romain Ilbert, Ambroise Odonnat, Vasilii Feofanov, Aladin Virmaux, Giuseppe Paolo, Themis Palpanas, and Ievgen Redko. 2024. SAM- former: unlocking the potential of transformers in time series forecast- ing with sharpness-aware minimization and channel-wise attention. , Article...

  25. [33]

    Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)

  26. [34]

    Pang Wei Koh, Shiori Sagawa, Henrik Marklund, Sang Michael Xie, Marvin Zhang, Akshay Balsubramani, Weihua Hu, Michihiro Ya- sunaga, Richard Lanas Phillips, Irena Gao, et al. 2021. Wilds: A bench- mark of in-the-wild distribution shifts. In International conference on machine l...

  27. [35]

    Atli Kosson, Bettina Messmer, and Martin Jaggi. 2024. Rotational equi- librium: how weight decay balances learning across neural networks. , Article 1015 (2024), 37 pages

  28. [36]

    Marc Juarez, Sadia Afroz, Gunes Acar, Claudia Diaz, and Rachel Green- stadt. 2014. A critical evaluation of website fingerprinting attacks. In Proceedings of the 2014 ACM SIGSAC Conference on Computer and Communications Security. 263–274

  29. [37]

    2022.{FOAP}:{Fine-Grained}{ Open-World} android app fingerprinting

    Jianfeng Li, Hao Zhou, Shuohan Wu, Xiapu Luo, Ting Wang, Xian Zhan, and Xiaobo Ma. 2022.{FOAP}:{Fine-Grained}{ Open-World} android app fingerprinting. In 31st USENIX Security Symposium (USENIX Security 22). 1579–1596

  30. [38]

    Xinjie Lin et al. 2022. Et-bert: A contextualized datagram representa- tion with pre-training transformers for encrypted traffic classification. In Proceedings of the ACM Web Conference 2022 . 633–642

  31. [39]

    Liyuan Liu, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, and Jiawei Han

  32. [40]

    Arash Habibi Lashkari, Gerard Draper Gil, Mohammad Saiful Islam Mamun, and Ali A Ghorbani. 2017. Characterization of tor traffic using time based features. In International Conference on Information Systems Security and Privacy , Vol. 2. SciTePress, 253–262

  33. [41]

    Navid Malekghaini, Elham Akbari, Mohammad A Salahuddin, Noura Limam, Raouf Boutaba, Bertrand Mathieu, Stephanie Moteau, and Stephane Tuffin. 2022. Data Drift in DL: Lessons Learned from En- crypted Traffic Classification. In 2022 IFIP Networking Conference (IFIP Networking). IEEE, 1–9

  34. [42]

    Alfredo Nascita, Antonio Montieri, Giuseppe Aceto, Domenico Ciuonzo, Valerio Persico, and Antonio Pescapé. 2021. XAI meets mo- bile traffic classification: Understanding and improving multimodal deep learning architectures. IEEE Transactions on Network and Service Management 1...

  35. [43]

    Behnam Neyshabur, Hanie Sedghi, and Chiyuan Zhang. 2020. What is being transferred in transfer learning? Advances in neural information processing systems 33 (2020), 512–523

  36. [44]

    arXiv preprint arXiv:2004.08249 (2020)

    Understanding the difficulty of training transformers. arXiv preprint arXiv:2004.08249 (2020)

  37. [45]

    Jan Luxemburk and Tomáš Čejka. 2023. Fine-grained TLS services classification with reject option.Computer Networks 220 (2023), 109467. doi:10.1016/j.comnet.2022.109467

  38. [46]

    Mohammad Saidur Rahman, Payap Sirinam, Nate Mathews, Kan- tha Girish Gangadhara, and Matthew Wright. 2019. Tik-tok: The utility of packet timing in website fingerprinting attacks.arXiv preprint arXiv:1902.06421 (2019)

  39. [47]

    Tal Shapira and Yuval Shavitt. 2019. Flowpic: Encrypted internet traffic classification is as easy as image recognition. In IEEE INFOCOM 2019- IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). IEEE, 680–687. 15 Elham Akbari, Zihao Zhou, M. A. Salahuddin, N...

  40. [48]

    Payap Sirinam et al. 2019. Triplet fingerprinting: More practical and portable website fingerprinting with n-shot learning. In Proceedings of the 2019 ACM SIGSAC Conference on Computer and Communications Security. 1131–1148

  41. [49]

    Yuqi Nie, Nam H Nguyen, Phanwadee Sinthong, and Jayant Kalagnanam. 2023. A Time Series is Worth 64 Words: Long-term Forecasting with Transformers. In The Eleventh International Confer- ence on Learning Representations . https://openreview.net/forum?id= Jbdc0vTOcol

  42. [50]

    Julien Piet, Dubem Nwoji, and Vern Paxson. 2023. GGFAST: Automat- ing Generation of Flexible Network Traffic Classifiers. In Proceedings of the ACM SIGCOMM 2023 Conference . 850–866

  43. [51]

    Vincent F Taylor, Riccardo Spolaor, Mauro Conti, and Ivan Martinovic

  44. [52]

    Thijs Van Ede, Riccardo Bortolameotti, Andrea Continella, Jingjing Ren, Daniel J Dubois, Martina Lindorfer, David Choffnes, Maarten van Steen, and Andreas Peter. 2020. Flowprint: Semi-supervised mobile- app fingerprinting on encrypted network traffic. In Network and dis- tribu...

  45. [53]

    Tao Wang and Ian Goldberg. 2016. On Realistically Attacking Tor with Website Fingerprinting. Proc. Priv. Enhancing Technol. 2016, 4 (2016), 21–36

  46. [54]

    Payap Sirinam, Mohsen Imani, Marc Juarez, and Matthew Wright. 2018. Deep fingerprinting: Undermining website fingerprinting defenses with deep learning. In Proceedings of the 2018 ACM SIGSAC conference on computer and communications security . 1928–1943

  47. [55]

    Leslie N. Smith. 2017. Cyclical Learning Rates for Training Neural Networks. In 2017 IEEE Winter Conference on Applications of Computer Vision (W ACV). 464–472. doi:10.1109/WACV.2017.58

  48. [56]

    Ailing Zeng, Muxi Chen, Lei Zhang, and Qiang Xu. 2023. Are trans- formers effective for time series forecasting?. In Proceedings of the AAAI conference on artificial intelligence , Vol. 37. 11121–11128

  49. [57]

    Ruijie Zhao, Xianwen Deng, Zhicong Yan, Jun Ma, Zhi Xue, and Yijun Wang. 2022. Mt-flowformer: A semi-supervised flow transformer for encrypted traffic classification. InProceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining . 2576–2584

  50. [58]

    Personal Data Pro- tection

    Guangmeng Zhou, Xiongwen Guo, Zhuotao Liu, Tong Li, Qi Li, and Ke Xu. 2024. Trafficformer: an efficient pre-trained model for traffic data. In 2025 IEEE Symposium on Security and Privacy (SP) . IEEE Computer Society, 102–102. A Ethics The datasets used in this work were all pu...

  51. [60]

    Wei Wang, Ming Zhu, Jinlin Wang, Xuewen Zeng, and Zhongzhen Yang. 2017. End-to-end encrypted traffic classification with one- dimensional convolution neural networks. In 2017 IEEE international conference on intelligence and security informatics (ISI) . IEEE, 43–48

  52. [61]

    Lixuan Yang, Alessandro Finamore, Feng Jun, and Dario Rossi. 2021. Deep learning and zero-day traffic classification: Lessons learned from a commercial-grade dataset. In IEEE Transactions on Network and Service Management, Vol. 18. IEEE, 4103–4118

  53. [65]

    All the snapshots have the same duration, e.g., 60 seconds, and may overlap depending on a step size, e.g., 15 seconds

    proposes a data augmentation method to increase the size of the small original dataset by moving a window over each flow and taking snapshots of the flow. All the snapshots have the same duration, e.g., 60 seconds, and may overlap depending on a step size, e.g., 15 seconds. Th...

  54. [66]

    correctly

    according to [5], which resulted in 320K flows in total. The dataset is labeled by SNIs, which can be mapped to 8 service classes using a method described by [5], resulting in 51K labeled flows. Each data item in the dataset is a bidirec- tional flow, which is the same as the ...

  55. [2016]

    In 2016 IEEE European Symposium on Security and Privacy (EuroS&P)

    Appscanner: Automatic fingerprinting of smartphone apps from encrypted network traffic. In 2016 IEEE European Symposium on Security and Privacy (EuroS&P) . IEEE, 439–454

  56. [2019]

    arXiv preprint arXiv:1907.02893 (2019)

    Invariant risk minimization. arXiv preprint arXiv:1907.02893 (2019)

  57. [2020]

    arXiv preprint arXiv:2010.01412 (2020)

    Sharpness-aware minimization for efficiently improving gener- alization. arXiv preprint arXiv:2010.01412 (2020)

  58. [2023]

    In Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security

    In Search of netUnicorn: A Data-Collection Platform to De- velop Generalizable ML Models for Network Security Problems. In Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security. 2217–2231

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.