{"id":"1efd47c8-0882-4b39-8697-4ac2715100ae","arxiv_id":"2502.09001","paper_version":1,"verdict":"REJECT","confidence":"MODERATE","novelty_score":2.0,"correctness_risk":"high","formal_verification":"none","parameter_count":9,"one_line_summary":"A stacking ensemble of KNN, SVM, XGBoost, and ANN is claimed to reach 94.3% accuracy on network anomaly detection, but no dataset, code, or privacy analysis is provided.","lead":"This paper stacks KNN, SVM, XGBoost, and a neural network into an ensemble for network anomaly detection, reporting 94.3% accuracy while claiming differential privacy safeguards. A generalist might read it to see whether basic privacy noise can be added to standard classifiers, but the paper lacks the dataset, code, and privacy details needed to support the claim.","discovery_kind":"incremental","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The privacy-utility balance is unsubstantiated: the DP mechanism and ε are unspecified, two incompatible noise-application descriptions appear in §III-D and §IV-A, and no with/without-privacy accuracy comparison is reported.","rationale":"I read the paper in good faith as claiming a specific achievement: a hybrid ensemble that simultaneously ensures differential privacy and maintains high detection accuracy. For that central claim to hold, the DP mechanism must be concretely specified and must be shown to preserve utility. The paper provides neither. The internal inconsistency between adding noise to the dataset (§III-D) and adding noise to gradients/weights (§IV-A) strongly suggests that no actual DP mechanism was implemented or validated. The reader's weakest_assumption identified exactly this point, and I agree it is the most load-bearing concern. Even if the 94.3% accuracy were reproducible on raw data, it would not support the 'privacy-preserving' label without a privacy analysis. Other serious issues exist, such as the absence of dataset identity, train/test split, error bars, and code, but those primarily affect reproducibility; the privacy-utility tradeoff is uniquely load-bearing for the paper's stated contribution. Therefore the REJECT verdict remains appropriate, and I do not recommend changing it.","tokens_in":3913,"tokens_out":4813,"duration_ms":50827,"concrete_test":"Require the authors to identify the dataset and rerun the same ensemble under a concrete DP mechanism (e.g., DP-SGD with stated ε and δ, or Laplace noise calibrated to a specified sensitivity), reporting accuracy and F1 for ε ∈ {0.1, 1, 10} and for the non-private baseline. If the privacy-preserving variant's accuracy falls materially below the claimed 94.3%, or if no ε can be supplied, the central privacy-utility balance claim is unsupported.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central claim is that the ensemble is 'privacy-preserving' while retaining 94.3% accuracy and 93.5% F1 (Table I, Section V). For this to hold, the differential privacy mechanism must provide a real privacy guarantee without destroying the signal. The paper never specifies a concrete DP mechanism, privacy budget (ε, δ), noise scale, or sensitivity. Worse, Section III-D says noise was added to the dataset to prevent re-identification, while Section IV-A says noise was added to gradients or weights during training; these are mutually incompatible descriptions. No ablation compares the ensemble's accuracy with and without privacy, so there is no evidence that a meaningful privacy guarantee would still permit the reported 94.3% accuracy. If an actual ε-DP guarantee (e.g., ε < 10) were enforced, utility could drop substantially, and the paper provides no analysis ruling this out. This is the load-bearing weakness: without a defined privacy mechanism and a measured privacy-utility tradeoff, the 'privacy-preserving' claim and the reported high accuracy cannot both be substantiated.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper proposes a hybrid ensemble model for network anomaly detection that combines KNN, SVM, XGBoost, and ANN, with logistic regression as the meta-learner. The preprocessing pipeline includes similarity-based oversampling, Z-score and KNN-based outlier detection, and several claimed privacy mechanisms such as anonymization, federated learning, secure multi-party computation, and differential privacy. The empirical contribution is a single table (Table I) reporting accuracy, precision, recall, and F1-score for FM, SVM, XGBoost, ANN, and the ensemble, with the ensemble achieving 94.3% accuracy and 93.5% F1-score. The paper concludes that this ensemble outperforms the individual models while ensuring privacy and security.","tokens_in":4211,"tokens_out":3721,"duration_ms":38822,"significance":"The would-be contribution is incremental: an ensemble of standard classifiers with standard preprocessing, framed with privacy-preserving terminology. The paper gives no dataset identifier, no experimental protocol, no code, and no privacy accounting, so the central claims are not verifiable. If the reported numbers came with reproducible experiments and a concrete differential-privacy guarantee, the paper would be a modest but useful data point; as written, it provides no falsifiable evidence and no implementation that another group could check.","major_comments":[{"comment":"Table I is the entire empirical support for the paper's central claim, but it reports only point estimates with no dataset name, no sample size, no train/test split, no cross-validation scheme, and no error bars. Without this information, the 1.8-percentage-point accuracy gap between ANN (92.1%) and the ensemble (94.3%) cannot be distinguished from noise, and the claim that the ensemble is superior is unsupported.","section":"Section V, Table I"},{"comment":"The privacy-preserving claim is load-bearing but unsubstantiated. Section III-D states that differential privacy was applied by adding controlled noise to the dataset to prevent re-identification, while Section IV-A states that noise was added to gradients or weights during training. These are incompatible descriptions with different sensitivity and privacy-accounting requirements. No privacy budget (epsilon, delta), noise scale, sensitivity, or with/without-privacy ablation is reported, so the abstract and conclusion's claim of balancing privacy and accuracy is not supported.","section":"Section III-D and Section IV-A"},{"comment":"The ensemble is a logistic regression meta-learner fit to the outputs of the base models, but the manuscript does not state whether Table I was computed on the same data used to fit the logistic regression weights. If the evaluation is in-sample, the ensemble's improvement is expected by construction and is not evidence of generalization. A nested cross-validation or held-out test set is required to validate the reported ensemble advantage.","section":"Section IV-G and Table I"},{"comment":"The model description is internally inconsistent. The ensemble combiner in Eq. (12) is said to combine KNN, ANN, SVM, and XGBoost outputs, but Table I reports 'FM' rather than KNN and gives no results for KNN. Conversely, the factorization machine described in Section IV-C and Eq. (6) is never included in the ensemble combiner. This makes the reported comparison impossible to reconstruct from the text.","section":"Section IV-B, IV-C, IV-G, and Table I"}],"minor_comments":[{"comment":"The keyword heading is misspelled as 'Kerwords'; this should be 'Keywords'.","section":"Abstract and keywords"},{"comment":"The class distribution, cluster similarity graph, and box plots are referenced as Figures 1-3, but no actual data values or axis labels are provided, so these figures are illustrative rather than reproducible.","section":"Section III-A and Figures 1-3"},{"comment":"Reference [5] on financial sentiment analysis with FinBERT and GPT-4o is unrelated to the network anomaly detection topic and should be removed or integrated with a direct connection to the paper's argument.","section":"Section II"},{"comment":"The focal loss formula is written for a single predicted probability y-hat, but the text says it is used for multi-class scenarios; the standard multi-class form with per-class alpha_t and p_t should be given to avoid ambiguity.","section":"Equation (14)"},{"comment":"The 'Security of the Model' subsection lists adversarial training, model hardening, and secure deployment, but none of these techniques are evaluated or connected to the experimental results, so they should be presented as design considerations rather than validated contributions.","section":"Section IV-H"}],"recommendation":"reject","confidential_remarks":"The manuscript is not ready for review in its current form because the central empirical and privacy claims are unsupported by any reproducible protocol, dataset, or privacy accounting. The inconsistencies between Section III-D and Section IV-A, and between the model list in Eq. (12) and Table I, are not local presentation issues; they concern the core claims. I would not consider a resubmission unless the authors add a complete experimental setup on a named dataset, report error bars, specify and evaluate the differential-privacy mechanism with a concrete epsilon, and align the model description with the reported results."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Briefly: the paper's contribution is a routine stacking ensemble (KNN/SVM/XGBoost/ANN combined by logistic regression) with no dataset, no experimental protocol, and a privacy claim that is internally inconsistent. The central result—94.3% accuracy and 93.5% F1—comes from a single table with no dataset name, no CV, no error bars, and no code. That is not a minor omission; it is the entire empirical foundation.\n\nWhat the paper does well: it is clearly written as a survey of textbook methods. The related work is honest and relevant, and the one self-citation (Yang et al., federated XGBoost) is a legitimate building block, not padding. The equations for KNN, SVM, XGBoost, cross-entropy and focal loss are correct as far as they go. As a refresher on standard anomaly-detection ingredients, it would be fine.\n\nThe soft spots are serious. The stress-test is right: §III-D says noise was added to the dataset, §IV-A says noise was added to gradients or weights. Those are different mechanisms, and neither is tied to a privacy budget (ε, δ) or a noise scale. No with/without-privacy ablation appears, so there is no evidence that a meaningful DP guarantee would leave accuracy anywhere near 94.3%. The architecture itself is muddled: the text says KNN feeds feature analysis, FM generates embeddings, ANN learns from them, and the ensemble combines KNN, ANN, SVM, and XGBoost—yet Table I reports FM rather than KNN and omits KNN entirely. A reader cannot tell which models are actually stacked. Minor issues: 'security' measures (SMPC, adversarial training, model hardening) are asserted without any evaluation, and some notation is sloppy. None of these are fatal if the paper were repositioned as a position paper, but the empirical claims make it a research paper.\n\nMy take: this deserves a desk reject, not a referee. If the authors release data, code, a proper train/test protocol, and a real DP analysis (with an accuracy-versus-ε curve), it could become a modest but acceptable workshop paper. Until then it is not a serious candidate for publication.","headline":"A clear, readable survey of standard techniques, but the headline accuracy and privacy claims rest on an unverifiable table and a self-contradictory DP description.","tokens_in":4712,"tokens_out":2441,"would_cite":false,"duration_ms":22108,"reading_group":"no","serious_thinker":"no","would_accept_peer_review":false},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"A hybrid ensemble of KNN, SVM, XGBoost, and ANN reports 94.3% accuracy on network anomaly detection while claiming privacy preservation.","keywords":["network anomaly detection","privacy-preserving machine learning","ensemble learning","K-nearest neighbors","support vector machine","XGBoost","artificial neural network","differential privacy"],"falsifier":"Run the same pipeline on a named public intrusion dataset such as NSL-KDD or CICIDS2017 with a stated differential-privacy budget, for example $\\epsilon = 1$, and compare accuracy with and without noise; if the ensemble's accuracy drops materially below 94.3% or if no epsilon can be specified, the central claim is falsified.","tokens_in":3763,"feed_emoji":"🛡️","tokens_out":5565,"duration_ms":52627,"temperature":0.7,"pith_summary":"This paper proposes a hybrid ensemble for network anomaly detection that combines K-nearest neighbors, support vector machines, XGBoost, and an artificial neural network, with a logistic regression layer blending their outputs. The authors report that the ensemble reaches 94.3% accuracy and a 93.5% F1-score on their unnamed network dataset, outperforming each of the four individual models. They argue that the system also protects sensitive traffic data by preprocessing that includes anonymization and the addition of differential-privacy noise, alongside adversarial training and secure deployment. The privacy-preserving component is stated as a design feature rather than a measured guarantee, since no privacy budget or ablation with and without noise is reported.","feed_headline":"Four-model ensemble detects network anomalies at 94.3% accuracy","feed_subtitle":"Stacking four classifiers beats each one alone, with privacy by noise and anonymization.","key_machinery":"The key object is the ensemble itself: KNN with k=5 is used for clustering and feature importance, its outputs feed factorization machines whose embedding vectors are passed to an ANN, while SVM and XGBoost are trained in parallel, and all four outputs are combined by a logistic regression (or softmax) layer. The other load-bearing components are the preprocessing steps: similarity-based interpolation for minority classes (a SMOTE-like formula), z-score and KNN outlier handling, and the differential-privacy noise addition described in Section III-D. The ensemble formula is the stacking step, and the paper attributes the performance gain to the diversity of the four learners.","core_discovery":"The paper sets out to show that a logistic-regression ensemble of KNN, SVM, XGBoost, and ANN detects network anomalies better than any of its components, and that the same model can be made privacy-preserving by anonymizing sensitive fields, adding differential-privacy noise, and applying adversarial training. In the reported experiments the ensemble reaches 94.3% accuracy and a 93.5% F1-score, ahead of the strongest single model, ANN, at 92.1% accuracy and 91.5% F1. The privacy-preserving aspects are asserted as part of the design; the paper does not report an epsilon value, noise scale, or a with/without privacy comparison, so the accuracy figure is not tied to a stated privacy guarantee.","pith_inferences":["The paper does not name its dataset or report a privacy budget, so the privacy discussion may be illustrative; a testable extension would be to re-run the ensemble on NSL-KDD or CICIDS2017 with a concrete epsilon and measure the accuracy drop.","Because the ensemble uses logistic regression stacking on only four models, the same framework could be extended to include newer classifiers, such as differently configured gradient-boosted trees or transformer-based tabular models, and the marginal gain from each could be measured.","The privacy-preserving claim would be strengthened by an ablation that toggles each privacy mechanism (anonymization, noise, adversarial training) and reports accuracy, F1, and a privacy metric such as epsilon or membership-inference risk; the current paper leaves that as future work."],"forward_implications":["If the ensemble result holds, practitioners can expect a 2–3 point accuracy gain from stacking these four classifiers over the best single model on imbalanced intrusion data.","The preprocessing combination of similarity-based oversampling and z-score/KNN outlier filtering can be reused as a general recipe for small, imbalanced network datasets.","If the privacy techniques are made quantitative with an epsilon and noise scale, the architecture could be adapted for cross-silo federated deployment where raw traffic cannot be shared.","The performance ranking with XGBoost and ANN above SVM and FM on this dataset gives a baseline expectation for which individual models dominate in similar anomaly-detection tasks."],"supporting_citations":[{"why":"Supplies the federated XGBoost with differential privacy approach that motivates combining privacy with anomaly detection.","marker":"[1]"},{"why":"Provides the SMOTE-based balancing method that the paper adapts into its similarity-based sampling for minority classes.","marker":"[2]"},{"why":"Shows the effectiveness of hybrid SVM-KNN models, supporting the idea of combining classifiers for anomaly detection.","marker":"[3]"},{"why":"Highlights poisoning attacks on federated learning, motivating the adversarial training and secure deployment components of the proposed model.","marker":"[4]"}],"fun_headline_variants":["Privacy-preserving 4-model ensemble hits 94.3% accuracy on anomalies","Hybrid ensemble with privacy noise reaches 94.3% detection accuracy","Stacking KNN, SVM, XGBoost, ANN: 94.3% accuracy with privacy","Privacy-aware ensemble beats single models at 94.3% accuracy"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The load-bearing premise is that adding unspecified controlled noise for differential privacy preserves the ensemble's 94.3% accuracy, yet no epsilon or noise scale is reported.","fun_headline_variants_meta":{"raw":{"variants":["Privacy-preserving 4-model ensemble hits 94.3% accuracy on anomalies","Hybrid ensemble with privacy noise reaches 94.3% detection accuracy","Stacking KNN, SVM, XGBoost, ANN: 94.3% accuracy with privacy","Privacy-aware ensemble beats single models at 94.3% accuracy"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000649,"raw_usage":{"total_tokens":2926,"prompt_tokens":843,"completion_tokens":2083,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":459,"completion_tokens_details":{"reasoning_tokens":1995}},"tokens_in":459,"tokens_out":2083,"duration_ms":15635,"temperature":1.0,"reasoning_tokens":1995,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-07T22:57:26.384802+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Run the same pipeline on a named public intrusion dataset such as NSL-KDD or CICIDS2017 with a stated differential-privacy budget, for example $\\epsilon = 1$, and compare accuracy with and without noise; if the ensemble's accuracy drops materially below 94.3% or if no epsilon can be specified, the central claim is falsified.","supporting_citations":[{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Supplies the federated XGBoost with differential privacy approach that motivates combining privacy with anomaly detection."},{"cited_title":"Maniriho, E","cited_arxiv_id":null,"evidence_quote":"Provides the SMOTE-based balancing method that the paper adapts into its similarity-based sampling for minority classes."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Shows the effectiveness of hybrid SVM-KNN models, supporting the idea of combining classifiers for anomaly detection."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Highlights poisoning attacks on federated learning, motivating the adversarial training and secure deployment components of the proposed model."}],"review_version":1}