REVIEW 4 major objections 7 minor 22 references
Detecting Sybil Addresses in Blockchain Airdrops: A Subgraph-based Feature Propagation and Fusion Approach
T0 review · 4 major / 7 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read Subgraph-based LightGBM detects Sybil airdrop addresses with all metrics above 0.9.
desk verdict Plausible first supervised airdrop-sybil method, but the evaluation's undisclosed label generation and missing train/test split keep the >0.9 claims unproven; deserves a careful major-revision round. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the two-layer transaction subgraph representation with cascade feature propagation and fusion. For a target address at level 0, the subgraph includes two layers of senders above it and two layers of recipients below it; features computed at each level are aggregated toward the target—amounts by min/max/mean/variance, degrees by summation, time features directly from the target's transactions—to form a 75-dimensional feature vector (7 time, 60 amount, 8 network features). This representation converts an unbounded transaction graph into a fixed-size, interpretable feature set that a gradient-boosted tree model can train on efficiently.
What would settle it
Take a fresh airdrop dataset, label sybils through an independent process that does not use the same transaction features or clustering heuristics, split into train and test, and rerun the 75-feature LightGBM pipeline; if precision, recall, F1, and AUC drop below the reported range, the original numbers reflected label leakage or overfitting to the labeling method rather than general Sybil detection.
Extended reading notes
Core claim
The central claim is that Sybil addresses are detectable from the shape and timing of their local transaction neighborhoods, not just from fund-flow clusters. For each address the paper builds a two-hop subgraph above and below it, derives 75 features, and learns a LightGBM classifier. The lifecycle time features capture the compressed, coordinated timing of Sybil creation and activity, while the propagated amount and degree features capture star, chain, and tree topologies characteristic of one controller operating many addresses. The paper reports that this approach beats all baselines on every metric, with all values above 0.9, and that its probability scores refine medium- and low-risk cases that clustering-based methods leave ambiguous.
Load-bearing premise
The entire result rests on the ground-truth Sybil labels being valid and independent of the features the model learns; the paper's labeling process is only summarized, and its relationship to the clustering baseline is not fully disclosed.
Editorial extensions
If this is right
- Long-term airdrop campaigns, where labeled Sybil addresses accumulate over time, can move from manually tuned clustering to supervised detection with reported accuracy high enough for production use.
- The same 75-feature extraction can be applied to other account-based, EVM-compatible chains without retraining the graph construction, only the classifier.
- Feature importance analysis shows that lifecycle timing and total balances drive detection, so attackers who randomize timing or maintain larger balances should become harder to catch.
- Because the subgraph is limited to two hops, the method avoids expanding the full transaction graph and keeps computational cost manageable on datasets with tens of millions of transactions.
Reading between the lines
- If the confirmed-Sybil labels were produced by clustering that resembles the baseline and consumes the same transaction features, the reported metrics may partly measure how well the model reproduces that labeling heuristic; an independent held-out label set would test this.
- The lifecycle features are likely transferable to other coordinated-identity problems, such as vote manipulation in DAOs or artificial liquidity in token markets, where the same just-in-time creation pattern appears.
- Replacing the hand-set fusion operations (min/max/mean/variance, sum) with learned aggregation, as in graph neural networks, is the natural next step and could push performance beyond the reported AUC while sacrificing some interpretability.
- The two-hop window is an implicit assumption about how far Sybil controllers operate from their seed address; checking whether three-hop or cross-chain expansion changes predictions would bound that assumption.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a supervised method, Subgraph-based LightGBM, for detecting Sybil addresses in blockchain airdrops. The method builds a two-layer transaction subgraph around each address, extracts time, amount, and network-structure features, and fuses features propagated from the subgraph layers. The authors evaluate on a dataset of 193,701 addresses from the BAB airdrop, of which 23,240 are labeled Sybil, and report that their model achieves precision 0.9428, recall 0.9182, F1 0.9303, and AUC 0.9806, outperforming SVM, decision trees, plain LightGBM, and the Clustering-based Trusta baseline. The paper also includes a feature importance analysis and a brief discussion of limitations.
Significance. If the central result holds, the paper would demonstrate that a supervised, subgraph-feature approach can outperform unsupervised clustering for Sybil detection in long-term airdrop campaigns, with a clear and interpretable feature set. The problem is practically important, and the dataset is real and industry-sourced. However, the evaluation as presented lacks the experimental rigor needed to support the claimed >0.9 performance: the ground-truth labeling procedure is not disclosed, no train/test split or cross-validation is reported, baselines are not feature-matched, and the data cleaning removes a meaningful address population. The paper also does not provide code or data, limiting reproducibility. These issues are central to the paper's contribution and require substantial revision.
major comments (4)
- [Section IV-A] The ground-truth Sybil labels are described as obtained through 'comprehensive manual analysis and clustering methods,' but the clustering algorithm, its input features, and its parameters are never disclosed. Because the proposed model's features (Section III-A) include transaction graph structure, amount statistics, and temporal lifecycle features, and because the Clustering-based Trusta baseline (Section IV-B) uses community detection and K-means on asset transfer graphs, the reported metrics in Table I may simply measure how well the supervised model reproduces the labeling heuristic rather than its independent detection capability. The authors must disclose the label-generation method or otherwise demonstrate that the labels are independent of the features used by the model, for example by ablating the clustering-derived features and showing that detection remains strong.
- [Section IV-C and Table I] No train/test split, cross-validation procedure, or variance estimates are reported for any model in Table I. This is particularly problematic because the two-layer subgraph feature propagation described in Section III-B means that an address's feature vector contains aggregated statistics from its two-hop neighbors; if those neighbors appear in the training set, the model can exploit label information through the graph structure. A random address-level split will place many addresses from the same Sybil cluster in both training and test sets, inflating all metrics. The authors should report evaluation with cluster-level or time-based held-out data and specify the number of Sybil clusters used for splitting.
- [Section IV-B] The comparison in Table I is not feature-matched. SVM, DT, and LightGBM are trained on 'first-order features' from Farrugia et al. [24], while the proposed model uses 75 features that include two-layer propagated subgraph features. The reported improvements over the baselines therefore cannot be attributed to the subgraph propagation and fusion method; they may simply reflect a richer feature set. A fair comparison would feed the same feature set to all classifiers, or ablate the propagation module to isolate its contribution.
- [Section IV-A] The preprocessing step that removes addresses with lifecycles exceeding one year (2.6% of the dataset) defines away a population that the model is never evaluated on. The authors justify this by arguing that Sybil attackers exhibit high address abandonment, but the consequence is that the reported precision and recall apply only to short-lived addresses. This limitation is not acknowledged in Section V, and it weakens the general claim that the model identifies Sybil addresses in airdrops broadly. The paper should at least discuss the excluded population and whether the model can be expected to handle long-lived Sybil addresses.
minor comments (7)
- [General] Figures 1, 2, and 3 are referenced in the text but are not included in the submitted manuscript; please add the figures or remove the references.
- [Section III-B] The feature fusion formula is ambiguous: the union operator S is not defined, and the amount-feature count of '2×6×5' is inconsistent with the four statistics (min, max, avg, var) listed in the same section, though Section III-A includes five statistics (adding median). Please clarify the notation and the exact feature count.
- [References] Reference [22] is cited twice with different attributions: 'Ramalingam et al. [22]' and 'Chen et al. [22]', while the introduction says the work is inspired by Chen et al. [1]. In addition, references [13] and [24] are duplicates of the same Farrugia et al. paper.
- [Section IV-B] The description of the Clustering-based Trusta baseline is incomplete: the authors state that 'time features were prioritized during clustering' but do not specify how the baseline was adapted to this dataset, what parameters were used, or how its risk scores were thresholded to produce labels. Without this, the Trusta comparison is not reproducible.
- [Section I] The contribution claim of 'the first application of a supervised machine learning method to sybil address identification' is too strong without a systematic survey to establish novelty; either provide evidence or weaken the claim.
- [Section V] The paper's own limitation statement that 'the current model relies on features specific to certain datasets' should be reflected in the abstract, which currently claims broad applicability to 'broader blockchain security areas' without this caveat.
- [Section V] The claim of 'lower computational overhead compared to traditional methods' is not supported by any runtime or complexity measurements; please provide experimental evidence or remove the claim.
Circularity Check
No significant circularity: the supervised model is trained on labels with an independent manual-review component, and the benchmark comparison is external.
full rationale
The paper does not exhibit a circular derivation. The supervised model is trained on labels that, per Section IV-A, were established by initial clustering followed by reward reclamation and a manual appeal review; the final confirmed labels therefore include a human-review component, so the labels are not definitionally identical to the model's features. The model features (time, amount, network structure) are computed from on-chain transactions, and no equation in Section III-B reduces to a fitted parameter renamed as a prediction. The comparison against Clustering-based Trusta is an external benchmark using the same ground-truth labels, and the concordance analysis in Section IV-C is not used as training input. No load-bearing uniqueness premise is imported from the authors' own prior work, and the cited prior methods are not used to justify the model's core feature set by self-citation. The undisclosed details of the initial clustering heuristic and the absence of an explicit train/test split are legitimate validation and external-validity concerns, but they do not, on the quoted evidence, amount to a by-construction reduction of the claimed predictions to the model's inputs. Therefore no circular step is established.
Assumptions & free parameters
free parameters (4)
- lifecycle threshold filter =
1 year
- subgraph depth =
2 layers
- LightGBM hyperparameters =
not reported
- label-clustering parameters =
not reported
assumptions (3)
- domain assumption The appeal-based label is a reliable ground truth for sybil behavior.
- domain assumption Two-layer transaction subgraphs are sufficient to capture sybil behavior patterns.
- domain assumption Baseline models are implemented and compared fairly.
Cite this review
Pith. "Pith review of Detecting Sybil Addresses in Blockchain Airdrops: A Subgraph-based Feature Propagation and Fusion Approach." pith.science (2026). https://pith.science/paper/2J3ONOLM
@misc{pith2026250509313,
author = {Pith},
title = {Pith review of: Detecting Sybil Addresses in Blockchain Airdrops: A Subgraph-based Feature Propagation and Fusion Approach},
year = {2026},
howpublished = {\url{https://pith.science/paper/2J3ONOLM}},
note = {Machine review of arXiv:2505.09313}
}
read the original abstract
Sybil attacks pose a significant security threat to blockchain ecosystems, particularly in token airdrop events. This paper proposes a novel sybil address identification method based on subgraph feature extraction lightGBM. The method first constructs a two-layer deep transaction subgraph for each address, then extracts key event operation features according to the lifecycle of sybil addresses, including the time of first transaction, first gas acquisition, participation in airdrop activities, and last transaction. These temporal features effectively capture the consistency of sybil address behavior operations. Additionally, the method extracts amount and network structure features, comprehensively describing address behavior patterns and network topology through feature propagation and fusion. Experiments conducted on a dataset containing 193,701 addresses (including 23,240 sybil addresses) show that this method outperforms existing approaches in terms of precision, recall, F1 score, and AUC, with all metrics exceeding 0.9. The methods and results of this study can be further applied to broader blockchain security areas such as transaction manipulation identification and token liquidity risk assessment, contributing to the construction of a more secure and fair blockchain ecosystem.
Figures
Reference graph
Works this paper leans on
-
[24]
S. Farrugia, J. Ellul, and G. Azzopardi, ”Detection of illicit accounts over the Ethereum blockchain,” Expert Syst. Appl., vol. 150, p. 113318, 2020
work page 2020
-
[1]
W. Chen, Z. Zheng, J. Cui, E. Ngai, P. Zheng, and Y . Zhou, ”Phishing scam detection on Ethereum: Towards financial security for blockchain ecosystem,” IJCAI, vol. 7, 2020
work page 2020
-
[3]
J. Xu, D. Xiang, Q. Yan, L. Wang, and G. Han, ”Gsan: Graph self- attention network for learning spatial-temporal interaction patterns in bitcoin transaction networks,” IEEE Trans. Netw. Sci. Eng., vol. 9, no. 1, pp. 204-217, 2021
work page 2021
-
[4]
F. Victor and B. K. L ¨uders, ”Measuring ethereum-based erc20 token networks,” in Proc. Int. Conf. Financial Cryptography Data Security, 2019, pp. 113-129
work page 2019
- [5]
-
[6]
M. Jourdan, S. Blandin, L. Wynter, and P. Deshpande, ”A probabilistic model of the bitcoin blockchain,” in Proc. IEEE Conf. Comput. Com- mun. Workshops (INFOCOM WKSHPS), 2018, pp. 1-6
work page 2018
-
[7]
X. Li, X. Wang, G. Yu, Y . Liu, and D. Feng, ”FedEC: A new paradigm for entity classification in blockchain,” IEEE Trans. Syst., Man, Cybern., Syst., vol. 53, no. 3, pp. 1859-1870, 2023
work page 2023
-
[8]
A. Biryukov and S. Tikhomirov, ”Deanonymization and linkability of cryptocurrency transactions based on network analysis,” in Proc. IEEE European Symp. Security Privacy (EuroS&P), 2019, pp. 172-184
work page 2019
Show all 22 references
-
[9]
Tzanetakis, G
M. Tzanetakis, G. Kamphausen, B. Werse, and R. von Laufenberg, ”The digital transformation of drug markets: An analysis of the supply-side of cryptomarkets,” J. Illicit Economies Development, vol. 3, no. 2, pp. 194-212, 2022
2022
-
[10]
Victor, ”Address clustering heuristics for Ethereum,” in Proc
F. Victor, ”Address clustering heuristics for Ethereum,” in Proc. Int. Conf. Financial Cryptography Data Security, 2020
2020
-
[11]
Payette, S
J. Payette, S. Schwager, and J. Murphy, ”Characterizing the ethereum address space,” Available at SSRN 2965684, 2017
2017
-
[12]
Y . Hu, S. Seneviratne, K. Thilakarathna, K. Fukuda, and A. Seneviratne, ”Characterizing and detecting money laundering activities on the bitcoin network,” arXiv preprint arXiv:1912.12060, 2019
1912 arXiv
-
[14]
J. Wu, Q. Yuan, D. Lin, W. You, W. Chen, C. Chen, and Z. Zheng, ”Who are the phishers? Phishing scam detection on ethereum via network embedding,” IEEE Trans. Syst., Man, Cybern., Syst., vol. 52, no. 2, pp. 1156-1166, 2020
2020
-
[15]
Jourdan, S
M. Jourdan, S. Blandin, L. Wynter, and P. Deshpande, ”Characterizing entities in the bitcoin blockchain,” in Proc. IEEE Int. Conf. Data Mining Workshops (ICDMW), 2018
2018
-
[16]
D. Lin, J. Wu, Q. Yuan, and Z. Zheng, ”Modeling and understanding ethereum transaction records via a complex network approach,” IEEE Trans. Circuits Syst. II, Exp. Briefs, vol. 67, no. 11, pp. 2737-2741, 2020
2020
-
[17]
Chauhan, O
A. Chauhan, O. P. Malviya, M. Verma, and T. S. Mor, ”Blockchain and scalability,” in Proc. IEEE Int. Conf. Softw. Quality, Rel. Security Companion (QRS-C), 2018
2018
-
[18]
Toyoda, T
K. Toyoda, T. Ohtsuki, and P. T. Mathiopoulos, ”Identification of high yielding investment programs in bitcoin via transactions pattern analysis,” in Proc. IEEE Global Commun. Conf. (GLOBECOM), 2017
2017
-
[19]
Baumann, B
A. Baumann, B. Fabian, and M. Lischke, ”Exploring the Bitcoin network,” in Proc. WEBIST, vol. 1, 2014, pp. 369-374
2014
-
[20]
Liu and H
Z. Liu and H. Zhu, ”Fighting Sybils in Airdrops,” arXiv preprint arXiv:2209.04603, 2022
2022 arXiv
-
[21]
Kanezashi, K
H. Kanezashi, K. Hirose, Y . Ike, K. Sano, and T. Yada, ”Ethereum fraud detection with heterogeneous graph neural networks,” arXiv preprint arXiv:2203.12363, 2022
2022 arXiv
-
[22]
Ramalingam and V
D. Ramalingam and V . Chinnaiah, ”Fake profile detection techniques in large-scale online social networks: A comprehensive review,” Comput. Elect. Eng., vol. 65, pp. 165-177, 2018
2018
-
[23]
R. Yang, T. Murray, P. Rimba, and U. Parampalli, ”Empirically analyzing ethereum’s gas mechanism,” in Proc. IEEE European Symp. Security Privacy Workshops (EuroS&PW), 2019
2019
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.