REVIEW 4 major objections 4 minor 1 cited by
Deep Reputation Scoring in DeFi: zScore-Based Wallet Ranking from Liquidity and Trading Signals
T0 review · 4 major / 4 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read This paper claims that a wallet's Uniswap v3 behavior can be summarized by two blueprint-guided scores—liquidity provision and swap behavior—refined by a deep residual network, and that high-scoring wallets exhibit disciplined…
desk verdict A real engineering contribution with a self-referential evaluation: the dual-score system trains and tests on its own blueprint, so the behavioral-validity claims do not yet hold. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing machinery is a blueprint-guided, noise-augmented supervised scoring pipeline: a hand-specified, weighted, per-category-capped scoring schema for LPs and swappers, plus Gaussian noise injection that creates soft training targets, plus a DeepMLP_ResNet (four residual blocks with projection shortcuts, layer normalization, dropout, and a regression head) that learns to reproduce those targets under wallet-level train/validation splits. The blueprint supplies interpretability and structure; the network supplies smooth, context-aware generalization; and pool-level features (TVL, fee tier, relative pool size) are appended so identical behavior is scored differently across pool environments.
What would settle it
Take a training window of Uniswap v3 activity, score wallets with zScore, then follow the same wallets in a later window on an outcome the blueprint does not use—say, whether they still hold liquidity after 90 days, whether they repay a DeFi loan, or whether their realized LP returns after gas and impermanent loss are positive. If top-zScore wallets do not outperform bottom-zScore wallets on those held-out outcomes, the claim that the score ranks strategic behavior is falsified.
Extended reading notes
Core claim
The central discovery is that a two-phase hybrid—interpretable rule-based blueprint followed by a noise-injected deep residual network with U-Net-style dense skip blocks—can produce a continuous 0–1000 behavioral score for Uniswap v3 wallets that differentiates roles and aligns with the authors' definition of strategic behavior. The LP score rewards long holding, low withdrawal, and high retention; the swap score rewards volume, frequency, token diversity, and routing complexity while penalizing micro-swaps and wash-like patterns. On their validation set, high-score bins concentrate exactly those behaviors: retention ratios rise from 0.00 in the lowest LP bin to 1.00 in the highest, and swap volumes climb from $4K to $82M across swap bins. The paper frames this as a bridge between anonymous on-chain interaction and trust-based protocol alignment.
Load-bearing premise
The hand-set blueprint weights and caps are assumed to be a valid measure of wallet reputation, and nothing outside the blueprint is used to check that assumption.
Editorial extensions
If this is right
- Liquidity and swap scores give protocols a cheap, on-chain-only way to segment users by role—LP or trader—without any identity verification.
- According to the bin tables, high-zScore wallets retain liquidity longer and trade more broadly, so the score could be used to gate airdrops, weight governance votes, or adjust lending terms toward users with stable behavior.
- The noise-injected blueprint pipeline turns a fixed rule system into a differentiable scoring function, allowing pool context to be updated as markets shift without re-specifying all thresholds.
- The architecture is reusable: swapping the blueprint to another role or protocol, such as lending or borrowing, yields a comparable behavioral score from the same network structure.
Reading between the lines
- The reported 91% accuracies measure agreement with the authors' own rubric, not truth about reputation; a real test would compare zScore against external outcomes such as default rates, realized LP profitability, or continued participation after a market shock.
- The deliberate exclusion of one-transaction wallets may inflate the observed score-behavior gradient, since the lowest-activity band is removed before bin analysis; re-including these wallets could change the shape of the tables.
- Pool-level context suggests a natural stress test: check whether wallet rankings stay stable when a pool changes fee tier or experiences a sharp TVL change, to see whether the score reflects durable behavior or merely current pool conditions.
- The dual-score output could be treated as a two-dimensional behavioral embedding, allowing clustering and anomaly detection to run directly on the score pair rather than on raw transaction features.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a dual-role behavioral scoring framework for Uniswap v3 wallets, producing a Liquidity Provision Score and a Swap Behavior Score. Scores are first generated by a hand-designed rule-based blueprint (Section 3.1), then Gaussian noise is added to these scores to create training targets, and a deep residual network (DeepMLP_ResNet) is trained to regress toward those noisy targets (Section 3.2). The empirical evaluation in Section 4 compares model predictions to the blueprint scores and reports 91.79% / 90.83% agreement within a ±50 tolerance, and presents bin-wise behavioral summaries in Tables 1-2 as evidence that higher scores correspond to more strategic behavior. The conclusion claims that zScores align closely with strategic behavior patterns and that high-scoring users exhibit strong liquidity retention, disciplined trading, and broad engagement.
Significance. If the claimed behavioral validity were established, an interpretable, context-aware, dual-role scoring system for DeFi wallets could be a useful building block for risk models, incentive design, and reputation systems in decentralized finance. The paper has some strengths: the blueprint is explicit and interpretable, the architecture is described in detail, and the authors provide a link to a supplementary validation report and code repository. However, the central empirical claim is not supported by the evidence presented: the 'ground truth' used for evaluation is the same blueprint score that generated the training labels, so the reported accuracy is a measure of how well the model fits its own training targets. The bin-wise behavioral trends in Tables 1-2 are also largely entailed by the features and weights built into the blueprint rather than independently discovered. No external outcome, baseline model, or statistical uncertainty is provided. Therefore, the paper's main contribution, as stated in the conclusion, is an unvalidated assumption rather than an empirically confirmed result.
major comments (4)
- [Section 4.1 and 4.2 (Figures 2 and 3)] The evaluation is circular. The 'ground truth' scores in Figures 2-3 are the blueprint scores from Section 3.1, which were then corrupted with Gaussian noise in Section 3.2 to form the network's training targets. The reported 91.79% and 90.83% agreement within ±50 therefore measures how well the network reproduces its own training signal, not how well the scores predict any externally meaningful behavior or outcome. This directly undermines the conclusion that 'empirical evaluations confirm that zScores align closely with strategic behavior patterns.'
- [Tables 1-2 and Section 4.3] The bin-wise behavioral summaries do not provide independent validation. The metrics shown in Tables 1-2 (liquidity retention, holding duration, withdrawal volume, swap count, token diversity) are the same sub-category features used in the blueprint to construct the scores, with hand-set weights and caps. The increasing trends across score bins are therefore mechanical consequences of the blueprint's construction, not discoveries about wallet behavior. The paper would need to validate the scores against behaviors or outcomes that were not used to define the score.
- [Sections 3.1-3.2 and Section 4] There is no external ground truth, no baseline, and no uncertainty quantification. The blueprint weights, caps, noise standard deviation, dusk thresholds, and tolerance window are all free parameters, and none is tested against an external outcome such as future returns, protocol revenue, loan repayment, or an independent reputation label. Without such validation, 'strategic behavior' is simply a restatement of the authors' rubric. Additionally, the paper does not compare the deep network against linear regression or against the raw blueprint scores, so the claimed benefit of the neural refinement phase is not established.
- [Section 4.3 (dusk wallet exclusion)] The post-hoc exclusion of 'dusk' wallets, defined as wallets with one transaction and negligible volume, is applied without reporting results with those wallets included. Because this exclusion is made after examining the data and without a sensitivity analysis, it is unclear whether the reported accuracy and bin trends hold for the full population. The exclusion may be reasonable, but it should be presented as a robustness check with both full-sample and filtered results, and the threshold definitions should be precise.
minor comments (4)
- [Section 4.3.2] The text 'often below 10f orLP sor50 for swaps' appears garbled and should be corrected to clearly state the dusk thresholds (e.g., dollar amounts) for LP deposits and swap volumes.
- [Section 4.1] The term 'T_scores' is used without definition; the reader must infer that it refers to the blueprint scores. Please define this notation.
- [Sections 3.1 and 3.2] Section 3.1 states that 'no rigid cutoffs are enforced,' while Section 3.2 states that each sub-category is 'capped by a predefined maximum'; this apparent inconsistency should be clarified.
- [External Validation Report] The supplementary validation report is a GitHub link rather than an archival, peer-reviewed artifact. If this report is intended to support the paper's claims, it should be made available in a permanent form with reproducibility instructions, and its contents should be summarized in the manuscript.
Circularity Check
The central behavioral-validity claim reduces to the blueprint that generates the training labels; the 91.79% 'prediction' accuracy and the bin tables measure reproduction of the authors' rubric, not independent evidence.
-
fitted input called prediction
[Section 3.2 (Noise-Aware Label Generation) and Section 4.1 (LP Score)]
"To evaluate the effectiveness of our model in learning liquidity provider behavior, we compare the predicted T_scores against blueprint-defined targets."
The 'ground truth' in this evaluation is the blueprint score produced by the Section 3.1 rubric, and Section 3.2 states that the training labels are exactly those scores plus injected Gaussian noise ('we inject controlled Gaussian noise into the blueprint-generated scores before training'). A deep network trained on noisy copies of the blueprint scores will, by construction, reproduce them on held-out wallets; the reported 91.79% (and 90.83% for swaps) is a fit-to-input measurement, not a prediction of any externally defined behavior. The word 'predicted' is applied to the network's approximation of its own training target.
-
self definitional
[Section 4.3.1 (Behavioral Trends Across LP Score Bins) versus blueprint definition in Section 3.1]
"Wallets in higher bins generally show lower withdrawal activity, higher liquidity retention, and significantly longer holding durations—indicating a stronger alignment with long-term, stable LP behavior."
Section 3.1 states that for liquidity providers 'the blueprint captures dimensions such as deposit volume and frequency, withdrawal activity, and average holding time,' and Table 1 tabulates exactly those dimensions (avg deposit, avg withdraw, holding days, liquidity remaining, deposit frequency). The scores are weighted sums of these components with caps, so higher-score bins having lower withdrawals, higher retention, and longer holding times is entailed by the score construction. The table is therefore a restatement of the blueprint, not independent evidence of behavioral validity.
2 more flagged steps
-
self definitional
[Section 4.3.2 (Behavioral Trends Across Swap Score Bins) versus blueprint definition in Section 3.1]
"Higher scoring wallets consistently demonstrate stronger trading engagement, with significantly higher swap volumes, increased transaction frequency, and greater diversity in token interactions."
The trader blueprint is defined by 'engagement through swap volume and frequency' plus 'token diversity, volatility exposure, and average time between swaps' (Section 3.1), and Table 2 reports swap volume, holding time, swap count, and unique tokens. The monotonic relationship between the score and these metrics is a direct consequence of the hand-set weights and caps used to build the score; it does not validate the score against an independent measure of trading quality or reputation.
-
self definitional
[Section 6 (Conclusion)]
"Empirical evaluations confirm that zScores align closely with strategic behavior patterns. High-scoring users exhibit strong liquidity retention, disciplined trading activity, and broad engagement across pools—indicating that the score meaningfully differentiates long-term, protocol-aligned participants from short-term or exploratory actors."
This is the paper's central claim, but 'strategic behavior' is never measured against an external outcome (e.g., future returns, realized creditworthiness, or honest behavior). The listed behaviors—liquidity retention, disciplined trading, broad engagement—are exactly the components and caps that define the blueprint, so the claimed alignment is true by definition. Without external validation of the blueprint weights, the conclusion restates the authors' rubric rather than confirming an empirical finding.
full rationale
The derivation chain is self-referential at its core. Section 3.1 constructs blueprint scores from hand-chosen behavioral dimensions; Section 3.2 trains the deep network on Gaussian-noise-augmented copies of those same scores; Section 4 evaluates the network against the same blueprint-defined targets; and Section 4.3 validates the scores against tables of the very features that compose the blueprint. The 91.79%/90.83% agreement figures therefore measure how well a flexible regressor recovers its own training labels, not whether the scores predict any external outcome. The bin-wise behavioral summaries are entailed by the score construction, so they cannot serve as confirmation. The reference to the authors' prior zScore work [16] is only a naming disclaimer and is not load-bearing, so it does not add circularity. The GitHub 'External Validation Report' is produced by the same team and consists of descriptive bin-level summaries rather than independent ground truth, so it does not break the circularity. Because no external criterion or independently validated target is introduced, the central claim that high zScores indicate strategic behavior is forced by the definition of the blueprint rather than by empirical discovery.
Assumptions & free parameters
free parameters (5)
- Blueprint sub-category weights and caps =
Not disclosed
- Gaussian noise standard deviation for label augmentation =
Not stated
- Dusk filter thresholds =
Vague: 'often below 10... or 50 for swaps'
- Tolerance window for accuracy =
±50
- Network hyperparameters =
lr 5e-4, weight decay 1e-4, hidden dims 1024->512->256
assumptions (5)
- domain assumption A wallet address corresponds to a single user.
- ad hoc to paper The feature blueprint encodes true reputation.
- ad hoc to paper Gaussian noise injection preserves the ordinal structure of scores.
- domain assumption Pool context (TVL, fee tier, pool size) is the correct normalizer.
- standard math Standard supervised learning assumptions hold across wallets.
invented entities (2)
-
zScore dual metrics (Liquidity Provision Score and Swap Behavior Score)
-
Dusk LPs and dusk swappers category
Cite this review
Pith. "Pith review of Deep Reputation Scoring in DeFi: zScore-Based Wallet Ranking from Liquidity and Trading Signals." pith.science (2026). https://pith.science/paper/2ISLXPSK
@misc{pith2026250720494,
author = {Pith},
title = {Pith review of: Deep Reputation Scoring in DeFi: zScore-Based Wallet Ranking from Liquidity and Trading Signals},
year = {2026},
howpublished = {\url{https://pith.science/paper/2ISLXPSK}},
note = {Machine review of arXiv:2507.20494}
}
read the original abstract
As decentralized finance (DeFi) evolves, distinguishing between user behaviors - liquidity provision versus active trading - has become vital for risk modeling and on-chain reputation. We propose a behavioral scoring framework for Uniswap that assigns two complementary scores: a Liquidity Provision Score that assesses strategic liquidity contributions, and a Swap Behavior Score that reflects trading intent, volatility exposure, and discipline. The scores are constructed using rule-based blueprints that decompose behavior into volume, frequency, holding time, and withdrawal patterns. To handle edge cases and learn feature interactions, we introduce a deep residual neural network with densely connected skip blocks inspired by the U-Net architecture. We also incorporate pool-level context such as total value locked (TVL), fee tiers, and pool size, allowing the system to differentiate similar user behaviors across pools with varying characteristics. Our framework enables context-aware and scalable DeFi user scoring, supporting improved risk assessment and incentive design. Experiments on Uniswap v3 data show its usefulness for user segmentation and protocol-aligned reputation systems. Although we refer to our metric as zScore, it is independently developed and methodologically different from the cross-protocol system proposed by Udupi et al. Our focus is on role-specific behavioral modeling within Uniswap using blueprint logic and supervised learning.
Figures
Forward citations
Cited by 1 Pith paper
-
ZAPs: A Reward Attribution Framework for DeFi Ecosystems with Adversarial-Robust Scoring via Parallel Anomaly Ensemble Detection
ZAPs attributes DeFi rewards via percentile-normalized score and a four-layer adversarial defense, reporting 0.923 ensemble ROC-AUC and 30–90% cuts in simulated adversarial reward capture.
Reference graph
Works this paper leans on
-
[16]
zScore: A Universal Decentralised Reputation System for the Blockchain Economy
Himanshu Udupi, Ashutosh Sahoo, Parag Paul, Petrus C Martens, et al. zscore: A universal decentralised reputation system for the blockchain economy.arXiv preprint arXiv:2503.05718, 2025
work page Pith review arXiv 2025
-
[1]
Decentralized exchange.American Economic Review, 107(11):3320– 3362, 2017
Semyon Malamud and Marzena Rostek. Decentralized exchange.American Economic Review, 107(11):3320– 3362, 2017
work page 2017
-
[2]
Yuen C Lo and Francesca Medda. Uniswap and the emergence of the decentralized exchange.Journal of financial market infrastructures, 10(2):1–25, 2021
work page 2021
-
[3]
Patrick Schueffel and Nikolaj Groeneweg. Evaluating crypto exchanges in the absence of governmental frameworks-a multiple criteria scoring model.Available at SSRN 3432798, 2019
work page 2019
-
[4]
Dean Fantazzini and Raffaella Calabrese. Crypto exchanges and credit risk: Modeling and forecasting the probability of closure.Journal of Risk and Financial Management, 14(11):516, 2021
work page 2021
-
[5]
Uniswap: Impermanent loss and risk profile of a liquidity provider
Andreas A Aigner and Gurvinder Dhaliwal. Uniswap: Impermanent loss and risk profile of a liquidity provider. arXiv preprint arXiv:2106.14404, 2021
arXiv 2021
-
[6]
Dan Lin, Jiajing Wu, Qishuang Fu, Zibin Zheng, and Ting Chen. Riskprop: Account risk rating on ethereum via de-anonymous score and network propagation.IEEE Transactions on Dependable and Secure Computing, 2024
work page 2024
-
[7]
A reputation scoring framework for lending protocols using the pagerank algorithm
Mau-Tra Nguyen, Tuan-Dat Trinh, and Viet-Bang Pham. A reputation scoring framework for lending protocols using the pagerank algorithm. InInternational Symposium on Information and Communication Technology, pages 478–494. Springer, 2024
work page 2024
Show all 21 references
-
[8]
Decentralized credit scoring: Black box 3.0.American Business Law Journal, 61(2):91–111, 2024
Nizan Geslevich Packin and Yafit Lev-Aretz. Decentralized credit scoring: Black box 3.0.American Business Law Journal, 61(2):91–111, 2024
2024
-
[9]
PhD thesis, San José State University, 2024
Mayuri Shimpi.Credit Score-Based Lending System On the Ethereum Platform. PhD thesis, San José State University, 2024
2024
-
[10]
Risk forecasting comparisons in decentralized finance: An approach in constant product market makers.Computational Economics, 65(1):395–428, 2025
Lucas Mussoi Almeida, Fernanda Maria Müller, and Marcelo Scherer Perlin. Risk forecasting comparisons in decentralized finance: An approach in constant product market makers.Computational Economics, 65(1):395–428, 2025. 9 zScore: Ranking Wallets by On-Chain Behavior
2025
-
[11]
Risks and returns of uniswap v3 liquidity providers
Lioba Heimbach, Eric Schertenleib, and Roger Wattenhofer. Risks and returns of uniswap v3 liquidity providers. InProceedings of the 4th ACM Conference on Advances in Financial Technologies, pages 89–101, 2022
2022
-
[12]
Defi protocol risks: The paradox of defi.Regtech, suptech and beyond: innovation and technology in financial services” riskbooks–forthcoming Q, 3, 2021
Nic Carter and Linda Jeng. Defi protocol risks: The paradox of defi.Regtech, suptech and beyond: innovation and technology in financial services” riskbooks–forthcoming Q, 3, 2021
2021
-
[13]
Defi risks and the decentralisation illusion.BIS Quarterly Review, 21, 2021
Jon Frost Doerr, Anneke Kosse, Asad Khan, Ulf Lewrick, Benoît Mojon, Benedicte Nolens, and Tara Rice. Defi risks and the decentralisation illusion.BIS Quarterly Review, 21, 2021
2021
-
[14]
Transparency, auditability, and explainability of machine learning models in credit scoring.Journal of the Operational Research Society, 73(1):70–90, 2022
Michael Bücker, Gero Szepannek, Alicja Gosiewska, and Przemyslaw Biecek. Transparency, auditability, and explainability of machine learning models in credit scoring.Journal of the Operational Research Society, 73(1):70–90, 2022
2022
-
[15]
Machine learning approach for credit scoring
Angela Rita Provenzano, Daniele Trifiro, Alessio Datteo, Lorenzo Giada, Nicola Jean, Andrea Riciputi, G Le Pera, Maurizio Spadaccino, Luca Massaron, and Claudio Nordio. Machine learning approach for credit scoring. arXiv preprint arXiv:2008.01687, 2020
2008 arXiv
-
[17]
Wire: Web3 integrated reputation engine
Suraj Shamsundar Jain, Huancheng Zhou, and Guofei Gu. Wire: Web3 integrated reputation engine. In2024 IEEE 44th International Conference on Distributed Computing Systems (ICDCS), pages 1388–1399. IEEE, 2024
2024
-
[18]
wild west
Angelo Aspris, Sean Foley, Jiri Svec, and Leqi Wang. Decentralized exchanges: The “wild west” of cryptocurrency trading.International Review of Financial Analysis, 77:101845, 2021
2021
-
[19]
Centralized exchanges vs
Sascha Hägele. Centralized exchanges vs. decentralized exchanges in cryptocurrency markets: A systematic literature review.Electronic Markets, 34(1):33, 2024
2024
-
[20]
Statistical and machine learning models in credit scoring: A systematic literature survey.Applied Soft Computing, 91:106263, 2020
Xolani Dastile, Turgay Celik, and Moshe Potsane. Statistical and machine learning models in credit scoring: A systematic literature survey.Applied Soft Computing, 91:106263, 2020
2020
-
[21]
Machine learning for credit scoring: Improving logistic regression with non-linear decision-tree effects.European Journal of Operational Research, 297(3):1178–1192, 2022
Elena Dumitrescu, Sullivan Hué, Christophe Hurlin, and Sessi Tokpavi. Machine learning for credit scoring: Improving logistic regression with non-linear decision-tree effects.European Journal of Operational Research, 297(3):1178–1192, 2022. 10
2022
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.