REVIEW 4 major objections 7 minor 28 references
Enhancing interpretability of rule-based classifiers through feature graphs
T0 review · 4 major / 7 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read The paper claims that the degree centrality of its projected feature graph is a valid model-agnostic feature importance metric for rule-based classifiers, performing comparably to permutation importance and with more stable rankings.
desk verdict A clearly specified graph-based framework for analyzing feature contributions in rule-based classifiers, with a novel weighted projection and degree-centrality importance score, but the validation is thinner than the claims warrant: synthetic results are visual only and the input relevance metric is adopted without independent scrutiny. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the projected feature graph: a weighted undirected graph on input features obtained from a tripartite network of features, rules, and class labels. Its adjacency matrix is computed by Equation (3) as a normalized product over rules, with each rule contributing a factor $1 - p_{ki} p_{kj} q_k$, where $p$ is a feature-to-rule relevance score and $q$ is a rule-to-class relevance score. Degree centrality of this adjacency matrix is the proposed importance measure, self-edges keep features that appear alone in rules, and the class-restricted projection gives class-specific feature graphs. The Frobenius distance between two normalized adjacency matrices is the proposed distance between rule sets.
What would settle it
On a synthetic rule set whose true pairwise contributions are known by construction, compare the centrality ranking from Equation (5) with the ranking obtained when Equation (8) is replaced by support, confidence, lift, or impurity gain; if the ranking materially changes with the injected score, the graph is measuring that score rather than the model's actual feature use.
Extended reading notes
Core claim
The central claim is that projecting a tripartite features-rules-classes network onto the feature set produces a feature graph whose degree centrality is a valid feature importance metric, independent of the rule-induction algorithm. In that graph, an edge between two features is strong when the pair appears together with high relevance in at least one rule that matters, while self-edges preserve the contribution of features that appear alone in rules. The authors evaluate this on synthetic data with known independent and combined predictive structure, on two clinical datasets with four rule-induction schemes, and on 15 public benchmarks against permutation importance, Gini importance, and average Shapley values. They report that the centrality score performs comparably to permutation importance in top-5 and top-10 feature-selection accuracy and is the most stable ranking across cross-validation folds. The same construction restricted to rules with one class gives class-specific interaction graphs, and the Frobenius distance between adjacency matrices serves as a rule-set distance that does not require pairwise rule matching.
Load-bearing premise
The whole graph is built from two input scores, feature-to-rule relevance and rule-to-outcome relevance, adopted from an existing method without independent validation, so if those scores misrepresent true contributions the edge weights, centrality rankings, and graph distances all inherit the error.
Editorial extensions
If this is right
- Rule sets from different induction schemes, such as decision trees, logic learning machines, association rules, and extracted neural-network rules, can be compared on a common feature-importance scale without re-training or pairwise rule matching.
- Clinicians can see which measurements are predictive only in combination, so data collection can prioritize pairs like glucose with age or with body mass index rather than treating all risk factors independently.
- Replacing a rule set in an expert system can be guided by graph distance, choosing the update whose feature-contribution graph is closest to the existing one and thereby preserving continuity of clinical explanations.
- Class-specific projections expose interactions that aggregate importance hides, such as phase angle and impedance carrying the signal for carcinoma while a single spectral feature suffices for adipose tissue in the breast-tissue case.
- The reported rank stability across decision-tree depths suggests that the centrality score can serve as a reliable feature-ranking tool when data splits are noisy, reducing the need for extensive hyperparameter tuning.
Reading between the lines
- A testable extension is to feed the edge weights, not just node centrality, into feature selection: strong edges between a predictive feature and a spurious one might flag correlations that survive single-feature rankings but not leave-one-out evaluation.
- Because the projection multiplies contributions, a single highly relevant rule containing a rare feature pair can dominate an edge; comparing multiplicative aggregation with additive aggregation on the same synthetic data would reveal whether that emphasis is a strength or a distortion.
- The framework's stated agnosticism to the input relevance scores suggests it could be used as a general contribution-to-graph wrapper around any local explanation method, although the paper only demonstrates it with scores adopted from logic learning machines.
- The robustness result hints at a practical rule of thumb: when data splits are noisy, graph centrality may be a safer basis than permutation importance for deciding which patient information to collect, a claim that could be tested directly on the same benchmarks with different training seeds.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a graph-based framework for estimating feature contributions in rule-based classifiers. It constructs a tripartite graph among features, rules, and classes, projects it onto a feature-level weighted graph via Eq. (3), and defines a feature importance score as degree centrality (Eq. 5) and a distance metric between rule sets as the Frobenius norm of the adjacency difference (Eq. 4). The graph adjacency is built from feature relevance and rule relevance scores adopted from the Logic Learning Machine literature (Eqs. 7-8). The authors evaluate the approach on synthetic data, two clinical datasets, and 15 public benchmarks, comparing the importance score against permutation importance, Gini importance, and SHAP in terms of top-k classification accuracy and rank robustness.
Significance. If the proposed importance metric is shown to be reliable, the framework would provide a unified, model-agnostic way to visualize feature interactions and compare rule sets, which is of practical value in high-stakes domains such as healthcare. The paper makes the implementation publicly available and implements alternative relevance metrics, both of which are positive features. However, the central claims are conditional on the validity of the input relevance scores and on the projection in Eq. (3) not distorting the contribution structure; the current evidence is not yet sufficient to support the strong claims of competitive performance and superior robustness.
major comments (4)
- [Section 3, Eq. (3)] The complement-product form in Eq. (3) can saturate: when even a few rules have moderately large p_ki * p_kj * q_k, the product over k of (1 - p_ki p_kj q_k) approaches zero, so A_ij tends to 1 and becomes insensitive to the magnitude of the relevance. As a result, the degree centrality in Eq. (5) increasingly reflects the number of rules in which a pair of features co-occurs rather than the strength of their joint contribution. This directly affects the validity of the proposed importance metric. Please provide a diagnostic (e.g., the distribution of A_ij values) and consider an alternative aggregation such as a sum or max that preserves magnitude information.
- [Sections 4.1 and 5.1] The synthetic evaluation is entirely visual: no quantitative measure is reported for how well the graph, or the underlying relevance scores of Eqs. (7)-(8), recover the known ground-truth feature structure. Because the entire framework inherits the properties of these input scores, the evaluation should include a quantitative recovery test (e.g., Spearman correlation between the computed centrality and the ground-truth importance, with standard errors). The paper already states that alternative relevance metrics (support, confidence, lift, impurity gain) are implemented; comparing the results under these alternatives would substantially strengthen the claim that the framework is robust to the choice of input metric.
- [Section 5.3, Table 1] The accuracy values are reported as point estimates without any measure of variance (standard deviation or confidence interval). Given that the robustness claim is central, the average Spearman correlations should also be reported with their variability across folds. Without error bars, it is impossible to assess whether the differences between methods are meaningful. Please report means and standard deviations across CV folds (or repeated runs) for both accuracy and rank robustness.
- [Section 4.2] The paper states that the fidelity of the extracted rule sets was evaluated with accuracy and F1, and that the number of rules was set to 15, but these fidelity results are never reported. Since the clinical insights in Section 5.2 are derived from surrogate rule sets, the reader needs to see how faithful these surrogates are to the original black-box models.
minor comments (7)
- [Abstract and throughout] The abstract and several places in the text contain spacing/formatting errors, e.g., 'discerncrucialfeatures' and 'uncovercrucial'; please fix the PDF compilation and proofread the text.
- [Table 1] In Table 1, 'Hill V alley' should be 'Hill Valley'.
- [Section 5.2] The centrality values and the pair-wise distance matrix are described qualitatively; please include the numerical values in a table so that the claims can be verified.
- [Section 3] The graph is described as undirected, but this is only valid if the adjacency matrix is symmetric; please state explicitly that A' is symmetric given non-negative P and q.
- [Section 5.3] The term 'model-agnostic' is used for the importance metric, but the benchmark evaluation only uses decision trees; please clarify the scope of the experiments.
- [Eq. (6)] The rule relevance I_nabla = covering * (1 - error) is one of several possible choices; consider reporting how the main results change if lift or confidence is used instead.
- [References] Reference [6] is a water-distribution application of LLM; for the relevance metrics defined in Section 3, please also cite the original LLM source where these metrics are introduced.
Circularity Check
No significant circularity; the graph construction is a compositional transformation of explicitly stated relevance metrics, and the central claims are independently benchmarked.
full rationale
The derivation chain is compositional rather than circular. The tripartite graph edges are defined in Eq. (3) as a product of feature relevance values and rule relevance values, the adjacency matrix is normalized, feature importance in Eq. (5) is a row sum of that normalized adjacency matrix, and graph distance in Eq. (4) is a Frobenius norm of adjacency differences. Each object is a new function of the preceding quantities, not a formal restatement of its inputs, and no parameter is fitted to the quantity it is later said to predict. The only self-citation signal is that the relevance metrics in Eqs. (7)-(8) are attributed to the LLM literature [6], whose author list includes the second author. This is source attribution rather than circular reduction: the formulas are stated in full, the pipeline is evaluated on 15 public benchmarks against permutation importance, Gini importance, and SHAP, and alternative relevance metrics are noted as implemented in code and deferred to future work. The concern that an unvalidated input metric may bias the graph is a validity or robustness limitation, not a circularity, because the centrality claim depends on the input but is not by construction equal to it. There is no fitted input renamed as a prediction, no imported uniqueness theorem, and no renaming of a known result presented as a derivation. Therefore the paper is self-contained against external benchmarks and exhibits no significant circularity.
Assumptions & free parameters
assumptions (4)
- domain assumption Feature relevance I_box and rule relevance I_nabla are valid measures of contribution.
- domain assumption The noisy-OR-like aggregation in Eq. (3) faithfully represents feature interactions.
- domain assumption Degree centrality is a sensible feature importance.
- domain assumption Frobenius norm of normalized adjacency matrices is a meaningful distance between rule sets.
Cite this review
Pith. "Pith review of Enhancing interpretability of rule-based classifiers through feature graphs." pith.science (2026). https://pith.science/paper/W7QJZCAK
@misc{pith2026250613903,
author = {Pith},
title = {Pith review of: Enhancing interpretability of rule-based classifiers through feature graphs},
year = {2026},
howpublished = {\url{https://pith.science/paper/W7QJZCAK}},
note = {Machine review of arXiv:2506.13903}
}
read the original abstract
In domains where transparency and trustworthiness are crucial, such as healthcare, rule-based systems are widely used and often preferred over black-box models for decision support systems due to their inherent interpretability. However, as rule-based models grow complex, discerning crucial features, understanding their interactions, and comparing feature contributions across different rule sets becomes challenging. To address this, we propose a comprehensive framework for estimating feature contributions in rule-based systems, introducing a graph-based feature visualisation strategy, a novel feature importance metric agnostic to rule-based predictors, and a distance metric for comparing rule sets based on feature contributions. By experimenting on two clinical datasets and four rule-based methods (decision trees, logic learning machines, association rules, and neural networks with rule extraction), we showcase our method's capability to uncover novel insights on the combined predictive value of clinical features, both at the dataset and class-specific levels. These insights can aid in identifying new risk factors, signature genes, and potential biomarkers, and determining the subset of patient information that should be prioritised to enhance diagnostic accuracy. Comparative analysis of the proposed feature importance score with state-of-the-art methods on 15 public benchmarks demonstrates competitive performance and superior robustness. The method implementation is available on GitHub: https://github.com/ChristelSirocchi/rule-graph.
Figures
Reference graph
Works this paper leans on
-
[1]
Bioinformatics26(10), 1340–1347 (2010)
Altmann, A., Toloşi, L., Sander, O., Lengauer, T.: Permutation importance: a corrected feature importance measure. Bioinformatics26(10), 1340–1347 (2010)
work page 2010
-
[2]
IEEE journal of biomedical and health in- formatics19(5), 1557–1566 (2015)
Banaee, H., Loutfi, A.: Data-driven rule mining and representation of temporal patterns in physiological sensor data. IEEE journal of biomedical and health in- formatics19(5), 1557–1566 (2015)
work page 2015
-
[3]
Expert Systems with Applications39(14), 11766–11774 (2012)
Chaves, R., Ramírez, J., Górriz, J., Puntonet, C.G., Initiative, A.D.N., et al.: Association rule-based feature selection method for alzheimer’s disease diagnosis. Expert Systems with Applications39(14), 11766–11774 (2012)
work page 2012
-
[4]
In: Machine learning proceedings 1995, pp
Cohen, W.W.: Fast effective rule induction. In: Machine learning proceedings 1995, pp. 115–123. Elsevier (1995)
work page 1995
-
[5]
Computers in Biology and Medicine162, 107064 (2023)
Crippa, V., Malighetti, F., Villa, M., Graudenzi, A., Piazza, R., Mologni, L., Ra- mazzotti, D.: Characterization of cancer subtypes associated with clinical outcomes by multi-omics integrative clustering. Computers in Biology and Medicine162, 107064 (2023)
work page 2023
-
[6]
Ferrari, E., Verda, D., Pinna, N., Muselli, M.: Optimizing water distribution through explainable ai and rule-based control. Computers12(6), 123 (2023)
work page 2023
-
[7]
Bmj327(7425), 1219–1221 (2003)
Haggerty, J.L., Reid, R.J., Freeman, G.K., Starfield, B.H., Adair, C.E., McKendry, R.: Continuity of care: a multidisciplinary review. Bmj327(7425), 1219–1221 (2003)
work page 2003
-
[8]
Hahsler, M.: Arulesviz: interactive visualization of association rules with r. R J. 9(2), 163 (2017)
work page 2017
Show all 28 references
-
[9]
Journal of pain and symptom management53(3), 571–577 (2017) 16 C
Hui, D., Dev, R., Pimental, L., Park, M., Cerana, M.A., Liu, D., Bruera, E.: Associ- ation between multi-frequency phase angle and survival in patients with advanced cancer. Journal of pain and symptom management53(3), 571–577 (2017) 16 C. Sirocchi & D. Verda
2017
-
[10]
Data & Knowledge Engineering63(1), 167–182 (2007)
Huysmans, J., Baesens, B., Vanthienen, J.: A new approach for measuring rule set consistency. Data & Knowledge Engineering63(1), 167–182 (2007)
2007
-
[11]
KR91, 387–394 (1991)
Katsuno, H., Mendelzon, A.O.: On the difference between updating a knowledge base and revising it. KR91, 387–394 (1991)
1991
-
[12]
In: Machine Learning and Knowledge DiscoveryinDatabases,2010,Proceedings,PartII21.pp.145–161.Springer(2010)
Kunapuli, G., Bennett, K.P., Shabbeer, A., Maclin, R., Shavlik, J.: Online knowledge-based support vector machines. In: Machine Learning and Knowledge DiscoveryinDatabases,2010,Proceedings,PartII21.pp.145–161.Springer(2010)
2010
-
[13]
IEEE Journal of Biomedical and Health Informatics (2023)
Lenatti, M., Paglialonga, A., Orani, V., Ferretti, M., Mongelli, M.: Characteriza- tion of synthetic health data using rule-based artificial intelligence models. IEEE Journal of Biomedical and Health Informatics (2023)
2023
-
[14]
In: 2016 IEEE 8th International Conference on Intelligent Systems (IS)
Liu, H., Gegov, A.: Rule based systems and networks: Deterministic and fuzzy approaches. In: 2016 IEEE 8th International Conference on Intelligent Systems (IS). pp. 316–321. IEEE (2016)
2016
-
[15]
In: 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE)
Liu, H., Gegov, A., Cocea, M.: Network based rule representation for knowledge discovery and predictive modelling. In: 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE). pp. 1–8. IEEE (2015)
2015
-
[16]
Advances in neural information processing systems30(2017)
Lundberg, S.M., Lee, S.I.: A unified approach to interpreting model predictions. Advances in neural information processing systems30(2017)
2017
-
[17]
Diabetologia 63, 519–527 (2020)
Luo, J., Hodge, A., Hendryx, M., Byles, J.E.: Age of obesity onset, cumulative obesity exposure over early adulthood and risk of type 2 diabetes. Diabetologia 63, 519–527 (2020)
2020
-
[18]
International Journal of Academic Information Systems Research (IJAISR)3(7), 1–23 (2019)
Masri, N., Sultan, Y.A., Akkila, A.N., Almasri, A., Ahmed, A., Mahmoud, A.Y., Zaqout, I., Abu-Naser, S.S.: Survey of rule-based systems. International Journal of Academic Information Systems Research (IJAISR)3(7), 1–23 (2019)
2019
-
[19]
In: Biomedical informatics: computer applications in health care and biomedicine, pp
Musen, M.A., Middleton, B., Greenes, R.A.: Clinical decision-support systems. In: Biomedical informatics: computer applications in health care and biomedicine, pp. 795–840. Springer (2021)
2021
-
[20]
Nembrini, S., König, I.R., Wright, M.N.: The revival of the gini importance? Bioin- formatics34(21), 3711–3718 (2018)
2018
-
[21]
IEEE Transactions on Fuzzy Systems21(6), 1133–1149 (2013)
Pancho, D.P., Alonso, J.M., Cordón, O., Quirin, A., Magdalena, L.: Fingrams: visual representations of fuzzy rule-based inference for expert analysis of compre- hensibility. IEEE Transactions on Fuzzy Systems21(6), 1133–1149 (2013)
2013
-
[22]
Information9(1), 6 (2018)
Pino Angulo, A.: Gene selection for microarray cancer data classification by a novel rule-based algorithm. Information9(1), 6 (2018)
2018
-
[23]
Data mining and knowledge discovery handbook pp
Rokach, L., Maimon, O.: Decision trees. Data mining and knowledge discovery handbook pp. 165–192 (2005)
2005
-
[24]
In: CEUR WORKSHOP PROCEED- INGS
Sabbatini, F., Ciatto, G., Calegari, R., Omicini, A., et al.: On the design of psyke: a platform for symbolic knowledge extraction. In: CEUR WORKSHOP PROCEED- INGS. vol. 2963, pp. 29–48 (2021)
2021
-
[25]
BMC Medical Informatics and Decision Making24 (Suppl 4), 186 (2024)
Sirocchi, C., Bogliolo, A., Montagna, S.: Medical-informed machine learning: inte- grating prior knowledge into medical decision systems. BMC Medical Informatics and Decision Making24 (Suppl 4), 186 (2024)
2024
-
[26]
Artificial Intelligence Review53(2), 907– 948 (2020)
Solorio-Fernández, S., Carrasco-Ochoa, J.A., Martínez-Trinidad, J.F.: A review of unsupervised feature selection methods. Artificial Intelligence Review53(2), 907– 948 (2020)
2020
-
[27]
In: Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining
Tan, P.N., Kumar, V., Srivastava, J.: Selecting the right interestingness measure for association patterns. In: Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining. pp. 32–41 (2002)
2002
-
[28]
Physical review E76(4), 046115 (2007)
Zhou, T., Ren, J., Medo, M., Zhang, Y.C.: Bipartite network projection and per- sonal recommendation. Physical review E76(4), 046115 (2007)
2007
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.