REVIEW 3 major objections 6 minor 44 references
Tabular classifiers can be explained by guiding a diffusion reverse process, with categorical features relaxed through Gumbel-softmax so classifier gradients can flow.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
TDCE guides a tabular diffusion reverse process with Gumbel-softmax classifier gradients to produce counterfactual explanations, achieving high validity on four benchmarks.
T0 review reviewed 2026-08-05 challenge →
load-bearing objection Useful empirical recipe for tabular counterfactuals via Gumbel-softmax guidance, but the theoretical bound in Theorem 4.1 is unproven—the proof rests on a false inequality. the 3 major comments →
Tabular Diffusion Counterfactual Explanations
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
Core claim
Central claim: a tabular diffusion model becomes a counterfactual explainer when classifier guidance is added to the reverse process and categorical features are relaxed with Gumbel-softmax vectors. Continuous features use the usual mean-plus-covariance gradient shift; categorical features approximate the Gumbel-softmax log-density linearly and add the classifier gradient to the logits (Eq. 18). The final category is an argmax. On four credit and law datasets, the paper reports the best validity, lower JS divergence for categorical distributions, and better interpretability than baselines at a fixed number of reverse steps, plus a temperature-dependent bound linking low temperature to a bett
What carries the argument
The load-bearing object is the Gumbel-softmax reparameterization of each categorical feature combined with a linearized guided reverse update. The relaxed vector replaces the one-hot value; the reverse log-density is approximated by the inner product of the relaxed vector with log probabilities from the denoiser, and the classifier's gradient is added to those logits. This makes the categorical reverse step resemble the Gaussian classifier-guidance update, allowing backpropagation through discrete features without enumerating all category combinations. The temperature controls how close the relaxation is to a one-hot vector and how much gradient variance appears.
Load-bearing premise
The categorical guidance pipeline assumes the approximation log pθ(ext|ext+1) ≈ ex⊤ log πθ(ext+1) + const is accurate enough that the guided reverse process still produces realistic categorical distributions; the paper's stated bound for this closeness relies on an inequality that does not hold for all Gumbel-softmax draws, so the theoretical guarantee is not actually established.
What would settle it
Compute the guided and unguided reverse trajectories on the same datasets and compare validity and JS divergence; if they match, the categorical guidance is not the active mechanism. Also, the proof's key inequality (Appendix A, A.17) fails for simple draws like π=(0.95,0.05), x=(0.2,0.8), so the bound cannot be relied on as a guarantee.
If this is right
- Counterfactual generation for categorical features becomes a fixed-cost reverse pass rather than a per-sample search, so explanation time scales with the diffusion depth, not with the data size.
- Continuous and categorical features are handled jointly in the same reverse process, so explanations can respect numeric and discrete structure at the same time.
- Immutable features can be enforced with a mask that blends the noisy input into the guided sample, which keeps protected or unchangeable attributes fixed.
- Temperature becomes a practical dial: lower temperatures make the relaxed features closer to one-hot but increase gradient variance, so each dataset needs its own temperature setting.
Where Pith is reading between the lines
- Because Eq. (16) linearizes the Gumbel-softmax log-density, the guidance update effectively shifts logits by a constant gradient; a natural extension is to learn a per-step logit correction that keeps the reverse trajectory on the data manifold even at high temperature.
- The approximation error is controlled by the minimum relaxed value, so categorical variables with skewed category distributions are the likely failure mode; testing on datasets with many rare categories would show where the method's validity advantage erodes.
- If the reported validity and interpretability gains hold, they imply that feature-space diffusion explainers stay closer to the data manifold than latent-space VAE explainers; this is directly testable by measuring the distance from generated counterfactuals to a held-out training set.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes TDCE, a tabular counterfactual-explanation method that extends classifier guidance to categorical features by relaxing one-hot vectors with a Gumbel-softmax reparameterization. The reverse process is guided by classifier gradients; a product-form approximation to the Gumbel-softmax density is introduced, and Theorem 4.1 claims a KL-divergence bound between the two. Experiments on four tabular datasets compare TDCE with Wachter, CCHVAE, REVISE, CLUE, FACE, and CounterNet on validity, interpretability, diversity, stability, JS divergence, L2 distance, and runtime. The paper reports that TDCE achieves competitive or superior performance on most metrics, especially validity and interpretability, while also being faster than search-based baselines.
Significance. If the method and its supporting analysis are correct, the paper makes a useful contribution: it provides a simple, model-agnostic way to perform classifier guidance on categorical tabular features within a diffusion framework, a setting that has received less attention than image counterfactuals. The empirical tables are presented with standard deviations and the runtime comparison is informative. However, the theoretical bound is not currently reliable, the algorithm as written does not transparently implement the derived update, and the empirical comparison lacks diffusion-based baselines and uses per-dataset tuning of the temperature. These issues affect the strength of the main claims, but the underlying idea is plausible and the experimental results are promising. The paper does not provide code or a reproducibility artifact, so independent verification is not yet possible.
major comments (3)
- [Appendix A, Eq. (A.17)] The proof of Theorem 4.1 relies on the inequality π_i^{1-x_i} ≤ (1-x_min)^{1-x_i}, but this is false in general. For example, with π=(0.95,0.05), x=(0.2,0.8), x_min=0.2, the left-hand side is 0.95^0.8 ≈ 0.96 while the right-hand side is 0.8^0.8 ≈ 0.84. Consequently, the upper-bound derivation leading to Eq. (A.22) collapses. Since Theorem 4.1 is the only theoretical justification for the approximation in Eq. (16), and Eq. (16) is used in deriving the guided update in Eq. (18), the theoretical guarantee for the categorical reverse process is not established. The authors should either repair the proof, provide a valid bound, or explicitly reframe Eq. (18) as a heuristic approximation supported only by experiments.
- [Algorithm 1, line 7] The update `ex_cat ← µ_cat + ||µ_cat|| g_cat` does not match the derived guided density in Eq. (18), which suggests updating the logits as `log π_θ + λ g_cat`. The algorithm also omits λ. It is unclear what µ_cat represents (predicted x_0? predicted logits? the mean of a Gumbel-softmax transition?) and how it is computed from the denoiser output. If the implemented update differs from Eq. (18), the derivation and the experiments may not correspond to the same method. Please specify the exact relationship and provide the sampling step or the closed-form update that follows from Eq. (18).
- [Section 5.3 and Tables 2–3] The empirical comparison is weakened by two issues. First, the temperature τ is searched per dataset over [0.1, 5] using the benchmark metrics themselves, while the baselines are reported with CARLA defaults. This can inflate the relative performance of TDCE. Second, there are no diffusion-based counterfactual baselines, despite the existence of recent discrete-diffusion guidance methods that the paper cites (e.g., [32,33]). A fairer comparison with baselines tuned on validation splits, plus at least one diffusion-based baseline, is needed to support the claim that TDCE 'outperforms popular baseline methods.'
minor comments (6)
- [Theorem 4.1 vs. Appendix A.2] The upper bound in the main text uses `log[1 - x_min]`, while Appendix A, Theorem A.2 states `log x_min` and the derivation in A.22 uses `log(1 - x_min)`. These versions should be reconciled.
- [Figure 3] The figure lacks axis labels and numerical values. Since the paper claims a 'tight bound,' it would help to plot the actual KL and both bounds on the same axes, or at least report the numerical values used.
- [Section 4.4 and Algorithm 1] The temperature schedule (warm start, then decrease) is described in the text but not reflected in Algorithm 1. Please state the schedule explicitly or add it to the pseudocode.
- [Section 5.3] Typo: 'low IM2/IM2' should read 'low IM1/IM2.' Also, 'Efficency' in the subsection heading should be 'Efficiency.'
- [Section 3.2] The function `f_dn` is used in Eq. (8) before being defined. Define it at first use.
- [Table 4] Caption says 'on the same computer setting'; should be 'same hardware and software settings' or similar.
Circularity Check
No significant circularity; the categorical guidance update is derived from an explicit Gumbel-softmax approximation and external classifier gradients, and the results are benchmarked externally.
full rationale
The paper's derivation chain is self-contained rather than circular. The guided categorical update (Eq. 18) follows from three explicit modeling choices: the Gumbel-softmax density (Eq. 13), the product-form approximation (Eq. 16/19), and a first-order Taylor expansion of the classifier (Eq. 17). None of these is fitted to the counterfactual metrics reported in Tables 2-3; the KL bound in Theorem 4.1 is a mathematical statement about the two distributions and is not a renamed version of the experimental results. The temperature τ is tuned on validation metrics, which is standard hyperparameter selection and does not make the reported counterfactual quality a prediction forced by construction. Self-citations (refs [11], [38]) appear only in related-work surveys and are not load-bearing for the method. The empirical comparison uses external baselines (Wachter, CCHVAE, REVISE, CLUE, FACE, CounterNet). The only notable issue is in the proof of Theorem 4.1: the inequality π_i^{1-x_i} ≤ (1-x_min)^{1-x_i} (Appendix A, Eq. A.17) is not valid in general, which undermines the stated upper bound; however, this is a correctness/mathematical-error concern, not a circularity, because the method does not reduce to its inputs by definition.
Axiom & Free-Parameter Ledger
free parameters (2)
- temperature tau =
searched in [0.1, 5] per dataset
- guidance strength lambda =
not reported
axioms (3)
- domain assumption The reverse process models the conditional distribution over discrete data using the Gumbel-softmax relaxation with temperature tau.
- domain assumption First-order Taylor expansion of the classifier log-likelihood in the Gumbel-softmax space (Eq. 17) yields a valid guidance direction.
- ad hoc to paper The diffusion model's reverse distributions p_theta(x_t|x_{t+1}) are accurately approximated by the categorical-style product in Eq. (19).
Cite this review
Pith. "Pith review of Tabular Diffusion Counterfactual Explanations." pith.science (2026). https://pith.science/paper/WTRRHFU4
@misc{pith2026250900876,
author = {Pith},
title = {Pith review of: Tabular Diffusion Counterfactual Explanations},
year = {2026},
howpublished = {\url{https://pith.science/paper/WTRRHFU4}},
note = {Machine review of arXiv:2509.00876}
}
abstract
Counterfactual explanations methods provide an important tool in the field of {interpretable machine learning}. Recent advances in this direction have focused on diffusion models to explain a deep classifier. However, these techniques have predominantly focused on problems in computer vision. In this paper, we focus on tabular data typical in finance and the social sciences and propose a novel guided reverse process for categorical features based on an approximation to the Gumbel-softmax distribution. Furthermore, we study the effect of the temperature $\tau$ and derive a theoretical bound between the Gumbel-softmax distribution and our proposed approximated distribution. We perform experiments on several large-scale credit lending and other tabular datasets, assessing their performance in terms of the quantitative measures of interpretability, diversity, instability, and validity. These results indicate that our approach outperforms popular baseline methods, producing robust and realistic counterfactual explanations.
Figures
Reference graph
Works this paper leans on
-
[1]
M. T. Ribeiro, S. Singh, C. Guestrin, ” why should i trust you?” ex- plaining the predictions of any classifier, in: International Conference on Knowledge Discovery and Data Mining, 2016
work page 2016
-
[2]
M. Ibrahim, M. Louie, C. Modarres, J. Paisley, Global explanations of neural networks: Mapping the landscape of predictions, in: AAAI/ACM Conference on AI, Ethics, and Society, 2019
work page 2019
-
[3]
A. Shrikumar, P. Greenside, A. Kundaje, Learning important features through propagating activation differences, in: International Conference on Machine Learning, 2017
work page 2017
-
[4]
M. Sundararajan, A. Taly, Q. Yan, Axiomatic attribution for deep networks, in: International Conference on Machine Learning, 2017. 29
work page 2017
-
[5]
S. Lundberg, S.-I. Lee, A unified approach to interpreting model predic- tions, in: Advances in Neural Information Processing Systems, 2017
work page 2017
-
[6]
L. T. Liu, S. Barocas, J. Kleinberg, K. Levy, On the actionability of outcome prediction, in: AAAI Conference on Artificial Intelligence, 2024
work page 2024
-
[7]
L. T. Liu, S. Dean, E. Rolf, M. Simchowitz, M. Hardt, Delayed impact of fair machine learning, in: International Conference on Machine Learning, 2018
work page 2018
-
[8]
R. Agarwal, L. Melnick, N. Frosst, X. Zhang, B. Lengerich, R. Caruana, G. E. Hinton, Neural additive models: Interpretable machine learning with neural nets, in: Advances in Neural Information Processing Systems, 2021
work page 2021
-
[9]
F. Radenovic, A. Dubey, D. Mahajan, Neural basis models for inter- pretability, in: Advances in Neural Information Processing Systems, 2022
work page 2022
- [10]
- [11]
-
[12]
S. Wachter, B. Mittelstadt, C. Russell, Counterfactual explanations without opening the black box: Automated decisions and the GDPR, Harvard Journal of Law & Tech. 31 (2017) 841. 30
work page 2017
-
[13]
R. Poyiadzi, K. Sokol, R. Santos-Rodriguez, T. De Bie, P. Flach, F ACE: feasible and actionable counterfactual explanations, in: AAAI/ACM Conference on AI, Ethics, and Society, 2020
work page 2020
-
[14]
A. Van Looveren, J. Klaise, Interpretable counterfactual explanations guided by prototypes, in: Joint European Conference on Machine Learning and Knowledge Discovery in Databases, 2021
work page 2021
- [15]
-
[16]
R. Guidotti, A. Monreale, S. Ruggieri, D. Pedreschi, F. Turini, F. Gi- annotti, Local rule-based explanations of black box decision systems, arXiv preprint arXiv:1805.10820 (2018)
Pith/arXiv arXiv 2018
-
[17]
R. K. Mothilal, A. Sharma, C. Tan, Explaining machine learning clas- sifiers through diverse counterfactual explanations, in: Conference on Fairness, Accountability, and Transparency, 2020
work page 2020
-
[18]
R. R. Fern´ andez, I. M. De Diego, V. Ace˜ na, A. Fern´ andez-Isabel, J. M. Moguerza, Random forest explainability using counterfactual sets, Infor- mation Fusion 63 (2020) 196–207
work page 2020
-
[19]
D. P. Kingma, Auto-encoding variational Bayes, arXiv preprint arXiv:1312.6114 (2013)
Pith/arXiv arXiv 2013
-
[20]
S. Joshi, O. Koyejo, W. Vijitbenjaronk, B. Kim, J. Ghosh, Towards realistic individual recourse and actionable explanations in black-box decision making systems, arXiv preprint arXiv:1907.09615 (2019). 31
Pith/arXiv arXiv 1907
-
[21]
J. Antor´ an, U. Bhatt, T. Adel, A. Weller, J. M. Hern´ andez-Lobato, Getting a clue: A method for explaining uncertainty estimates, arXiv preprint arXiv:2006.06848 (2020)
Pith/arXiv arXiv 2006
-
[22]
M. Pawelczyk, K. Broelemann, G. Kasneci, Learning model-agnostic counterfactual explanations for tabular data, in: The Web Conference, 2020
work page 2020
-
[23]
J. Ho, A. Jain, P. Abbeel, Denoising diffusion probabilistic models, in: Advances in Neural Information Processing Systems, 2020
work page 2020
-
[24]
J. Song, C. Meng, S. Ermon, Denoising diffusion implicit models, arXiv preprint arXiv:2010.02502 (2020)
Pith/arXiv arXiv 2010
-
[25]
P. Dhariwal, A. Nichol, Diffusion models beat GANs on image synthesis, in: Advances in Neural Information Processing Systems, 2021
work page 2021
-
[26]
M. Augustin, V. Boreiko, F. Croce, M. Hein, Diffusion visual counter- factual explanations, in: Advances in Neural Information Processing Systems, 2022
work page 2022
-
[27]
E. Hoogeboom, D. Nielsen, P. Jaini, P. Forr´ e, M. Welling, Argmax flows and multinomial diffusion: Learning categorical distributions, in: Advances in Neural Information Processing Systems, 2021
work page 2021
-
[28]
H. Sun, L. Yu, B. Dai, D. Schuurmans, H. Dai, Score-based continuous- time discrete diffusion models, arXiv preprint arXiv:2211.16750 (2022)
Pith/arXiv arXiv 2022
-
[29]
S. Dieleman, L. Sartran, A. Roshannai, N. Savinov, Y. Ganin, P. H. 32 Richemond, A. Doucet, R. Strudel, C. Dyer, C. Durkan, et al., Continuous diffusion for categorical data, arXiv preprint arXiv:2211.15089 (2022)
Pith/arXiv arXiv 2022
-
[30]
A. Kotelnikov, D. Baranchuk, I. Rubachev, A. Babenko, Tabddpm: Mod- elling tabular data with diffusion models, in: International Conference on Machine Learning, 2023
work page 2023
- [31]
- [32]
-
[33]
Y. Schiff, S. S. Sahoo, H. Phung, G. Wang, S. Boshar, H. Dalla-torre, B. P. de Almeida, A. Rush, T. Pierrot, V. Kuleshov, Simple guidance mech- anisms for discrete diffusion models, arXiv preprint arXiv:2412.10193 (2024)
Pith/arXiv arXiv 2024
-
[34]
E. Jang, S. Gu, B. Poole, Categorical reparameterization with Gumbel- softmax, in: International Conference on Learning Representations, 2017
work page 2017
-
[35]
A. Nazabal, P. M. Olmos, Z. Ghahramani, I. Valera, Handling incomplete heterogeneous data using vaes, Pattern Recognition 107 (2020) 107501
work page 2020
-
[36]
H. Guo, T. H. Nguyen, A. Yadav, Counternet: End-to-end training of prediction aware counterfactual explanations, in: Proceedings of the 29th 33 ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2023, pp. 577–589
work page 2023
-
[37]
H. Guo, F. Jia, J. Chen, A. Squicciarini, A. Yadav, Rocoursenet: Robust training of a prediction aware recourse model, in: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, 2023, pp. 619–628
work page 2023
- [38]
-
[39]
J. Su, D. V. Vargas, K. Sakurai, One pixel attack for fooling deep neural networks, IEEE Transactions on Evolutionary Computation 23 (2019) 828–841
work page 2019
-
[40]
J. Sohl-Dickstein, E. Weiss, N. Maheswaranathan, S. Ganguli, Deep unsupervised learning using nonequilibrium thermodynamics, in: Inter- national Conference on Machine Learning, 2015
work page 2015
-
[41]
A. Q. Nichol, P. Dhariwal, Improved denoising diffusion probabilistic models, in: International Conference on Machine Learning, 2021
work page 2021
-
[42]
C. J. Maddison, A. Mnih, Y. W. Teh, The concrete distribution: A continuous relaxation of discrete random variables, arXiv preprint arXiv:1611.00712 (2016)
Pith/arXiv arXiv 2016
-
[43]
O. Avrahami, D. Lischinski, O. Fried, Blended diffusion for text-driven editing of natural images, in: IEEE Conference on Computer Vision and Pattern Recognition, 2022. 34
work page 2022
-
[44]
log Γ(K)τ K−1 KY i=1 Z(π)π1−exi i ex−τ −1 i KP j πj ex−τ j # (A.15) = E
M. Pawelczyk, S. Bielawski, J. v. d. Heuvel, T. Richter, G. Kasneci, CARLA: A Python library to benchmark algorithmic recourse and coun- terfactual explanation algorithms, in: Neural Information Processing Systems Track on Datasets and Benchmarks, 2021. 35 Appendix A. Proof of the closeness of the approximated Gumbel Softmax distribution Lemma Appendix A....
work page 2021
This paper was first reviewed by deepseek-v4-flash on August 5, 2026.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.