REVIEW 3 major objections 4 minor 41 references
Towards Robust Interpretable Surrogates for Optimization
T0 review · 3 major / 4 minor · reviewed 2026-08-12 · deepseek-v4-flash
Pith's one-line read Training a small decision tree that maps observed costs to solutions, under worst-case budgeted perturbations of those observations, gives surrogates that keep most of their nominal quality while performing much better on noisy and…
desk verdict Solid robust-optimization extension of interpretable surrogates, but the out-of-sample global-budget comparison is weakened by a test/training budget mismatch and needs fixing before the headline claim is trusted. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the robust decision-tree surrogate: a univariate, bounded-depth tree whose internal nodes each test one cost coefficient against a threshold and whose leaves contain feasible solutions of the underlying optimization problem. The argument is carried by the robust interpretable tree (RIT) formulation, whose objective is the worst-case sum over training samples under a budgeted $\ell^1$ perturbation set, either global $U_{\text{glob}}$ (one budget for all perturbations) or local $U_{\text{loc}}$ (a budget per sample). The exact method alternates a flow-based mixed-integer master problem, restricted to split thresholds at midpoints of sorted training values, with an adversary problem that maximizes cost by assigning samples to leaves; the adversary problem is a multiple-choice knapsack. Heuristics split the joint tree-structure and leaf-solution decision by fixing one side and optimizing the other, alternating between the two until convergence.
What would settle it
Take any training instance, solve the robust tree problem with the midpoint grid, then search each chosen split interval on a fine continuous grid; if a single threshold outside the midpoint set lowers the worst-case cost, the method's optimality claim fails. On the empirical side, an out-of-sample dataset containing real measurement noise would be the test: the paper's claim predicts the robust tree achieves lower average cost than the nominally trained tree at small nominal loss.
Extended reading notes
Core claim
On the paper's own terms, the central claim is that the min-max problem of finding a robust interpretable decision tree, $\min_{T} \max_{\xi \in U} \sum_j c_j^\top T(c_j+\xi_j)$, is tractable enough in practice to be worth solving: exact scenario generation works for small instances, and a heuristic that fixes the tree structure and then optimizes the leaf solutions finds good surrogates quickly. The experiments show that the price of robustness is low—robust trees are within roughly two percent of the nominal tree's training objective—while their worst-case in-sample objective improves by up to about sixteen percent, and on out-of-sample data robust trees beat the nominal tree even when no perturbations are applied. The paper also establishes that with sufficiently large perturbation budgets a single-solution tree is optimal, and that assigning optimal solutions to the leaves of a fixed tree is NP-hard even for a simple selection problem with a unit budget.
Load-bearing premise
The exact method proves optimality only among trees whose split thresholds are midpoints between sorted training values, so the true best robust tree might use a threshold the model never offers.
Editorial extensions
If this is right
- A robustly trained tree loses less than about two percent of nominal in-sample performance while improving worst-case in-sample cost by roughly nine to sixteen percent over a nominally trained tree, so robustness does not require sacrificing much everyday quality.
- Trees trained for robustness beat the nominally trained tree on out-of-sample test data even when the test data are unperturbed, and the advantage grows with instance size, so robust training appears to act as a regularizer.
- Whenever the perturbation budget exceeds $D\cdot N\cdot M$ (global) or $D\cdot M$ (local), a single fixed solution is provably optimal, so large uncertainty budgets make deep trees unnecessary.
- Even fixing the tree structure and choosing leaf solutions optimally is NP-hard for the selection problem, so the heuristic decomposition into tree-building and solution-assignment steps is justified.
- Worst-case performance under the global and local budgeted uncertainty sets is strongly correlated, so the cheaper local-budget model can serve as a practical proxy for the global model.
Reading between the lines
- The restriction of split thresholds to midpoints of sorted training values may make the reported robust optima conservative; solving the same min-max problem with continuous thresholds could find trees with even smaller nominal loss or better worst-case cost, an improvement the paper does not claim.
- The out-of-sample gains in unperturbed settings suggest that robust training is implicitly regularizing the tree, which connects this work to structural-risk arguments without the paper drawing that link.
- Because local-budget uncertainty is easier to optimize and strongly correlated with the global set, a practitioner could estimate per-observation budgets from historical measurement residuals and train under $U_{\text{loc}}$ alone, an extension the paper lists as future work.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper studies decision-tree surrogates for optimization problems when the observed cost parameters are subject to worst-case perturbations. The authors formulate a min-max problem (RIT) over univariate trees, introduce a global budgeted uncertainty set Uglob and a local one Uloc, and propose an exact scenario-generation MIP (master problem (1) plus adversary problem (2)/(3)), a post-processing step, and three heuristics H_tree, H_sol, H_alt, together with a single-solution baseline H1. The main theoretical results are Theorem 4.1 (large-budget regimes make H1 optimal) and Theorem 4.2 (NP-hardness of leaf-solution assignment for a fixed tree). In experiments on synthetic grid shortest-path instances, the paper compares robust trees with a nominal surrogate Tnom and reports that robust models lose little nominal performance and improve worst-case and out-of-sample performance. The code and data are made available.
Significance. The contribution is potentially useful: it extends the interpretable-surrogate framework of Goerigk and Hartisch to a robust setting, and the two uncertainty models plus the exact/heuristic solution methods are clearly specified. Strengths include explicit adversary formulations, a clean large-budget characterization (Theorem 4.1), a correct-looking NP-hardness reduction for LSAP, reproducible code and data, and honest reporting that the exact scenario-generation method solves few instances to optimality for larger budgets. The main caveats are that the exact method is exact only over a discrete threshold grid, and that the global-budget out-of-sample experiment dilutes the test adversary by reusing the training budget on a 1000-point test set. If these are addressed, the empirical claims about robust generalization can be evaluated properly.
major comments (3)
- [Section 5.2.3, Table 5] The out-of-sample evaluation for the global budget reuses the training budget Gammaglob = N Gammaloc (with N = 3 to 10 training samples) on a test set of T = 1000 observations. Since Uglob is a single L1 budget across the whole set, the per-observation adversary power on the test set is smaller by a factor of order T/N, roughly 100 to 300, than on the training set. The reported advantages of H_glob_tree over Tnom on the test data therefore likely reflect a much weaker test adversary rather than robust generalization. Please re-evaluate with Gammaglob_test = T Gammaloc, or with a per-observation evaluation using Gammaloc, and report error bars or significance tests over the 20 instances.
- [Section 2.2, Problem (1)] The exact method restricts split thresholds to the finite midpoint set Theta(i), while Problem (RIT) as defined in Section 2.1 allows any threshold in the interval [min_j c_{j,i}, max_j c_{j,i}]. The robust training objective is not constant on such intervals because the adversary costs rho_j^k depend linearly on the distance from c_{j,i} to the threshold; hence the midpoint restriction is not without loss of optimality. The post-processing over the nine-point grid Pi = {0.1, ..., 0.9} only explores a finite subset of each interval and does not restore global optimality. The paper should either define the solved problem as restricted to Theta(i) and adjust the 'optimal' claims accordingly, or justify that an optimal threshold can always be found on the grid.
- [Section 5.2.2, Table 3 and Figures 6-7] The comparison between SG and the heuristics is difficult to interpret because SG is not solved to optimality for most instances; Table 3 reports only counts of instances with a gap of at most 0.001, not the actual observed gaps. Since the plotted SG objective values are therefore upper bounds on the true robust optimum for these instances, the claim that H_sol performs noticeably worse than other robust methods is not fully established. Please report average optimality gaps, or mark the points in Figures 6 and 7 where the one-hour time limit was reached.
minor comments (4)
- [Section 4.2, Theorem 4.2] The reduction starts from a partition problem with the additional constraint p = n/2, but the standard Partition problem does not constrain cardinality. Please state the cardinality-constrained variant explicitly and justify its NP-completeness, or give a short reduction from the unconstrained variant.
- [Section 5.1, Tables 4 and 5] No error bars or significance tests are reported for any of the numerical comparisons beyond averaging over 20 instances. Adding standard errors, especially for the out-of-sample rows in Tables 4 and 5, would make the relative rankings much more informative.
- [Section 2.2, Constraint (1h)] The big-M values M^j are defined as max_{x in X} c_j^T x or any upper bound; this assumes bounded X or a known finite upper bound. For the shortest-path experiments this is fine, but the text should state the boundedness assumption explicitly.
- [Section 4.1, Theorem 4.1] The proof's equality/inequality chain would benefit from one sentence explaining why, under the stated budgets, the adversary can simultaneously send every sample to any leaf, rather than only each sample individually.
Circularity Check
No significant circularity: robust-tree formulation and experiments are self-contained, with only a benchmarking confound in the global-budget test evaluation.
full rationale
The paper's central derivation is not circular. Problem (RIT) in Section 2.1 defines a new min-max objective, and the exact scenario-generation method, the adversary MIPs (Models (2)-(3)), and the heuristics are all built from this definition; no fitted constant is later relabeled as a prediction. The nominal baseline Tnom is re-implemented using Model (1) rather than taken on faith from the authors' earlier framework, and comparisons also include the trivial single-solution heuristic H1, so the robust claim is tested against independent or intentionally weak alternatives. Optimality is explicitly scoped: thresholds are restricted to the midpoint grid Θ(i) in Section 2.2, with a post-processing search over a fixed 9-point discretization, so the exact method is optimal only within that stated class. The self-citations to [GH23], [GH24], and [GHMS24] are contextual background (framework, textbook, feature-based extension) and do not carry any load-bearing theorem; Theorems 4.1 and 4.2 are new proofs with self-contained constructions. The most notable weakness is in Section 5.2.3, where Γglob=NΓloc is trained on N samples and then reused as an absolute budget on T=1000 test observations, diluting the per-observation global-budget threat; the authors themselves acknowledge this: 'This can be explained by the use of the same absolute values for Γglob in the training and test environment, which reduces its relative impact in the latter case.' That is an evaluation limitation, not a circular reduction: test data are not used to fit the model, and the out-of-sample objective is not equal to the training objective by construction. No circular step can be exhibited.
Assumptions & free parameters
free parameters (3)
- Uncertainty budget scaling λ
- Threshold refinement grid Π =
0.1, 0.2, ..., 0.9
- Tie-breaking constant ϵ =
0.001
assumptions (4)
- domain assumption Split thresholds are restricted to midpoints of sorted training values for each item; the optimal tree is assumed to be findable within this discrete grid with post-hoc refinement.
- domain assumption The true cost vector of an instance is fixed; only its observation can be perturbed by an adversary within a budgeted L1 uncertainty set.
- standard math The underlying optimization problem min_{x∈X} c^T x is representable as a mixed-integer linear program.
- standard math Balanced partition with an exact cardinality of n/2 is NP-complete, used as the source problem in the reduction for Theorem 4.2.
Cite this review
Pith. "Pith review of Towards Robust Interpretable Surrogates for Optimization." pith.science (2026). https://pith.science/paper/Y2SZBQAN
@misc{pith2026241201264,
author = {Pith},
title = {Pith review of: Towards Robust Interpretable Surrogates for Optimization},
year = {2026},
howpublished = {\url{https://pith.science/paper/Y2SZBQAN}},
note = {Machine review of arXiv:2412.01264}
}
read the original abstract
An important factor in the practical implementation of optimization models is the acceptance by the intended users. This is influenced among other factors by the interpretability of the solution process. Decision rules that meet this requirement can be generated using the framework for inherently interpretable optimization models. In practice, there is often uncertainty about the parameters of an optimization problem. An established way to deal with this challenge is the concept of robust optimization. The goal of our work is to combine both concepts: to create decision trees as surrogates for the optimization process that are more robust to perturbations and still inherently interpretable. For this purpose we present suitable models based on different variants to model uncertainty, and solution methods. Furthermore, the applicability of heuristic methods to perform this task is evaluated. Both approaches are compared with the existing framework for inherently interpretable optimization models.
Reference graph
Works this paper leans on
-
[1]
Min--max and min--max regret versions of combinatorial optimization problems: A survey
Hassene Aissi, Cristina Bazgan, and Daniel Vanderpooten. Min--max and min--max regret versions of combinatorial optimization problems: A survey. European Journal of Operational Research , 197(2):427--438, 2009
work page 2009
-
[2]
Maxime Amram, Jack Dunn, and Ying Daisy Zhuo. Optimal policy trees. Machine Learning , 111(7):2741--2768, 2022
work page 2022
-
[3]
A framework for data-driven explainability in mathematical optimization
Kevin-Martin Aigner, Marc Goerigk, Michael Hartisch, Frauke Liers, and Arthur Miehlich. A framework for data-driven explainability in mathematical optimization. Proceedings of the AAAI Conference on Artificial Intelligence , 38(19):20912--20920, Mar. 2024
work page 2024
-
[4]
Strong optimal classification trees
Sina Aghaei, Andr \'e s G \'o mez, and Phebe Vayanos. Strong optimal classification trees. Operations Research , 2024
work page 2024
-
[5]
Explainable predict-and-optimize
Rafael Blanquero, Emilio Carrizosa, and Nuria G \'o mez-Vargas. Explainable predict-and-optimize. Preprint available online , 2023
work page 2023
-
[6]
Decision trees: from efficient prediction to responsible AI
Hendrik Blockeel, Laurens Devos, Beno \^ t Fr \'e nay, G \'e raldin Nanfack, and Siegfried Nijssen. Decision trees: from efficient prediction to responsible AI . Frontiers in Artificial Intelligence , 6:1124553, 2023
work page 2023
-
[7]
Hamsa Bastani, Kimon Drakopoulos, Vishal Gupta, Jon Vlachogiannis, Christos Hadjichristodoulou, Pagona Lagiou, Gkikas Magiorkinis, Dimitrios Paraskevis, and Sotirios Tsiodras. Interpretable operations research for high-stakes decisions: Designing the Greek COVID -19 testing system. INFORMS Journal on Applied Analytics , 52(5):398--411, 2022
work page 2022
-
[8]
Improving Stability in Decision Tree Models
Dimitris Bertsimas and Vassilis Digalakis Jr. Improving stability in decision tree models. arXiv preprint arXiv:2305.17299 , 2023
work page Pith review arXiv 2023
Show all 41 references
-
[9]
Optimal prescriptive trees
Dimitris Bertsimas, Jack Dunn, and Nishanth Mundru. Optimal prescriptive trees. INFORMS Journal on Optimization , 1(2):164--183, 2019
2019
-
[10]
Data-driven robust optimization
Dimitris Bertsimas, Vishal Gupta, and Nathan Kallus. Data-driven robust optimization. Mathematical Programming , 167:235--292, 2018
2018
-
[11]
Interpretable clustering: an optimization approach
Dimitris Bertsimas, Agni Orfanoudaki, and Holly Wiberg. Interpretable clustering: an optimization approach. Machine Learning , 110:89--138, 2021
2021
-
[12]
Robust discrete optimization and network flows
Dimitris Bertsimas and Melvyn Sim. Robust discrete optimization and network flows. Mathematical Programming , 98(1):49--71, 2003
2003
-
[13]
The price of robustness
Dimitris Bertsimas and Melvyn Sim. The price of robustness. Operations Research , 52(1):35--53, 2004
2004
-
[14]
Algorithms and uncertainty sets for data-driven robust shortest path problems
Andr \'e Chassein, Trivikram Dokka, and Marc Goerigk. Algorithms and uncertainty sets for data-driven robust shortest path problems. European Journal of Operational Research , 274(2):671--686, 2019
2019
-
[15]
Explainable interactive evolutionary multiobjective optimization
Salvatore Corrente, Salvatore Greco, Benedetto Matarazzo, and Roman S owi \'n ski. Explainable interactive evolutionary multiobjective optimization. Omega , 122:102925, 2024
2024
-
[16]
On clustering and interpreting with rules by means of mathematical optimization
Emilio Carrizosa, Kseniia Kurishchenko, Alfredo Mar \' n, and Dolores Romero Morales. On clustering and interpreting with rules by means of mathematical optimization. Computers & Operations Research , 154:106180, 2023
2023
-
[17]
Argumentation for explainable scheduling
Kristijonas C yras, Dimitrios Letsios, Ruth Misener, and Francesca Toni. Argumentation for explainable scheduling. In Proceedings of the AAAI Conference on Artificial Intelligence , volume 33, pages 2752--2759, 2019
2019
-
[18]
Mi s i \'c
Dragos Florin Ciocan and Velibor V. Mi s i \'c . Interpretable optimal stopping. Management Science , 68(3):1616--1638, 2022
2022
-
[19]
Costa and Carlos E
Vin \' cius G. Costa and Carlos E. Pedreira. Recent advances in decision trees: An updated survey. Artificial Intelligence Review , 56(5):4765--4800, 2023
2023
-
[20]
Robust decision trees against adversarial examples
Hongge Chen, Huan Zhang, Duane Boning, and Cho-Jui Hsieh. Robust decision trees against adversarial examples. In International Conference on Machine Learning , pages 1122--1131. PMLR, 2019
2019
-
[21]
predict, then optimize
Adam N. Elmachtoub and Paul Grigas. Smart “predict, then optimize”. Management Science , 68(1):9--26, 2022
2022
-
[22]
Explainable data-driven optimization: from context to decision and back again
Alexandre Forel, Axel Parmentier, and Thibaut Vidal. Explainable data-driven optimization: from context to decision and back again. In International Conference on Machine Learning , pages 10170--10187. PMLR, 2023
2023
-
[23]
A framework for inherently interpretable optimization models
Marc Goerigk and Michael Hartisch. A framework for inherently interpretable optimization models. European Journal of Operational Research , 310(3):1312--1324, 2023
2023
-
[24]
An Introduction to Robust Combinatorial Optimization
Marc Goerigk and Michael Hartisch. An Introduction to Robust Combinatorial Optimization . Springer Cham, 2024
2024
-
[25]
Feature-based interpretable surrogates for optimization
Marc Goerigk, Michael Hartisch, Sebastian Merten, and Kartikey Sharma. Feature-based interpretable surrogates for optimization. arXiv preprint arXiv:2409.01869 , 2024
2024
-
[26]
Garey and David S
Michael R. Garey and David S. Johnson. Computers and intractability , volume 174. Freeman San Francisco, 1979
1979
-
[27]
Gurobi Optimizer Reference Manual , 2024
Gurobi Optimization, LLC . Gurobi Optimizer Reference Manual , 2024
2024
-
[28]
Gorissen, \.I hsan Yan ko g lu, and Dick den Hertog
Bram L. Gorissen, \.I hsan Yan ko g lu, and Dick den Hertog. A practical guide to robust optimization. Omega , 53:124--137, 2015
2015
-
[29]
Hagberg, Daniel A
Aric A. Hagberg, Daniel A. Schult, and Pieter J. Swart. Exploring network structure, dynamics, and function using networkx. In Proceedings of the 7th Python in Science Conference (SciPy2008) , pages 11--15, 2008
2008
-
[30]
Optimal robust classification trees
Nathan Justin, Sina Aghaei, Andres Gomez, and Phebe Vayanos. Optimal robust classification trees. In The AAAI-22 Workshop on Adversarial Machine Learning and Beyond , 2022
2022
-
[31]
Christopher Beck
Anton Korikov and J. Christopher Beck. Objective-based counterfactual explanations for linear discrete optimization. In International Conference on Integration of Constraint Programming, Artificial Intelligence, and Operations Research , pages 18--34. Springer, 2023
2023
-
[32]
\.I lker Birbil, and Dick den Hertog
Jannis Kurtz, S . \.I lker Birbil, and Dick den Hertog. Counterfactual explanations for linear optimization. arXiv preprint arXiv:2405.15431 , 2024
2024 arXiv
-
[33]
The multiple-choice knapsack problem
Hans Kellerer, Ulrich Pferschy, and David Pisinger. The multiple-choice knapsack problem. In Knapsack Problems , pages 317--347. Springer Berlin Heidelberg, 2004
2004
-
[34]
Hyafil Laurent and Ronald L. Rivest. Constructing optimal binary decision trees is NP -complete. Information Processing Letters , 5(1):15--17, 1976
1976
-
[35]
Robust decision trees for the multi-mode project scheduling problem with a resource investment objective and uncertain activity duration
Tom Portoleau, Christian Artigues, and Romain Guillaume. Robust decision trees for the multi-mode project scheduling problem with a resource investment objective and uncertain activity duration. European Journal of Operational Research , 312(2):525--540, 2024
2024
-
[36]
Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead
Cynthia Rudin. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence , 1(5):206--215, 2019
2019
-
[37]
Zoltners
Prabhakant Sinha and Andris A. Zoltners. The multiple-choice knapsack problem. Operations Research , 27(3):503--515, 1979
1979
-
[38]
Explaining solutions to multi-stage stochastic optimization problems to decision makers
Kevin Tierney, Kaja Balzereit, Andreas Bunte, and Oliver Nieh \"o rster. Explaining solutions to multi-stage stochastic optimization problems to decision makers. In 2022 IEEE 27th International Conference on Emerging Technologies and Factory Automation (ETFA) , pages 1--4. IEEE, 2022
2022
-
[39]
Efficient training of robust decision trees against adversarial examples
Dani \"e l Vos and Sicco Verwer. Efficient training of robust decision trees against adversarial examples. In International Conference on Machine Learning , pages 10586--10595. PMLR, 2021
2021
-
[40]
Robust optimal classification trees against adversarial examples
Daniël Vos and Sicco Verwer. Robust optimal classification trees against adversarial examples. Proceedings of the AAAI Conference on Artificial Intelligence , 36(8):8520--8528, Jun. 2022
2022
-
[41]
Solving two-stage robust optimization problems using a column-and-constraint generation method
Bo Zeng and Long Zhao. Solving two-stage robust optimization problems using a column-and-constraint generation method. Operations Research Letters , 41(5):457--461, 2013
2013
Reviewed August 12, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.