REVIEW 4 major objections 5 minor 42 references
Computational adversarial risk analysis for general security games
T0 review · 4 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read This paper claims that any proper bi-agent influence diagram security game, discrete or continuous, can be solved from the Defender's perspective by replacing every expected-utility maximization with a mode estimate of an augmented…
desk verdict Solid extension of APS to general security games with a useful case study, but the flagship reduction as written has a conditioning bug and the continuous-domain claims outrun the proofs. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central mechanism is Augmented Probability Simulation (APS): instead of maximizing the Defender's expected utility directly, one samples from an augmented distribution proportional to the utility times the relevant probability factors and estimates the mode of the decision-variable marginal, which coincides with the optimal decision when the utility is positive. For the Attacker, the same construction applies to random utilities and probabilities, yielding a Random Augmented Distribution whose marginal mode produces a sample from the Attacker's random optimal action; repeating this supplies the Defender's probabilistic forecast of the attack. DAPS and AAPS reductions package these mode-finding steps so that Algorithm 2 works backward along the Defender Decision Path and Attacker Decision Path, the named reduction operations being the paper's main theoretical instruments.
What would settle it
Construct a small discrete proper BAID, compute the optimal Defender policy by exhaustive enumeration, then run Algorithm 2 with exact enumeration in place of sampling; if the output differs from the exhaustive optimum on any instance, Proposition 5 fails. For the computational pipeline, take a continuous instance where the true optimal second-stage decision has a known closed form and check whether the neural-network value-function metamodel has the same maximizer; a single case where the metamodel's mode differs from the true mode would falsify the approximation scheme.
Extended reading notes
Core claim
Proposition 5 states that in a proper BAID, Algorithm 2 provides the optimal policy for the Defender. The algorithm reads the game as two directed decision paths (the Defender's and the Attacker's), and at each backward step it either applies a DAPS reduction—defining an augmented distribution proportional to the Defender's utility times the relevant probability terms, so that the mode in the decision variable equals the optimal decision—or, when the Defender lacks the probabilities describing the Attacker's next move, an AAPS reduction that samples the Attacker's random optimal decision from his own augmented distribution. Because expected utilities are maximized, positive constants in Bayes' denominators can be ignored, so continuous and high-cardinality spaces are handled by sampling and mode estimation rather than arc inversions and analytic elimination. The paper also provides a full computational scheme, using neural-network metamodels trained on grids to carry approximate value functions and conditional attack densities backwards through the diagram, demonstrated on a disinformation-war case.
Load-bearing premise
Correctness depends on the informal availability check in Section 4.3: every Defender decision must be reachable either with all needed probabilities already available or after finitely many Attacker reductions, with no circular dependence on the very Defender decision being computed, and the metamodels used in continuous problems must preserve the modes they approximate.
Editorial extensions
If this is right
- Security games with continuous action spaces and no common knowledge can be solved from the Defender's perspective, not just discrete or low-cardinality ones.
- The Attacker's decisions come with probabilistic forecasts that feed naturally into the Defender's optimization and could also be used for attack awareness.
- The approach provides a general resolution of the longstanding query about solving influence diagrams with multiple decision-makers, within the adversarial risk analysis solution concept.
- Multi-stage games are handled by backward induction with metamodels, as illustrated by the disinformation-war study producing a first-stage defense allocation of 0.7 and a defensive response policy that deploys full reactive resources only when a high-intensity attack is expected.
Reading between the lines
- The informal availability check in Section 4.3 is where the general claim is most exposed; a formal characterization of when repeated AAPS reductions terminate without circular dependence would turn the computational scheme into a fully stated theorem.
- The same APS mode-finding construction could plausibly extend to games with more than two agents, since each additional strategic agent could be represented by another layer of random augmented distributions, though computational cost and confluence issues would likely grow.
- The reliance on mode-consistent estimators suggests that multimodal augmented distributions could be a practical weak point; a testable extension is to compare the algorithm's output with exact enumeration on small multimodal instances.
- Using adaptive experimental design instead of fixed grids, as the authors note, could reduce the cost of training the metamodels that approximate value functions and attack densities.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a computational scheme for solving general security games, modeled as bi-agent influence diagrams (BAIDs), from an adversarial risk analysis (ARA) perspective. The method replaces Shachter-style influence diagram reductions with augmented probability simulation (APS) reductions, so that defender decisions are obtained by finding modes of augmented distributions and attacker decisions are sampled from random augmented distributions. The authors claim this provides the first general solution to Shachter's query for possibly continuous BAIDs. The paper includes a formal algorithmic description (Algorithm 2, Proposition 5), a discussion of computational approximations using neural-network metamodels, and a disinformation-war case study with a reported optimal first-stage defense d*1 = 0.7.
Significance. If the theoretical core were fully correct, the paper would be a valuable contribution: it extends prior discrete ARA solutions (González-Ortega et al., 2019) and sequential APS methods (Ekin et al., 2023) to general, possibly continuous BAIDs, and it provides an implemented, reproducible case study with publicly available code. The mode-to-argmax idea for APS is attractive and, for unconditional defender decisions, the paper correctly proves the required equivalence under positivity and continuity assumptions. However, the formal statements of the conditional-policy reductions contain genuine defects, the termination/confluence argument for Algorithm 2 is incomplete, and the approximation error introduced by the MLP metamodels is not accounted for. These issues are load-bearing for the central claim, so the paper requires major revision before the contribution can be accepted as stated.
major comments (4)
- [§3.1 (DAPS1), §3.2 (Prop. 3), §5.2.1] The mode-to-argmax equivalence for conditional policies is misstated. In Section 3.1, DAPS1 defines π(d1,d2,θ2|a2,θ1) ∝ uD(d1,d2,θ2)pD(θ2|d2,a2,θ1) and then says that estimating mode(π(d1|a2,θ1)) approximates d*2(d1,a2,θ1). The joint distribution contains d1, but the conditioning set does not, so the marginal over d2 averages over d1 without a specified weighting measure; its mode is not the pointwise argmax d*2(d1,a2,θ1). A simple counterexample is uD = C − (d1−d2)^2, for which the true conditional argmax is d2 = d1 but the unconditional marginal mode is an averaged value. The correct construction, which Section 5.2.1 actually uses, conditions on d1 as well: π(d2,θ2|d1,a2,θ1) ∝ uD(d1,d2,θ2)pD(θ2|d2,a2,θ1). Proposition 3 has the same defect: conditioning on ant(Xc(D)) can include the very decision being maximized (e.g., D2 ∈ ant(Θ2) in the case study), and it omits utility antecessors such as d1 that survive in the policy argument y′. As written, Proposition 5's proof, which cites Propositions 3 and 4, does not establish the conditional-policy claims. This is a correctable but central error in the formal development.
- [§3.2 (Prop. 3 proof) and Section 3.2 discussion] The proof of Proposition 3, and the surrounding discussion, assert that denominators arising from Bayes' rule are 'positive constants' and can therefore be ignored. Positivity alone is insufficient: a positive factor that depends on the decision being maximized changes the argmax. In Example 2 the denominator pD(x2) is independent of d, so the argument works, but the general proposition does not state or prove that the ignored marginals are constant with respect to the decision variable. Arc inversions in a general proper BAID can produce marginals that depend on remaining decision variables. The paper should either prove that the Shachter elimination ordering in a proper BAID always makes such marginals independent of the optimized decision, or add the required condition to Propositions 3 and 4.
- [§3.2 (Prop. 5 proof) and §4.3] Proposition 5's proof concludes termination from the finiteness of the DDP and ADP, but correctness and termination of Algorithm 2 also depend on the informal availability check in Section 4.3. The proof does not show that, whenever a Defender decision Di is reached, the required attacker distributions are actually available after finitely many AAPS reductions, nor that these reductions do not depend circularly on the same Di. The statement 'reduce the required Aj nodes in the ADP inverse sequence order until deducing the corresponding attack distributions' describes a heuristic rather than a proven property of proper BAIDs. Finiteness of the two decision paths alone does not rule out the possibility that the else branch reduces a wrong attacker node and the loop fails to make progress toward the needed distribution. A rigorous proof of the availability/confluence property is needed for Proposition 5.
- [§4.1, §4.2, §5.2] The implemented algorithm replaces the exact ingredients of Algorithm 2 with MLP metamodels: ψD(d1,a2,θ1) in Section 4.1, pD(a2|d1,a1) and ΨA(d1,a1) in Section 4.2, and subsequently pD(a1) in Section 5.2.3. Proposition 5, however, states optimality for Algorithm 2 under exact distributions and utilities. The paper does not provide any error propagation, consistency, or approximation bound for the MLP-based scheme, nor does it state conditions under which the approximate d*1 approaches the exact ARA solution. This gap is load-bearing because the case study's final recommendation d*1 = 0.7 is computed entirely through the approximate pipeline. The authors should either prove a convergence or error bound under explicit metamodel accuracy assumptions, or clearly restrict the theoretical optimality claim to the exact version and present the MLP scheme as a heuristic with empirical validation.
minor comments (5)
- [§3.1 (DAPS1)] The notation 'mode(π(d1|a2,θ1))' appears to be a typo; the intended quantity is the mode of π(d2|d1,a2,θ1). This typo is not merely cosmetic because it obscures the conditioning set required for the conditional argmax.
- [Algorithm 1c] In the AAPS loop, the MH call is written as MH(gD, uD, ...) but should be MH(gA, uA, ...), since the proposal and utility are the attacker's.
- [§5.2.1] The text says 'J = 9621 = 213' values for the grid (d1,a2,θ1). With splits of 0.05 on [0,1], the correct count is 21^3 = 9261. The number 9621 appears to be a typo.
- [§5.2.4 and SM2.2] The reported optimal first-stage defense d*1 = 0.7 coincides exactly with the mean µd1 = 0.7 used to center the attacker's assessed distribution PA(D1) in the supplementary materials. Since the output is partly inherited from this input prior, the case study would be more convincing if the sensitivity of d*1 to µd1 were reported.
- [§4.3] The term 'DP P' in the sentence 'the last decision node Di in DP P' is a typo for 'DDP'.
Circularity Check
The single-stage APS mode identities are not circular, but the general BAID reduction as written conditions on the wrong information set, so the claimed conditional policy is, by construction, a d1-averaged decision; Proposition 5 inherits this gap.
-
self definitional
[Section 3.1, DAPS1]
"DAPS1. Aggregate steps D1-D2, corresponding to d∗2(d1,a2,θ1)=arg maxd2 ∫ uD(d1,d2,θ2)pD(θ2|d2,a2,θ1) dθ2. For this, define the AD π(d1,d2,θ2|a2,θ1) ∝ uD(d1,d2,θ2)pD(θ2|d2,a2,θ1). By sampling from this distribution and consistently estimating mode(π(d1|a2,θ1)), we approximate d∗2(d1,a2,θ1)."
The augmented distribution is conditioned on (a2,θ1) only, not on d1. Its marginal in d2 integrates uD·pD over θ2 and d1, so its mode is argmax_{d2} ∫ ψD(d1,d2,a2,θ1) dd1, the d1-averaged second-stage optimum, not the pointwise policy d*2(d1,a2,θ1). If the text instead means the mode over d1, that maximizes a d2-averaged function of d1 and is not a conditional policy at all. Either way, the written AD removes the conditioning on d1 that would make its mode equal the claimed policy; Section 5.2.1 silently restores this conditioning by invoking DAPS1 on a grid of (d1,a2,θ1) values.
-
self definitional
[Appendix A, proof of Proposition 3; SM1, proof of Proposition 4]
"Consider the AD π(d, x1, . . . , xnD |ant(Xc(D))) ∝ ψD(y) ∏_{Xi∈Xc(D)} pD(xi|ant(Xi)). If all nodes participating in arc inversions are eliminated, then d∗(y′) = mode(π(d|ant(Xc(D))))"
The general reduction conditions the AD on ant(Xc(D)) and asserts the mode equals d*(y′), where y′ = (y \ (Xc(D) ∪ D)) ∪ ant(Xc(D)). But y′ can contain utility antecessors not in ant(Xc(D)): in DAPS1, y={d1,d2,a2,θ1}, Xc(D)={Θ2}, ant(Θ2)={d2,a2,θ1}, so y′ contains d1 while the AD conditions only on {a2,θ1}. The marginal mode over d then integrates over d1, yielding an averaged optimum rather than the pointwise policy. The proof's assertion that the conditional marginal is proportional to the expected utility holds only after conditioning on all of y′; the written construction defines a different functional. Proposition 4 and its SM proof repeat the same conditioning error for the attacker.
1 more flagged steps
-
other
[Appendix A, proof of Proposition 5]
"Then, reduce the corresponding Di from the DDP, with the same optimality preserving features. As both the DDP and the ADP are finite, the algorithm necessarily terminates providing the required output as deduced from Propositions 3 and 4."
Proposition 5's optimality conclusion is deduced entirely from Propositions 3 and 4, and those propositions' mode identities fail for conditional policies whenever the policy's information set includes variables outside ant(Xc(·)). The central claim that Algorithm 2 provides the Defender's optimal policy therefore rests on identifying the policy with a mode that the written augmented distributions compute only after averaging out the policy's conditioning variables. This is a construction-level mismatch in the derivation chain, not an external benchmark or independent verification.
full rationale
The core single-stage machinery is not circular: πD(d,a,θ) ∝ uD(d,θ)pD(θ|d,a)pD(a) has marginal proportional to ψD(d), and the random-attacker analogue has marginal mode equal to the random optimal attack; these are mathematical identities that assume no target result. The case-study agreement d*1=0.7 with the prior mean µd1=0.7 is suggestive but no equation forces that equality, so I do not score it as formal circularity. The circularity lies in the general BAID extension: DAPS1 and Propositions 3-4 define augmented distributions conditioned on ant(Xc(·)) rather than on the full information set y′, so the mode they define is, by construction, an averaged decision rather than the claimed conditional policy d*(y′). Proposition 5 inherits this gap, making the paper's central 'first general solution' claim rest on a self-definitional identification. Since the single-stage identities are sound and the case-study implementation de facto conditions on the grid points, thereby correcting the written construction, the paper is partially circular rather than wholly forced; score 6.
Assumptions & free parameters
free parameters (5)
- mu_d1 (prior mean for PA(D1)) =
0.7
- omega_d2 =
0.9
- td, ta =
td=1, ta=1.2
- gamma_D, gamma_A =
2616, 1280
- augmentation parameter h per stage =
40, 80, 120, 20
assumptions (6)
- domain assumption Defender and attacker utilities are positive (a.s. for random utilities).
- domain assumption Decision sets are compact and distributions continuous and positive; proposal distributions have full support.
- domain assumption The game is a proper BAID with acyclic directed graph and directed decision paths (DDP, ADP).
- domain assumption Level-2 thinking: attacker maximizes expected utility while modeling the defender as non-strategic.
- ad hoc to paper Metamodel approximations (MLPs) are sufficiently accurate to preserve the mode of the augmented distribution.
- standard math Consistent mode estimators and MH convergence (Smith & Roberts 1993; Chacon 2020).
Cite this review
Pith. "Pith review of Computational adversarial risk analysis for general security games." pith.science (2026). https://pith.science/paper/MYLC24U6
@misc{pith2026250602603,
author = {Pith},
title = {Pith review of: Computational adversarial risk analysis for general security games},
year = {2026},
howpublished = {\url{https://pith.science/paper/MYLC24U6}},
note = {Machine review of arXiv:2506.02603}
}
read the original abstract
This paper provides an efficient computational scheme to handle general security games from an adversarial risk analysis perspective. Two cases in relation to single-stage and multi-stage simultaneous defend-attack games motivate our approach to general setups which uses bi-agent influence diagrams as underlying problem structure and augmented probability simulation as core computational methodology. Theoretical convergence and numerical, modeling, and implementation issues are thoroughly discussed. A disinformation war case study illustrates the relevance of the proposed approach.
Figures
Figures from the paper (9 more)
Reference graph
Works this paper leans on
- [1]
-
[2]
Antenore, M., Camacho, J. M., & Panizzi, E. (2023). A comparative study of bot detection techniques with an application in Twitter Covid-19 discourse . Soc. Sci. Comp. Rev. , 41(5), :1520--1545
work page 2023
-
[3]
Antos, D. & Pfeffer, A. (2010). Representing Bayesian games without a common prior. Proc. 9th Int. Conf. Auton. Agents & Multiagent Syst. , 1457--1458
work page 2010
-
[4]
Banks, D., Gallego, V., Naveiro, R., & Insua, D. R. (2022). A dversarial risk analysis: A n overview. Wiley Interdisc. Rev.: Comput. Stat. , 14(1) :, Article e1530
work page 2022
-
[5]
Banks, D., Rios, J., & Insua, D. R. (2015). Adversarial Risk Analysis . CRC Press
work page 2015
-
[6]
Barman, D., Guo, Z., & Conlan, O. (2024). The Dark Side of Language Models: Exploring the Potential of LLMs in Multimedia Disinformation Generation and Dissemination . Mach. Learn. Appl. , 16, Article 100545
work page 2024
-
[7]
Bielza, C., M \"u ller, P., & Insua, D. R. (1999). Decision analysis by augmented probability simulation. Manag. Sci. , 45(7), :995--1007
work page 1999
-
[8]
Bishop, C. M. (2006). Pattern recognition and machine learning . Springer
work page 2006
Show all 42 references
-
[9]
Brown, G., Carlyle, M., Salmer \'o n, J., & Wood, K. (2006). Defending critical infrastructure. Interfaces , 36(6) :, 530--544
2006
-
[10]
Chacon, J. (2020). The modal age of statistics. Int. Stat. Rev. , 88(1) :, 122--141
2020
-
[11]
Chung, K. L. (2001). A Course in Probability Theory . Academic Press
2001
-
[12]
R., & Torres-Barr \'a n, A
Ekin, T., Naveiro, R., Insua, D. R., & Torres-Barr \'a n, A. (2023). Augmented probability simulation methods for sequential games. Eur. J. Oper. Res , 306(1) :, 418--430
2023
-
[13]
& Insua, D
French, S. & Insua, D. R. (2000). Statistical Decision Theory . Wiley
2000
-
[14]
& Insua, D
Gallego, V. & Insua, D. R. (2022). Current advances in neural networks. Ann. Rev. Stat. & Appl. , 9 :, 197--222
2022
-
[15]
Gallego, V., Naveiro, R., & Insua, D. R. (2019). Reinforcement learning under threats. Proc. AAAI Conf. Artif. Intell. , 33(01) :, 9939--9940
2019
-
[16]
& Parra-Arnau, J
Gil, C. & Parra-Arnau, J. (2019). An A dversarial- R isk- A nalysis A pproach to C ounterterrorist O nline S urveillance. Sens. , 19(3), :Article 480
2019
-
[17]
R., & Cano, J
Gonz \'a lez-Ortega, J., Insua, D. R., & Cano, J. (2019). Adversarial risk analysis for bi-agent influence diagrams: An algorithmic approach. Eur. J. Oper. Res , 273(3) :, 1085--1096
2019
-
[18]
& Varoufakis, Y
Hargreaves-Heap, S. & Varoufakis, Y. (2004). Game Theory: a Critical Introduction . Routledge
2004
-
[19]
B ayesian
Harsanyi, J. C. (1967). Games with incomplete information played by “ B ayesian” players, I -- III P art I . The basic model . Manag. Sci. , 14(3) :, 159--182
1967
-
[20]
Hausken, K. (2024). Fifty Years of Operations Research in Defense . Eur.J.Oper.Res. , 318 :, 355--368
2024
-
[21]
R., Couce-Vieira, A., Rubio, J
Insua, D. R., Couce-Vieira, A., Rubio, J. A., Pieters, W., Labunets, K., & G. Rasines, D. (2019). An adversarial risk analysis framework for cybersecurity. Risk Anal. , 41(1) :, 16--36
2019
-
[22]
R., Naveiro, R., Gallego, V., & Poulos, J
Insua, D. R., Naveiro, R., Gallego, V., & Poulos, J. (2023). Adversarial machine learning: Bayesian perspectives. J. Am. Stat. Assoc. , 118(543) :, 2195--2206
2023
-
[23]
R., R \' os, J., & Banks, D
Insua, D. R., R \' os, J., & Banks, D. (2009). Adversarial risk analysis. J. Am. Stat. Assoc. , 104(486) :, 841--854
2009
-
[24]
Kadane, J. B. & Larkey, P. D. (1982). Subjective probability and the theory of games. Manag. Sci. , 28(2) :, 113--120
1982
-
[25]
Keeney, R. (2007). Modeling values for anti-terrorism analysis. Risk Anal. , 27(3):585--596
2007
-
[26]
& Milch, B
Koller, D. & Milch, B. (2003). Multi-agent influence diagrams for representing and solving games. Games & Econ. Behav. , 45(1) :, 181--221
2003
-
[27]
M., Kelton, W
Law, A. M., Kelton, W. D., & Kelton, W. D. (2007). Simulation modeling and analysis. 3rd Ed. McGraw-Hill
2007
-
[28]
M \"u ller, P., Sans \'o , B., & De Iorio, M. (2004). Optimal Bayesian design by inhomogeneous Markov chain simulation . J. Am. Stat. Assoc. , 99(467) :, 788--798
2004
-
[29]
Raiffa, H., Richardson, J., & Metcalfe, D. (2002). Negotiation Analysis: The Science and Art of Collaborative Decision Making . Harvard University Press
2002
-
[30]
& Insua, D
Rios, J. & Insua, D. R. (2012). Adversarial risk analysis for counterterrorism modeling. Risk Anal. , 32(5) :, 894--915
2012
-
[31]
& Salo, A
Roponen, J. & Salo, A. (2015). Adversarial risk analysis for enhancing combat simulation models. J. Mil. Stud. , 6(2) :, 82--103
2015
-
[32]
S \'a kovics, J. (2001). Games of incomplete information without common knowledge priors. Theory & Decis. , 50 :, 347--366
2001
-
[33]
C., Insua, D., & Rios, J
Sevillano, J. C., Insua, D., & Rios, J. (2012). Adversarial Risk Analysis: The Somali Pirates Case . Decis. Anal. , 9(2) :, 86--95
2012
-
[34]
Shachter, R. D. (1986). Evaluating influence diagrams. Oper. Res. , 34(6) :, 871--882
1986
-
[35]
Smith, A. F. & Roberts, G. O. (1993). Bayesian computation via the G ibbs sampler and related M arkov chain M onte C arlo methods. J. Royal Stat. Soc.: Ser. B (Method.) , 55(1) :, 3--23
1993
-
[36]
Stahl, D. O. & Wilson, P. W. (1995). On players' models of other players: Theory and experimental evidence. Games & Econ. Behav. , 10(1) :, 218--254
1995
-
[37]
Virtanen, K., Karelahti, J., & Raivio, T. (2006). Modeling air combat by a moving horizon influence diagram game. J. Guid., Control, & Dyn. , 29(5) :, 1080--1091
2006
-
[38]
& Banks, D
Wang, S. & Banks, D. (2011). Network routing for insurgency: An adversarial risk analysis framework. Nav. Res. Logist. , 58(6) :, 595--607
2011
-
[39]
The Global Risks Report 2024
World Economic Forum (2024). The Global Risks Report 2024. Insights Report . World Econ. Forum
2024
-
[40]
The Global Risks Report 2025
World Economic Forum (2025). The Global Risks Report 2025. Insights Report . World Econ. Forum
2025
-
[41]
& Bier, V
Zhuang, J. & Bier, V. M. (2007). Balancing terrorism and natural disasters—Defensive strategy with endogenous attacker effort . Oper. Res. , 55(5) :, 976--991
2007
-
[42]
write newline
" write newline "" before.all 'output.state := FUNCTION fin.entry add.period write newline FUNCTION new.block output.state before.all = 'skip after.block 'output.state := if FUNCTION new.sentence output.state after.block = 'skip output.state before.all = 'skip after.sentence '...
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.