Pith. sign in

REVIEW 4 major objections 6 minor 22 references

There's Waldo: PCB Tamper Forensic Analysis using Explainable AI on Impedance Signatures

T0 review · 4 major / 6 minor · reviewed 2026-08-07 · deepseek-v4-flash

Pith's one-line read This paper claims that a random forest trained on the reflection signature of a PCB's power delivery network can detect tampering, name the modified component, and identify which parasitic characteristic changed, with 96.7% accuracy and…

desk verdict A credible simulation-only proof of concept for component-level tamper classification, undermined by an unimplemented DTW alignment and no measured-board validation. read the letter →

arxiv 2506.05734 v1 pith:CPEY5PC4 submitted 2025-06-06 cs.CR

classification cs.CR
keywords PCBtamperforensicspowerdeliverynetworkS-parametersrandomforestclassifierSHAPexplainabilityimpedancesignaturehardwaredetection
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper asks whether the two-dimensional impedance signature of a PCB's power delivery network can be reverse-engineered for forensics, not just detection. It answers that a random forest classifier trained on simulated |S11| traces can distinguish eleven classes—genuine boards and ten tamper types defined by which component and which parasitic parameter (ESL, ESR, or parasitic capacitance) was altered—at 96.7% accuracy. SHAP values then show which frequency points drive each decision, and those frequencies align with the physical resonance behavior of the affected components. If the simulation-to-measurement transfer holds, a verifier could pinpoint the compromised component from a single non-invasive measurement, avoiding costly visual inspection.

What carries the argument

The central object is the $|S_{11}|$ reflection coefficient of the PDN, sampled at 5,000 frequency points from 1 MHz to 1 GHz, related to port impedance by $Z_{\mathrm{DUT}} = Z_0(1+S_{11})/(1-S_{11})$. The argument is carried by a random forest classifier (11 classes, 5-fold cross-validation, per-fold accuracy from 96.33% to 96.83%) whose decisions are explained by TreeSHAP additive per-frequency contributions. The physical mechanism that makes the classification interpretable is that each component class moves a characteristic resonance: capacitance and ESL shifts move resonance frequencies, ESR and resistance change amplitudes, and the most influential SHAP features line up with these resonances. The paper avoids PCA because its transformed features cannot be mapped back to individual frequencies, which would destroy the explainability needed for forensics.

What would settle it

Measure |S11| from 1 MHz to 1 GHz on a physical PCB with a vector network analyzer, apply a known tamper (for example, replace a capacitor or add series inductance), remeasure, and run the trained random forest; if the predicted tamper class does not match the actual change with accuracy comparable to 96.7%, the simulation-to-measurement transfer fails.

Watch

Extended reading notes

Core claim

The central discovery is that a |S11| magnitude trace measured at the PDN port carries enough information to localize a tamper event to a specific component. The paper's dataset models manufacturing variation by perturbing component values and parasitics, then simulates ten tamper classes: each is a specific capacitor or resistor whose value was multiplied by 10, 100, or 1000 and whose parasitic inductance, series resistance, or parasitic capacitance was varied by 20%. A random forest trained on these traces reaches 96.7% accuracy, and the SHAP explanation identifies the frequency components that matter for each class—for example, the fundamental resonance near 470 MHz and local resonances near 395, 662, and 712 MHz that correspond to specific capacitor families. The conclusion draws the forensic claim: accurate classification of different tamper types and precise localization of tamper events from the signature alone.

Load-bearing premise

The load-bearing premise is that simulated |S11| traces faithfully represent physically tampered boards, since the 96.7% accuracy and every SHAP explanation are produced and tested entirely within simulation, and the proposed alignment of measured to simulated signatures is never implemented or validated.

Editorial extensions

If this is right

  • A verifier can distinguish a genuine board from boards with one of ten tamper types, and for each tamper type can name both the component (which capacitor or resistor) and the parasitic characteristic that was changed.
  • The SHAP-identified frequency points give a physical fingerprint: influential frequencies cluster at the fundamental resonance and at component-specific local resonances, so the explanation is a checkable electromagnetic prediction rather than a black-box artifact.
  • Unknown modifications not present in training can still be flagged as non-genuine, although the model cannot name the exact change.
  • Because the method labels the tamper type, it reduces the need for time-consuming manual visual inspection to find the modified component.
  • The same training pipeline is claimed to apply to component insertion or removal, not only replacement.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Beyond the paper: the SHAP frequency attributions could be inverted into a physical tamper diagnosis—a shift in resonance frequency suggests an inductance or capacitance change, while an amplitude change at low frequency suggests a resistance change—turning the classifier into an automated failure-analysis tool.
  • The reported 96.7% accuracy is an upper bound on real-world performance: training and testing both draw from the same simulation campaign, so the decisive next test is measured |S11| traces from physically tampered boards.
  • If the dynamic time warping alignment step described in the threat model is implemented and validated, the approach could work against a golden-free measured baseline, making it practical for boards whose design files are unavailable.
  • The same random-forest-plus-SHAP recipe could transfer to chip-level PDN impedance sensing, where on-chip impedance measurement already exists, if simulated chip signatures generalize to silicon.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 6 minor

Summary. The paper presents a simulation-based study of PCB tamper forensics using |S11| impedance signatures of a power delivery network. The authors generate a dataset in Ansys SIwave by perturbing component values and parasitics for one PCB design, train a random forest classifier with five-fold cross-validation (96.7% accuracy) to distinguish one genuine class and ten tamper classes defined by component part number and modified parasitic, and use SHAP values to identify which frequency features drive each class decision. The paper claims that this enables reverse-engineering of impedance signatures to determine which component has been compromised and to localize tamper events.

Significance. The core idea is timely and potentially useful: if a classifier trained on simulated signatures transferred to measurements, non-invasive forensic triage would be possible without physical golden or tampered samples. The paper's strengths are a clearly described threat model, a nontrivial simulation setup (242-component PCB, 5000 frequency points), explicit modeling of manufacturing variation, and the use of SHAP to provide per-class frequency attributions. The main weakness is that the entire empirical pipeline is simulation-only; the DTW alignment that is supposed to connect simulated signatures to measured ones (Section III-A) is never implemented, and no measured traces are reported. Consequently, the headline accuracy and the SHAP explanations currently describe the simulator's response to synthetic parameter perturbations, not the response of a physical PCB to tampering. The 'localization' claim is also stronger than the class labels support.

major comments (4)
  1. [Section III-A and Section V] The threat model describes a DTW-based alignment of measured golden signatures to simulated signatures before training, but this step is never implemented or validated; no measured |S11| trace appears anywhere in the paper. As a result, the 96.7% accuracy in Table II and the SHAP attributions in Table III and Fig. 4 cannot be taken as evidence about real tamper forensics, and the claims in Section IV-B and Section VI that the method identifies compromised components and localizes tamper events are unsupported. Please add experimental validation on at least one physical PCB (golden and tampered), including the DTW alignment, or explicitly reposition the paper as a simulation feasibility study.
  2. [Section IV-B, Table I, and Section VI] The class labels are keyed to component part numbers and parasitic types, not to physical instances. The 1V8 PDN contains multiple instances of C0402-CAP-ASM-1 (and likely other part numbers), so a prediction of, say, class 1 indicates that some C0402-CAP-ASM-1 has an altered ESL, not which specific capacitor on the board was tampered. The conclusion's phrase 'precise localization of tamper events' is therefore an overstatement. Either add instance-level classes or at least acknowledge that localization is limited to component type, and revise the claims accordingly.
  3. [Section V-C and Table II] The paper reports no comparison with simpler baselines. On a synthetic dataset generated by perturbing known parameters, a k-nearest-neighbor classifier on the raw spectra, a logistic regression on selected resonance frequencies, or an SVM may achieve comparable accuracy, which would undermine the claim that the RF/SHAP combination is necessary for forensic analysis. Please add baseline comparisons and, for the XAI component, a quantitative comparison of SHAP attributions against ground-truth physical parameter changes, for example by simulating single-component perturbations and measuring feature importance.
  4. [Section IV-B] The choice of ±10% (genuine) and ±20% (tampered) parasitic variations, and the use of 10x, 100x, and 1000x component multipliers, are ad hoc, and no sensitivity analysis is reported. The separability of the classes and hence the 96.7% accuracy may be an artifact of these ranges. Please report results for varied variation magnitudes and noise levels.
minor comments (6)
  1. [Abstract and Section III-A] The manuscript contains typographical errors such as 'the classifier In' in the abstract and 'treat model' in Section III-A; please proofread the text.
  2. [Table I] The genuine class 0 is shown in five rows with the same class ID; clarify that all genuine variants collapse into a single label, and specify how many physical instances of each part number exist on the PDN.
  3. [Section V-D] The SHAP analysis uses 50 background samples, but the choice is justified only by a statement that 100 and 200 gave 'the same' results; report a quantitative comparison, such as feature rank correlation, to support this claim.
  4. [Section III-B] The claim that random forests 'provide interpretability' is imprecise; random forests are not directly interpretable, and the paper relies on SHAP for explanation. Please rephrase.
  5. [Figure 3] The two subfigures are referenced but the axes are not described in the caption; add axis labels and a legend so the claimed resonance shifts are visible.
  6. [References] Reference [6] is cited as a 2024 IPFA paper; if it is a preprint or has been published in the meantime, update the citation with the full bibliographic details.

Circularity Check

0 steps flagged · score 1.0 of 10

No significant circularity: the RF/SHAP pipeline is an internal supervised benchmark on simulated |S11| traces; the unvalidated simulation-to-measurement transfer is an external-validity gap, not a derivation reduction.

full rationale

The claimed derivation chain is: simulate tamper scenarios in Ansys SIwave, label traces by component part number and parasitic modification (Table I), train a random forest on these traces, and compute SHAP values to attribute classifications to frequency features. No step exhibits a constructional equivalence between an input and a predicted output: the classifier is not fitted to a target result and then renamed as a prediction; the SHAP values are, by definition, explanations of the trained model, which is the intended use of XAI rather than a circular derivation of physical cause. The statement 'By detecting each class, we can determine what has occurred on the PCB and identify which component has been compromised' (Section IV-B) simply maps classifier outputs back to the class labels that were defined by the simulation scenarios; this is benchmark semantics, not a logically forced reduction. The principal weakness is the unvalidated DTW alignment described in the threat model (Section III-A), which would connect simulated signatures to measured VNA data but is never implemented or evaluated, so the 96.7% accuracy (Table II) and SHAP attributions may not transfer to physical PCBs. That is a domain-shift or external-validity concern, not a circularity. Existing self-citations (e.g., [5], [6]) support background claims about impedance-based tamper detection and DTW-based golden-free verification, but none is load-bearing for the central RF/SHAP result, and no uniqueness theorem is invoked to forbid alternative methods. The paper therefore does not derive its predictions from its own definitions, and the score is low.

Assumptions & free parameters 4 free parameters · 3 assumptions · 0 invented entities

The central claim rests on hand-chosen simulation parameters (variation ranges and tamper multipliers) and on the domain assumption that simulated S11 traces represent physical tampering. No new physical entities are introduced. The load-bearing transferability from simulation to measurement is assumed, not validated.

free parameters (4)
  • Genuine variation range = ±10% of component values and parasitics
    Section IV-B: hand chosen to model manufacturing process variations; the simulated genuine class spread depends on these values.
  • Tampered parasitic variation range = ±20% of parasitics
    Section IV-B: hand chosen for all tampered classes; affects separation between classes.
  • Tamper magnitude multipliers = 10, 100, and 1000 times original value
    Section IV-B and Table I: hand chosen multipliers applied to capacitor values and resistor values; classification is over these discrete levels.
  • SHAP background sample count = 50 per class
    Section V-D: default TreeSHAP sample size; authors state 100 and 200 gave identical results, so not load-bearing.
assumptions (3)
  • domain assumption Any tampering with a PCB or IC package changes the equivalent impedance of the power delivery network.
    Background and Section III-A; this is the physical premise inherited from cited prior work [1]-[5].
  • domain assumption Ansys SIwave/HFSS simulations accurately reproduce the |S11| signatures of the physical PCB.
    Section IV-A; the full training and test pipeline uses simulated traces, with no comparison to measured traces.
  • ad hoc to paper The ten tamper classes (component and parasitic type) cover the tamper events of forensic interest.
    Section IV-B and Table I; classes are defined by the authors and exclude insertion, removal, and value changes outside the chosen multipliers; the paper admits unknown classes cannot be localized.

how reviews work

0 comments
Cite this review

Pith. "Pith review of There's Waldo: PCB Tamper Forensic Analysis using Explainable AI on Impedance Signatures." pith.science (2026). https://pith.science/paper/CPEY5PC4

@misc{pith2026250605734,
  author       = {Pith},
  title        = {Pith review of: There's Waldo: PCB Tamper Forensic Analysis using Explainable AI on Impedance Signatures},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/CPEY5PC4}},
  note         = {Machine review of arXiv:2506.05734}
}
read the original abstract

The security of printed circuit boards (PCBs) has become increasingly vital as supply chain vulnerabilities, including tampering, present significant risks to electronic systems. While detecting tampering on a PCB is the first step for verification, forensics is also needed to identify the modified component. One non-invasive and reliable PCB tamper detection technique with global coverage is the impedance characterization of a PCB's power delivery network (PDN). However, it is an open question whether one can use the two-dimensional impedance signatures for forensics purposes. In this work, we introduce a novel PCB forensics approach using explainable AI (XAI) on impedance signatures. Through extensive experiments, we replicate various PCB tamper events, generating a dataset used to develop an XAI algorithm capable of not only detecting tampering but also explaining why the algorithm makes a decision about whether a tamper event has happened. At the core of our XAI algorithm is a random forest classifier with an accuracy of 96.7%, sufficient to explain the algorithm's decisions. To understand the behavior of the classifier in the decision-making process, we utilized SHAP values as an XAI tool to determine which frequency component influences the classifier's decision for a particular class the most. This approach enhances detection capabilities as well as advancing the verifier's ability to reverse-engineer and analyze two-dimensional impedance signatures for forensics.

Figures

Figures reproduced from arXiv: 2506.05734 by the authors.

Figure 1
Figure 1. Hardware signature extraction using S-parameters. [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 2
Figure 2. (a) Simulated design file of the PCB under test in [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 3
Figure 3. (a) S-parameter traces corresponding to C0603-CAP-ASM-T-ESL class. (b) S-parameter traces corresponding to C0805-CAP-ASM-T-ESL class. process. In contrast, the C0603-CAP-ASM, despite having the same capacitance values, influences frequencies higher than the fundamental resonance frequency, due to its smaller physical dimensions compared to the C0805-CAP-ASM capacitors as shown in [PITH_FULL_IMAGE:figures/full_fig_p… view at source ↗
Figures from the paper (1 more)
Figure 4
Figure 4. Figure 4: SHAP values: Each dot represents a sample, with its position on the x-axis indicating the impact of a particular signature [PITH_FULL_IMAGE:figures/full_fig_p006_4.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

22 extracted references · 21 canonical work pages

  1. [1]

    Scatterverif: Verification of electronic boards using reflection response of power distribution network,

    T. Mosavirik, F. Ganji, P. Schaumont, and S. Tajik, “Scatterverif: Verification of electronic boards using reflection response of power distribution network,”ACM Journal on Emerging Technologies in Computing Systems (JETC), vol. 18, no. 4, pp. 1–24, 2022

  2. [2]

    Detection of recycled ICs using backscattering side-channel analysis,

    F. T. Werner, M. Prvulovic, and A. Zaji ´c, “Detection of recycled ICs using backscattering side-channel analysis,”IEEE Transactions on Very Large Scale Integration (VLSI) Systems, vol. 30, no. 9, pp. 1244–1255, 2022

  3. [3]

    PDNpulse: Sensing PCB anomaly with the intrinsic power delivery network,

    H. Zhu, H. Shan, D. Sullivan, X. Guo, Y . Jin, and X. Zhang, “PDNpulse: Sensing PCB anomaly with the intrinsic power delivery network,” IEEE Transactions on Information Forensics and Security, vol. 18, pp. 3590–3605, 2023

  4. [4]

    Counterfeit chip detection using scattering parameter analysis,

    M. S. Safa, T. Mosavirik, and S. Tajik, “Counterfeit chip detection using scattering parameter analysis,” in2023 26th International Symposium on Design and Diagnostics of Electronic Circuits and Systems (DDECS), IEEE, 2023

  5. [5]

    Impedanceverif: On-chip impedance sensing for system-level tampering detection,

    T. Mosavirik, P. Schaumont, and S. Tajik, “Impedanceverif: On-chip impedance sensing for system-level tampering detection,”IACR Transactions on Cryptographic Hardware and Embedded Systems, pp. 301–325, 2023

  6. [6]

    Parasitic circus: On the feasibility of golden free pcb verification,

    M. Saadat Safa, P. Schaumont, and S. Tajik, “Parasitic circus: On the feasibility of golden free pcb verification,”IEEE International Symposium on the Physical and Failure Analysis of Integrated Circuits (IPFA), 2024

  7. [7]

    James, D

    G. James, D. Witten, T. Hastie, R. Tibshirani,et al.,An introduction to statistical learning, vol. 112. Springer, 2013

  8. [8]

    The elements of statistical learning: Data mining, inference, and prediction,

    T. Hastie, “The elements of statistical learning: Data mining, inference, and prediction,” 2009

Show all 22 references
  1. [9]

    Murphy,Machine Learning: a probabilistic perspective

    K. Murphy,Machine Learning: a probabilistic perspective. MIT press, 2012

  2. [10]

    Random forests,

    L. Breiman, “Random forests,”Machine learning, vol. 45, pp. 5–32, 2001

  3. [11]

    Classification and regression by randomforest,

    A. Liaw, M. Wiener,et al., “Classification and regression by randomforest,”R news, vol. 2, no. 3, pp. 18–22, 2002

  4. [12]

    Support-vector networks,

    C. Cortes, “Support-vector networks,”Machine Learning, 1995

  5. [13]

    Hyperparameters and tuning strategies for random forest,

    P. Probst, M. N. Wright, and A.-L. Boulesteix, “Hyperparameters and tuning strategies for random forest,”Wiley Interdisciplinary Reviews: data mining and knowledge discovery, vol. 9, no. 3, p. e1301, 2019

  6. [14]

    Feature selection with ensembles, artificial variables, and redundancy elimination,

    E. Tuv, A. Borisov, G. Runger, and K. Torkkola, “Feature selection with ensembles, artificial variables, and redundancy elimination,”The Journal of Machine Learning Research, vol. 10, pp. 1341–1366, 2009

  7. [15]

    Molnar,Interpretable Machine Learning: A Guide for Making Black Box Models Explainable

    C. Molnar,Interpretable Machine Learning: A Guide for Making Black Box Models Explainable. Leanpub, 2022. Available at https://christophm. github.io/interpretable-ml-book/shap.html

  8. [16]

    “why should i trust you?

    M. T. Ribeiro, S. Singh, and C. Guestrin, ““why should i trust you?”: Explaining the predictions of any classifier,” inProceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1135–1144, ACM, 2016

  9. [17]

    A unified approach to interpreting model predictions,

    S. M. Lundberg and S.-I. Lee, “A unified approach to interpreting model predictions,” inProceedings of the 31st International Conference on Neural Information Processing Systems (NIPS), pp. 4765–4774, 2017

  10. [18]

    ANSYS SIwave 2023 R2

    ANSYS, Inc., “ANSYS SIwave 2023 R2.” http://www.ansys.com, 2023

  11. [19]

    PCB manufacturing variation impact on high frequency measurement fixtures,

    E. Fledell and B. Grossman, “PCB manufacturing variation impact on high frequency measurement fixtures,” in2010 76th ARFTG Microwave Measurement Conference, pp. 1–6, IEEE, 2010

  12. [20]

    CIPA: Concurrent IC and PCB authentication using on-chip ring oscillator array,

    Y . Han, X. Wang, and M. Tehranipoor, “CIPA: Concurrent IC and PCB authentication using on-chip ring oscillator array,” in2018 IEEE 27th Asian Test Symposium (ATS), pp. 109–114, IEEE, 2018

  13. [21]

    An introduction to explainable AI with Shapley values

    Scott Lundberg, “An introduction to explainable AI with Shapley values.” [Online]https://shap.readthedocs.io/en/latest/overviews.html[Accessed Sep.22, 2024]

  14. [22]

    Silicon echoes: Non-invasive trojan and tamper detection using frequency-selective impedance analysis,

    T. Mosavirik, S. K. Monfared, M. S. Safa, and S. Tajik, “Silicon echoes: Non-invasive trojan and tamper detection using frequency-selective impedance analysis,”IACR Transactions on Cryptographic Hardware and Embedded Systems, vol. 2023, no. 4, pp. 238–261, 2023

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.