REVIEW 4 major objections 6 minor 20 references
Interplay-robust optimization for treating irregularly breathing lung patients with pencil beam scanning
T0 review · 4 major / 6 minor · reviewed 2026-08-12 · deepseek-v4-flash
Pith's one-line read This paper shows that explicitly modeling the time-dependent interference between pencil beam delivery and irregular breathing during plan optimization raises near-worst-case target coverage in lung proton therapy and, at equal coverage…
desk verdict A transparent simulation study extending IPRO to amplitude-irregular breathing; the advantage over 4DRO holds within the matched-distribution setup, but external motion variability remains untested. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the 4D dose computation (4DDC) with phase sorting: each pencil beam spot's dose is computed on the motion state it hits during delivery, deformed to a reference state, and summed. Interplay-robust optimization minimizes a worst-case objective over a set of motion scenarios, each a random concatenation of breathing cycles; the delivery time structure is updated heuristically as spot weights change. IPRO-1C builds its scenario set from one breathing cycle, varied by period-scaling factors and start-phase shifts, to test how much robustness can be recovered when data are limited.
What would settle it
Simulate delivery of the IPRO and 4DRO plans using evaluation scenarios drawn from a breathing distribution with, say, 30% larger amplitudes and a uniformly random start phase per beam, and check whether the 5th-percentile CTV D98 of IPRO still exceeds 4DRO; if the margin vanishes or reverses, the claim fails for unrepresented motion states.
Extended reading notes
Core claim
The authors claim that explicitly modeling the interplay effect, the time-dependent interference between pencil beam spot delivery and breathing motion, during robust optimization produces lung cancer proton plans that are more robust to irregular breathing than plans from phase-averaged 4D robust optimization. Using synthetic 4DCTs with multiple breathing cycles of varying period and amplitude, they show that IPRO, which optimizes against randomly concatenated breathing cycles, and IPRO-1C, which generates scenarios from a single breathing cycle with scaled periods and shifted start phases, both increase the 5th-percentile CTV D98 relative to 4DRO in all four patient cases. After normalizing each plan to match the 4DRO near-worst-case target coverage, the robustly optimized plans spare organs at risk more: IPRO with 49 scenarios reduces the 95th-percentile OAR dose by an average of 4.2%, and IPRO-1C with 9 scenarios by 1.7% while requiring no more dose computations than 4DRO.
Load-bearing premise
The evaluation scenarios are built from the same synthetic motion model and cycle statistics as the optimization scenarios, with every breathing cycle assumed to start at end-exhale; if a patient's real on-couch breathing differs in amplitude, period, or start phase, the reported robustness gain shrinks or disappears.
Editorial extensions
If this is right
- IPRO and IPRO-1C raise the 5th-percentile CTV D98 relative to 4DRO in every patient case studied, with little change to dose homogeneity.
- After normalizing to equal target coverage, IPRO with 49 scenarios reduces the near-worst-case (95th percentile) OAR dose by an average of 4.2%, and IPRO-1C with 9 scenarios by 1.7%.
- Increasing the scenario count from 9 to 49 typically improves robustness, and using multiple breathing cycles outperforms a single cycle when that single cycle is unrepresentative of the evaluation motion.
- IPRO-1C with 9 scenarios uses the same number of motion states and dose computations as 4DRO, so the robustness gain comes at no added computational cost.
Reading between the lines
- If the same margin persists under randomized start phases and day-to-day amplitude drift, IPRO could allow fewer re-scans or wider gating windows, shortening treatment times and improving comfort, an implication the authors state as motivation but do not demonstrate.
- The 4.2% OAR improvement is likely an optimistic bound because evaluation scenarios are drawn from the same motion model used for optimization; a fairer clinical test would use independent motion data acquired on a different day.
- The IPRO-1C result suggests that a single pre-treatment breathing cycle, augmented by period and phase perturbations, may be sufficient to capture the interplay uncertainty; a testable extension would compare IPRO-1C against gated delivery on the same patients.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes and evaluates interplay-robust optimization (IPRO) for pencil beam scanning proton therapy of lung patients with irregular breathing, extending prior work on frequency uncertainty to include amplitude variability. Motion is modeled with synthetic 4DCTs derived from 4DMRI patterns; optimization and evaluation scenarios are generated by randomly concatenating held-out breathing cycles. IPRO and a single-cycle variant IPRO-1C are compared with 4DRO on four synthetic patient cases. The authors report improved near-worst-case target coverage for IPRO and IPRO-1C, and, after equal-coverage dose normalization, reduced OAR doses with average near-worst-case improvements of 4.2% (IPRO-49S) and 1.7% (IPRO-1C-9S).
Significance. If the result holds outside the simulated setting, it is clinically relevant: explicitly modeling the spot-to-phase interplay during optimization could reduce the need for gating or rescanning, and IPRO-1C-9S is claimed to have computational cost comparable to 4DRO. The study has notable strengths: it uses a published delivery-time model, evaluates each plan in 500 motion scenarios as recommended in the literature, and is transparent about its limitations. However, the evidence base is four synthetic cases with evaluation scenarios drawn from the same motion model used for optimization, so the quantitative improvements reported here should be read as conditional on that matched distribution until out-of-distribution robustness is demonstrated.
major comments (4)
- [Sec. 2.4 and Sec. 4] The central claim that IPRO and IPRO-1C improve target coverage for irregularly breathing lung patients is supported only under a matched-distribution simulation: evaluation scenarios are generated by randomly concatenating held-out breathing cycles from the same s4DCT motion model, and every cycle is assumed to start at end-exhale with no phase uncertainty at beam start (Sec. 2.4). The authors themselves state in Sec. 4 that the case that may compromise IPRO's robustness is when motion states occurring during delivery are not represented in the optimization scenarios. The abstract's phrasing that IPRO 'increased the target coverage for all patient cases' therefore overreaches beyond the simulation setting. Please add an explicit out-of-distribution test, for example evaluating with a random start-phase offset or with breathing amplitude/period distributions deliberately perturbed relative to the optimization set, and temper the conclusions accordingly.
- [Sec. 3, Table 2] The normalized comparison used to support the OAR-sparing claims is affected by a modeling inconsistency: all evaluation doses are scaled by a constant factor to match the 4DRO 5th-percentile CTV D98, and 'the effect on the time structure was ignored.' Uniformly scaling spot weights changes the delivery time structure, which changes the spot-to-motion-state assignment in Eq. (2) and hence the actual interplay-affected dose that would be delivered. The reported OAR improvements, including the 4.2% average for IPRO-49S, are therefore computed from doses that would not be delivered by the scaled plans. Please re-optimize the normalized plans, include the time-structure effect of the scaling, or quantitatively assess the error introduced by ignoring it.
- [Table 2 and Sec. 3] The key numerical results are point estimates without confidence intervals or hypothesis tests. The 5th and 95th percentiles over 500 simulated scenarios are random quantities, and differences of 1.7% or even 4.2% could be within scenario sampling noise. Please provide bootstrap confidence intervals or other uncertainty quantification for the reported changes, and state exactly which OAR metrics and patient cases are included in the 'averaging' that produced the 4.2% and 1.7% figures in the abstract.
- [Sec. 3.4, Case 3b*] Case 3b* is introduced after observing that the initial IPRO-1C breathing cycle was unrepresentative of the evaluation motion (Sec. 3.4). This post-hoc selection means that the IPRO-1C results in Table 2 are a mixture of a pre-specified case and a repaired case, so they do not provide an unbiased estimate of the method's typical performance when a single cycle is chosen. Combined with the small number of geometries and motion patterns, this limits the strength of the claim that IPRO-1C reliably improves over 4DRO. Please present 3b* explicitly as a post-hoc sensitivity analysis and adjust the corresponding conclusions.
minor comments (6)
- [Figure 3 caption] The caption states that the whiskers indicate the 5th and 95th percentiles but then repeats the same information; please clarify whether the box edges are quartiles and the whiskers are the stated percentiles, since this differs from standard Tukey boxplots.
- [Sec. 2.7] The IPRO-1C scenario grids for period scaling and start-phase shift are described only in prose; a small table or equation would make the scenario construction easier to follow and reproduce.
- [Abstract and Sec. 3] The abstract's '4.2 %' and '1.7 %' improvements should specify the exact set of OAR metrics and cases over which the average is taken, because Table 2 shows considerable variation by case and metric.
- [Sec. 2.1, Eq. (1)] The set I^p(x; s) is introduced as 'I p(x; s)' in the text but printed with a superscript in Eq. (1); please unify the notation for readability.
- [References] Reference [15] is cited as 's4DCT(MRI)' in the bibliography while the text uses 's4DCT'; please add a clear definition at first use and make the reference title consistent.
- [Sec. 2.6] The text says the template plan was optimized with 40 iterations of 4DRO and that the 4DRO plan used 40 additional iterations; please clarify whether the total number of iterations for the final 4DRO plan is 80 and how this compares with the 40 iterations used for the other methods.
Circularity Check
No significant circularity; the IPRO evaluation uses disjoint held-out breathing cycles and the cited prior IPRO work is not load-bearing for the numerical claim.
full rationale
The paper's central claim is that IPRO and IPRO-1C improve target coverage and OAR sparing relative to 4DRO under irregular-breathing scenarios. Evaluation (Sec. 2.5) uses 500 scenarios formed by randomly concatenating held-out breathing cycles (even indices), while IPRO optimization scenarios are formed by the same random-concatenation procedure from odd-index cycles (Sec. 2.4 and Sec. 2.7). This makes the evaluation in-distribution with the optimization scenario model, but it is not circular in the prohibited sense: no outcome quantity is used to define the method, no parameter is fitted to the evaluation data, and the evaluation scenarios are not the same scenarios used for optimization. The stated 4.2% and 1.7% OAR reductions arise from a fixed normalization to equal 5th-percentile CTV D98 and are computed on the evaluation set rather than being built into the objective. The paper explicitly acknowledges the generalizability boundary: 'the case that may compromise the robustness aimed at by IPRO is when the motion states that may occur during treatment delivery are not represented in the scenarios used during optimization' and 'Larger discrepancies between the data used for optimization and evaluation, respectively, are expected to decrease the robustness gain of IPRO.' These are honest limitations about distribution shift, not reductions by construction. The only self-citation with author overlap (Fredriksson is a coauthor of Engwall et al. [14]) is used to motivate the IPRO approach and a heuristic time-structure update; the present derivation and numerical comparisons are self-contained and do not rest on an unverified theorem from that citation. Therefore no circular step is exhibited and the score is 0.
Assumptions & free parameters
free parameters (6)
- Weighted-power-mean exponent (power=8) =
8
- IPRO-1C period scaling grid =
e.g., {0.9,1,1.1} for 9S, up to {0.7,...,1.3} for 49S
- IPRO-1C start-phase shift grid =
e.g., {-1,0,+1} for 9S, up to {-3,...,+3} for 49S
- Number of optimization scenarios =
9, 25, 49
- Patient-specific objective weights =
Table 3 values, e.g., CTV min dose weights 400, 1200, 80
- Normalization dose-scaling factor =
Per-plan factor to match 4DRO 5th percentile CTV D98
assumptions (6)
- domain assumption Synthetic 4DCTs from 4DMRI deformation accurately represent realistic irregular breathing motion, including amplitude variation.
- domain assumption Breathing can be decomposed into cycles, each starting at end-exhale, with no uncertainty in the breathing phase at beam start.
- domain assumption Phase-sorted 4D dose computation with the fitted IBA delivery time model is accurate enough for comparing planning methods.
- ad hoc to paper Fixing the spot-to-motion-state assignment during optimization and updating every 10 iterations is a valid heuristic for the non-convex interplay problem.
- domain assumption The weighted-power-mean objective with parameter 8 adequately approximates the worst-case objective.
- domain assumption 500 evaluation scenarios provide statistically accurate estimates of interplay dose variation.
Cite this review
Pith. "Pith review of Interplay-robust optimization for treating irregularly breathing lung patients with pencil beam scanning." pith.science (2026). https://pith.science/paper/4EAWL653
@misc{pith2026241116230,
author = {Pith},
title = {Pith review of: Interplay-robust optimization for treating irregularly breathing lung patients with pencil beam scanning},
year = {2026},
howpublished = {\url{https://pith.science/paper/4EAWL653}},
note = {Machine review of arXiv:2411.16230}
}
read the original abstract
The steep dose gradients obtained with pencil beam scanning allow for precise tumor targeting at the cost of high sensitivity to uncertainties. Robust optimization is commonly applied to mitigate uncertainties in density and patient setup, while its application to motion management, called 4D-robust optimization (4DRO), is typically accompanied by other motion mitigation techniques. In particular, current commercial implementations of 4DRO do not model the interplay effect between the delivery time structure and the patient's motion. Previously, it has been shown that Interplay-robust optimization (IPRO) can mitigate the interplay effect given uncertainty in the patient's breathing frequency. In this study, we investigate and evaluate IPRO in the context where the motion uncertainty is extended to also include variations in breathing amplitude. We model the patients' motion using synthetic 4DCTs, each created by deforming a reference CT based on a motion pattern obtained with 4DMRI. Each synthetic 4DCT contains multiple breathing cycles, partitioned into two sets for scenario generation: one for optimization and one for evaluation. Motion scenarios are then created by randomly concatenating breathing cycles varying in period and amplitude. In addition, a method considering a single breathing cycle for generating optimization scenarios (IPRO-1C) is developed to investigate to which extent robustness can be achieved with limited information. IPRO and IPRO-1C increased the target coverage for all patient cases in terms of the near-worst-case (5th percentile) CTV D98, compared to 4DRO. After normalization of plan doses to equal target coverage, IPRO with 49 scenarios resulted in the greatest decreases in OAR dose, with near-worst-case (95th percentile) improvements averaging 4.2 %. IPRO-1C with 9 scenarios, with comparable computational demands as 4DRO, decreased OAR dose by 1.7 %.
Figures
Figures from the paper (2 more)
Reference graph
Works this paper leans on
-
[1]
Treatment planning and verification of proton therapy using spot scanning: Initial experiences
A. J. Lomax et al. “Treatment planning and verification of proton therapy using spot scanning: Initial experiences”. Medical Physics 31.11 (2004)
2004
-
[2]
Minimax optimization for handling range and setup uncertainties in proton therapy
A. Fredriksson, A. Forsgren, and B. H ˚ ardemark. “Minimax optimization for handling range and setup uncertainties in proton therapy”. Medical Physics 38.3 (2011)
work page 2011
-
[3]
Treatment planning of scanned proton beams in RaySta- tion
M. Janson et al. “Treatment planning of scanned proton beams in RaySta- tion”. Medical Dosimetry. Treatment Planning in Proton Therapy 49.1 (1, 2024)
work page 2024
-
[4]
A review of proton therapy – Current status and future di- rections
R. Mohan. “A review of proton therapy – Current status and future di- rections”. Precision Radiation Oncology6.2 (2022)
work page 2022
-
[5]
A survey of practice patterns for real-time intrafrac- tional motion-management in particle therapy
Y. Zhang et al. “A survey of practice patterns for real-time intrafrac- tional motion-management in particle therapy”. Physics and Imaging in Radiation Oncology26 (1, 2023)
work page 2023
-
[6]
Surveying the clinical practice of treatment adaptation and motion management in particle therapy
B. Kn¨ ausl et al. “Surveying the clinical practice of treatment adaptation and motion management in particle therapy”. Physics and Imaging in Radiation Oncology27 (1, 2023)
work page 2023
-
[7]
A review of the clinical introduction of 4D particle therapy research concepts
B. Kn¨ ausl et al. “A review of the clinical introduction of 4D particle therapy research concepts”. Physics and Imaging in Radiation Oncology 29 (1, 2024)
work page 2024
-
[8]
Intrafractional motion during proton beam scanning
J. Lambert et al. “Intrafractional motion during proton beam scanning”. Physics in Medicine & Biology50.20 (2005)
work page 2005
Show all 20 references
-
[9]
Breathing interplay effects during proton beam scanning: simulation and statistical analysis
J. Seco et al. “Breathing interplay effects during proton beam scanning: simulation and statistical analysis”. Physics in Medicine & Biology54.14 (2009)
2009
-
[10]
Quantification of interplay effects of scanned particle beams and moving targets
C. Bert, S. O. Gr¨ ozinger, and E. Rietzel. “Quantification of interplay effects of scanned particle beams and moving targets”.Physics in Medicine & Biology 53.9 (2008)
2008
-
[11]
Motion in radiotherapy: particle therapy
C. Bert and M. Durante. “Motion in radiotherapy: particle therapy”. Physics in Medicine & Biology56.16 (2011)
2011
-
[12]
Advanced treatment planning using direct 4D opti- misation for pencil-beam scanned particle therapy
K. Bernatowicz et al. “Advanced treatment planning using direct 4D opti- misation for pencil-beam scanned particle therapy”. Physics in Medicine & Biology 62.16 (2017)
2017
-
[13]
Multigating, a 4D Optimized Beam Tracking in Scanned Ion Beam Therapy
C. Graeff et al. “Multigating, a 4D Optimized Beam Tracking in Scanned Ion Beam Therapy”. Technology in Cancer Research & Treatment13.6 (1, 2014)
2014
-
[14]
4D robust optimization including uncertainties in time structures can reduce the interplay effect in proton pencil beam scanning radiation therapy
E. Engwall, A. Fredriksson, and L. Glimelius. “4D robust optimization including uncertainties in time structures can reduce the interplay effect in proton pencil beam scanning radiation therapy”. Medical Physics 45.9 (2018). 19
2018
-
[15]
Synthetic 4DCT(MRI) lung phantom generation for 4D radiotherapy and image guidance investigations
A. Duetschler et al. “Synthetic 4DCT(MRI) lung phantom generation for 4D radiotherapy and image guidance investigations”.Medical Physics49.5 (2022)
2022
-
[16]
Motion Interplay as a Function of Patient Param- eters and Spot Size in Spot Scanning Proton Therapy for Lung Can- cer
C. Grassberger et al. “Motion Interplay as a Function of Patient Param- eters and Spot Size in Spot Scanning Proton Therapy for Lung Can- cer”. International Journal of Radiation Oncology*Biology*Physics86.2 (1, 2013)
2013
-
[17]
Effectiveness of different res- canning techniques for scanned proton radiotherapy in lung cancer pa- tients
E. Engwall, L. Glimelius, and E. Hynning. “Effectiveness of different res- canning techniques for scanned proton radiotherapy in lung cancer pa- tients”. Physics in Medicine & Biology63.9 (2018)
2018
-
[18]
Experimental validation of a 4D dose calculation routine for pencil beam scanning proton therapy
T. Pfeiler et al. “Experimental validation of a 4D dose calculation routine for pencil beam scanning proton therapy”. Zeitschrift f¨ ur Medizinische Physik 28.2 (1, 2018)
2018
-
[19]
How should we model and evaluate breathing interplay effects in IMPT?
O. Pastor-Serrano et al. “How should we model and evaluate breathing interplay effects in IMPT?” Physics in Medicine and Biology66.23 (23, 2021)
2021
-
[20]
Giaddui et al
T. Giaddui et al. “Establishing the feasibility of the dosimetric compliance criteria of RTOG 1308: phase III randomized trial comparing overall sur- vival after photon versus proton radiochemotherapy for inoperable stage II-IIIB NSCLC”. Radiation Oncology (London, England)11 ...
2016
Reviewed August 12, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.