REVIEW 4 major objections 6 minor 19 references
Virtual Dosimetrists: A Radiotherapy Training "Flight Simulator"
T0 review · 4 major / 6 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read A dual-encoder model generates and edits radiotherapy dose distributions from natural-language prompts, delivering requested organ-at-risk dose changes in about seven seconds.
desk verdict Genuinely new language-conditioned dose editing, but the headline accuracy is produced by an inference-time feedback loop; better evaluation needed before the education claim lands. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is a dual-encoder neural network: a three-dimensional dense dilated U-net that reads the volumetric inputs (CT, current dose, structure masks) and a text encoder that reads the prompt, fused before the final dose output. A weighted mean-squared-error loss gives 60% of its weight to a dilated organ-at-risk region, so the network learns to concentrate the requested dose change where it matters while leaving distant dose similar to the input. At inference, a sliding-window ensemble of five models produces the prediction, and a loop compares the achieved dose change to the requested one and issues a corrected prompt until convergence.
What would settle it
Give radiation oncology experts a blinded mix of real suboptimal clinical plans and model-generated suboptimal plans for the same patients and ask them to distinguish; if they can reliably tell the two apart, or if the generated plans show artifacts real plans lack, the educational-value claim fails.
Extended reading notes
Core claim
The central claim is that a single cross-modal model can both degrade and improve a radiotherapy dose distribution by interpreting a short text prompt. On fifty-three head-and-neck VMAT plans, the authors created thousands of suboptimal variants by repeatedly resetting organ-at-risk planning objectives to a target type and updating them via a line search, then trained a dual-encoder network. At inference, the requested metric (minimum, mean, or maximum dose) is compared against the actual change, and a feedback loop regenerates a corrected prompt until the difference is within ±50 cGy or ten attempts have passed. Median dose changes for a 500 cGy request cluster around 500 cGy for most organs, though some structures near air boundaries (oral cavity, mandible) show larger scatter. The authors conclude that the system generates training examples and trainee-driven improvements in a clinic-like workflow with essentially no delay.
Load-bearing premise
The entire educational value rests on the untested premise that the deliberately worsened plans produced by the replanning technique look and behave like real suboptimal clinical plans, so that skills practised on them transfer to actual plan review.
Editorial extensions
If this is right
- Trainees can practice plan review on an unlimited stream of suboptimal plans and see the consequence of a planning directive within seconds, rather than waiting minutes to hours for a clinical replan.
- The same model can serve both directions of training: it generates a deliberately worse plan and then improves it when the trainee issues the correct prompt.
- Because the pipeline needs only a CT, a starting dose, structure masks, and text, it is independent of any commercial treatment planning system, which would make distribution to training programs straightforward.
- For most head-and-neck organs, requested dose changes of 500 cGy land within about ±50 cGy after the iterative correction loop, so the exercise is faithful to the prompt.
- This is the first reported link between natural-language instructions and direct dose-map editing, so it opens a new interaction mode for plan modification beyond adjusting optimizer weights inside a treatment planning system.
Reading between the lines
- A natural next test is whether the same architecture transfers to other disease sites with fewer training examples; the authors only demonstrate head-and-neck, and the claim that this is the most complex site is an argument, not a proof.
- The language interface is currently bound to a fixed prompt template; extending it to free-form clinical phrasing would require showing that the text encoder actually understands dose concepts rather than pattern-matching the template.
- If the synthetic suboptimal plans are clinically realistic, the same generator could be used as data augmentation to train automated plan-quality assurance models, a use the paper does not explore.
- The reported 7-second generation time makes an interactive 'flight simulator' plausible, but real educational benefit would need to be measured by trainee performance on real plan review, not just by speed and dose accuracy.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces 'Virtual Dosimetrist' models that combine a 3D dose-prediction network (DDU-Net) with a CLIP text encoder to modify head-and-neck VMAT dose distributions according to natural-language prompts such as 'Increase the mean dose by 500 cGy'. The models are trained on 53 patient plans plus synthetically degraded replans generated with a TPS-based line-search replanning method. At inference, a sliding-window ensemble predicts a modified dose volume in about 7 seconds, and an iterative loop re-prompts the model with the measured residual until the requested OAR metric change is within ±50 cGy or 10 iterations are reached. The authors claim this is the first work to combine dose distribution prediction with natural language processing and to demonstrate direct, prompt-based dose modification for radiotherapy training.
Significance. If the claims are supported, the paper would introduce a genuinely useful educational tool and a novel cross-modal formulation: language-conditioned, voxel-level dose editing. The speed (about 7 seconds) and the ability to generate both lower-quality and improved plans on demand are attractive for plan-review training. The authors are also transparent about per-OAR variability and about using a 80/20 patient-level split with five-fold cross-validation. However, the central quantitative claim of 'accurate' dose modification is currently supported only by a closed-loop inference procedure, and the evaluation omits whole-dose realism checks that are load-bearing for the stated educational purpose. The significance is therefore conditional on a substantially strengthened evaluation.
major comments (4)
- [§2.3, Table 2] The reported accuracy is not an independent test of prompt-conditioned dose modification. Section 2.3 describes an inference loop that compares the achieved OAR metric change with the requested change, generates a new prompt containing the residual, and repeats on the initial dose until the error is within ±50 cGy or 10 iterations are reached. The median changes in Table 2 are therefore the output of a feedback optimizer, not of a single forward pass conditioned on the user's original prompt. The paper gives no first-pass/open-loop accuracy, no iteration counts, and no failure rate, so the reader cannot tell how much of the reported success is due to the model versus the loop. In addition, several Table 2 entries are far outside the stated ±50 cGy tolerance even in closed loop, e.g., Mandible ΔDmax = 7.0 cGy, Submandibular Gland (L) ΔDmin = 743.5 cGy, and Esophagus ΔDmin = 344.8 cGy. Please report open-loop performance, convergence statistics, and failure rates, and discuss why the tolerance is not met for these structures.
- [§3, Table 2] The evaluation checks only the change in a single OAR scalar metric relative to the starting clinical dose. There is no voxel-wise comparison to the ground-truth TPS-replanned dose that was used as the training target, no gamma or DVH-wide analysis, and no verification that target coverage and other OAR constraints remain clinically acceptable. Because the stated purpose is to generate clinically realistic lower-quality plans and to train plan-review skills, the model could hit the requested mean-dose change while producing dose maps that no dosimetrist would accept. This missing whole-dose validation is load-bearing for the paper's central claim and should be addressed before the accuracy and realism statements can be accepted.
- [§2.1, §4] The educational value rests on an unvalidated assumption that the synthetically replanned suboptimal doses are clinically realistic. The replanning technique in Section 2.1, which resets OARs to 'target' type and uses a line search to increase OAR dose, is heuristic and is not validated against real suboptimal clinical plans or against expert dosimetrist review. Table 1 shows that some OARs have very few examples (e.g., Lens with 60 distributions), and the paper reports no measure of whether the generated suboptimal plans resemble the kinds of mistakes trainees should learn to catch. Please provide evidence that the synthetic suboptimal plans are plausible, for example via expert grading, DVH comparison to real suboptimal plans, or another clinically grounded realism metric.
- [Table 2] It is unclear which metric was actually prompted for each row of Table 2. The table reports ΔDmin, ΔDmean, and ΔDmax for every OAR, but the prompt template in Section 3 specifies exactly one metric per prompt. If each column corresponds to a separate prompt, then entries such as Mandible ΔDmax = 7.0 cGy are direct failures of the requested 500 cGy increase for that metric. If instead the table reports all three metrics under a single prompt (for example, a mean-dose prompt), the non-target columns are expected to vary and should not be interpreted as accuracy failures. The manuscript must state which metric was prompted for each row and give per-prompt results, including the distribution of outcomes, not only medians.
minor comments (6)
- [§3, Fig. 2] The prompt template 'Decrease the metric dose by -amount cGy' is internally contradictory, and Fig. 2's caption uses 'Decrease the mean dose by -900 cGy', which mathematically increases the dose. Please use a consistent wording such as 'Change the mean dose by -900 cGy' or 'Decrease the mean dose by 900 cGy'.
- [Table 2] Report the number of test cases per OAR and confidence intervals or interquartile ranges; with only 11 test patients and highly variable per-OAR sample sizes, a median plus standard deviation does not convey statistical uncertainty.
- [Eq. (1)] The notation D_dm, D_PTV, D_OAR is used in Eq. (1) but not defined in the text; please define the 'dose mask' and state explicitly whether the OAR mask in the loss is the dilated mask used as network input.
- [§2.1] The line-search replanning algorithm is described only verbally; include the objective-update equations or provide a pseudocode/supplementary description so the data-generation procedure is reproducible.
- [§1] The citation to an 'unpublished National Cancer Database analysis, 2021' is not a usable reference; please replace it with a citable source or remove it.
- [§3] The sentence 'The results for prompts to decrease dose by the same amount are similar' is unsupported by any table or figure; please include the corresponding data or soften the claim.
Circularity Check
The headline accuracy result is produced by an inference-time feedback loop that rewrites the prompt until the OAR metric is within tolerance, so Table 2 reports a controlled variable, not an independent prediction.
-
fitted input called prediction
[Section 2.3 (Inference and Post Processing Techniques) and Table 2 in Section 3]
"To increase precision, a simple loop-based approach was designed in the inference process. Following the initial inference and prompt, the resulting dose difference for the specified OAR was compared to the requested change and metric. If the difference was not less than±50cGy, a new prompt was generated with the difference and the prediction repeated on the initial inference data. This process was repeated until the inferred dose change was within±50cGy of the initial prompt, or 10 iterations, whichever occurred first."
The evaluation metric reported in Table 2—the change in the specified OAR dose metric—is exactly the quantity used by the loop to generate new prompts. Each iteration reconditions the model on the residual between the requested and achieved change, so the final output is driven toward the requested value by construction. The paper then summarizes this closed-loop result as 'successful at producing new dose distributions with the requested change' and uses Table 2 as the main evidence of accuracy. No first-pass, open-loop accuracy, iteration count, or failure rate is reported, so the reader cannot distinguish model skill from the feedback loop's fixed-point enforcement. Moreover, the final prompt is not the user's original prompt, weakening the claim of 'direct modification ...
full rationale
The central circularity is the closed-loop inference protocol. The loop's stopping criterion uses the same OAR dose-metric difference that Table 2 reports, so the reported medians are the outcome of a feedback controller rather than a single forward pass conditioned on the user's prompt. This is a fitted input called prediction: the prompt is iteratively fit to make the evaluation metric hit the target, and the resulting value is presented as evidence that the model 'successfully' performs the requested modification. The paper does not disclose how many iterations were needed, how often the 10-iteration cap was reached, or what the first-pass accuracy was, so the accuracy claim is not independently testable from the presented data. The self-citations to earlier DDU-Net dose-prediction work are not circular: they support the architecture choice but are not used to prove the current language-conditioned dose-modification claim. The synthetic suboptimal-plan assumption is a validity risk rather than circularity, since the model is still trained and tested on held-out patients. Overall, the numeric core of the headline claim reduces by construction to the loop's control objective, meriting a score of 6; the remaining pipeline still has independent empirical content, so the paper is only partially circular.
Assumptions & free parameters
free parameters (5)
- Loss weights (0.2, 0.2, 0.6) =
0.2, 0.2, 0.6
- OAR mask dilation (1.5 cm) =
1.5 cm
- Inference loop tolerance (+/-50 cGy) =
50 cGy
- Max loop iterations (10) =
10
- CT intensity clip range (-200, 450 HU) =
-200 to 450
assumptions (3)
- domain assumption The 53 head-and-neck VMAT plans from a single institution are representative enough to train a model that transfers to other patients and disease sites.
- domain assumption The replanning technique produces suboptimal dose distributions that are clinically realistic and suitable for training.
- domain assumption CLIP text encoder provides a usable representation for these simple dose-modification instructions.
Cite this review
Pith. "Pith review of Virtual Dosimetrists: A Radiotherapy Training "Flight Simulator"." pith.science (2026). https://pith.science/paper/WDSNH35P
@misc{pith2026250509796,
author = {Pith},
title = {Pith review of: Virtual Dosimetrists: A Radiotherapy Training "Flight Simulator"},
year = {2026},
howpublished = {\url{https://pith.science/paper/WDSNH35P}},
note = {Machine review of arXiv:2505.09796}
}
read the original abstract
Effective education in radiotherapy plan quality review requires a robust, regularly updated set of examples and the flexibility to demonstrate multiple possible planning approaches and their consequences. However, the current clinic-based paradigm does not support these needs. To address this, we have developed 'Virtual Dosimetrist' models that can both generate training examples of suboptimal treatment plans and then allow trainees to improve the plan quality through simple natural language prompts, as if communicating with a dosimetrist. The dose generation and modification process is accurate, rapid, and requires only modest resources. This work is the first to combine dose distribution prediction with natural language processing; providing a robust pipeline for both generating suboptimal training plans and allowing trainees to practice their critical plan review and improvement skills that addresses the challenges of the current clinic-based paradigm.
Figures
Reference graph
Works this paper leans on
-
[1]
Medical Physics48(9), 5549–5561 (2021).https://doi.org/ 10.1002/mp.14845
Babier, A., Zhang, B., Mahmood, R., Moore, K.L., Purdie, T.G., McNiven, A.L., Chan, T.C.Y.: OpenKBP: The open-access knowledge-based planning grand chal- lenge and dataset. Medical Physics48(9), 5549–5561 (2021).https://doi.org/ 10.1002/mp.14845
doi:10.1002/mp.14845 2021
-
[2]
Boyd, G.H., Vanbenthuysen, L., Jimenez, R.B.: Radiation Treatment Plan Evalu- ation Education in Residency: A Needs Assessment. International Journal of Ra- diation Oncology, Biology, Physics117(2), e504–e505 (Oct 2023).https://doi. org/10.1016/j.ijrobp.2023.06.1753
-
[3]
Chen, Z., Chen, G.H., Diao, S., Wan, X., Wang, B.: On the Difference of BERT- style and CLIP-style Text Encoders (Jun 2023).https://doi.org/10.48550/ arXiv.2306.03678
-
[4]
AAPM (Jul 2023),https://aapm.confex.com/aapm/2023am/meetingapp
Gao, Y., Shen, C., Gonzalez, Y., Jia, X.: High Dose-Rate Brachytherapy Treat- ment Planning for Gynecological Cancer with Intelligent and Conversational AI. AAPM (Jul 2023),https://aapm.confex.com/aapm/2023am/meetingapp. cgi/Paper/6126
work page 2023
-
[5]
Radiotherapy and Oncology184, 109685 (Jul 2023)
Gao, Y., Shen, C., Jia, X., Kyun Park, Y.: Implementation and evaluation of an intelligent automatic treatment planning robot for prostate cancer stereotac- tic body radiation therapy. Radiotherapy and Oncology184, 109685 (Jul 2023). https://doi.org/10.1016/j.radonc.2023.109685
arXiv 2023
-
[6]
Journal of Machine Learning Research23(173), 1–65 (2022),http://jmlr.org/papers/v23/20-1258
Granziol, D., Zohren, S., Roberts, S.: Learning Rates as a Function of Batch Size: A Random Matrix Theory Approach to Neural Network Training. Journal of Machine Learning Research23(173), 1–65 (2022),http://jmlr.org/papers/v23/20-1258. html
work page 2022
-
[8]
Medical Physics48(9), 5567– 5573 (2021).https://doi.org/10.1002/mp.14827
Gronberg, M.P., Gay, S.S., Netherton, T.J., Rhee, D.J., Court, L.E., Cardenas, C.E.: Technical Note: Dose prediction for head and neck radiotherapy using a three-dimensional dense dilated U-net architecture. Medical Physics48(9), 5567– 5573 (2021).https://doi.org/10.1002/mp.14827
-
[9]
Medical Physics50(11), 6639–6648 (2023).https://doi.org/10.1002/mp.16735
Gronberg, M.P., Jhingran, A., Netherton, T.J., Gay, S.S., Cardenas, C.E., Chung, C., Fuentes, D., Fuller, C.D., Howell, R.M., Khan, M., Lim, T.Y., Marquez, B., Olanrewaju, A.M., Peterson, C.B., Vazquez, I., Whitaker, T.J., Wooten, Z., Yang, M., Court, L.E.: Deep learning–baseddose prediction to improve the planquality of volumetric modulated arc therapy f...
Show all 19 references
-
[10]
32nd International Conference on Machine Learning, ICML 20151(Feb 2015),http://arxiv.org/abs/1502.03167
Ioffe, S., Szegedy, C.: Batch normalization: Accelerating deep network training by reducing internal covariate shift. 32nd International Conference on Machine Learning, ICML 20151(Feb 2015),http://arxiv.org/abs/1502.03167
2015 arXiv
- [11]
- [12]
-
[13]
In: 2023 IEEE/CVF International Conference on Computer Vi- sion (ICCV)
Liu, J., Zhang, Y., Chen, J.N., Xiao, J., Lu, Y., Landman, B.A., Yuan, Y., Yuille, A., Tang, Y., Zhou, Z.: CLIP-Driven Universal Model for Organ Segmentation and Tumor Detection. In: 2023 IEEE/CVF International Conference on Computer Vi- sion (ICCV). pp. 21095–21107 (Oct 2023)...
2023
-
[14]
MONAI Consortium: MONAI: Medical Open Network for AI (Oct 2024).https: //doi.org/10.5281/zenodo.13942962
2024 doi
-
[15]
International Journal of Radiation Oncology*Biology*Physics81(2), 545–551 (Oct 2011).https://doi
Moore, K.L., Brame, R.S., Low, D.A., Mutic, S.: Experience-Based Quality Control of Clinical Intensity-Modulated Radiotherapy Planning. International Journal of Radiation Oncology*Biology*Physics81(2), 545–551 (Oct 2011).https://doi. org/10.1016/j.ijrobp.2010.11.030
2011 doi
-
[17]
Medical Physics47(3), 837–849 (2020).https://doi.org/10.1002/mp.13955
Nguyen, D., McBeth, R., Sadeghnejad Barkousaraie, A., Bohara, G., Shen, C., Jia, X., Jiang, S.: Incorporating human and learned domain knowledge into training deep neural networks: A differentiable dose-volume histogram and adversarial in- spiredframeworkforgeneratingParetoopt...
2020 doi
- [18]
-
[19]
Medical Physics47(6), 2329–2336 (2020).https:// doi.org/10.1002/mp.14114
Shen, C., Nguyen, D., Chen, L., Gonzalez, Y., McBeth, R., Qin, N., Jiang, S.B., Jia, X.: Operating a treatment planning system using a deep-reinforcement learning- based virtual treatment planner for prostate cancer intensity-modulated radiation therapy treatment planning. Med...
2020 doi
-
[20]
Biomedical Physics & Engineering Express8(4), 045008 (Jun 2022).https://doi.org/10.1088/ 2057-1976/ac6d82
Sprouts, D., Gao, Y., Wang, C., Jia, X., Shen, C., Chi, Y.: The development of a deep reinforcement learning network for dose-volume-constrained treatment planning in prostate cancer intensity modulated radiotherapy. Biomedical Physics & Engineering Express8(4), 045008 (Jun 20...
2022
-
[21]
Practi- cal Radiation Oncology10(5), 312–320 (Sep 2020).https://doi.org/10.1016/j
Talcott,W.J.,Lincoln,H.,Kelly,J.R.,Tressel,L.,Wilson,L.D.,Decker,R.H.,Ford, E., Hartvigson, P.E., Pawlicki, T., Evans, S.B.: A Blinded, Prospective Study of Error Detection During Physician Chart Rounds in Radiation Oncology. Practi- cal Radiation Oncology10(5), 312–320 (Sep 2...
2020 doi
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.