REVIEW 4 major objections 5 minor 32 references
OpenBreastUS: Benchmarking Neural Operators for Wave Imaging Using Breast Ultrasound Computed Tomography
T0 review · 4 major / 5 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read OpenBreastUS lets neural wave solvers image real breast tissue for the first time.
desk verdict A genuinely useful large-scale USCT dataset and benchmark, undermined by an internally inconsistent report of the in vivo experiment that needs fixing before the headline claim can be trusted. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the frequency-domain heterogeneous Helmholtz equation, solved by the Convergent Born Series algorithm to create ground-truth wavefields for 8,000 virtual breast anatomies under a real annular-array USCT configuration. Neural operator baselines, including FNO, BFNO, AFNO, MgNO, and U-Net, learn the map from sound-speed map and source to complex wavefield; the best forward models are then plugged into the adjoint-state gradient, replacing the two Helmholtz solves per iteration with one network evaluation. The mixture-of-experts frequency-specific operators, together with the adjoint-gradient formula $-2(\omega^j)^2 \lambda u / c^3$, are what make the in vivo inversion tractable.
What would settle it
A decisive check would be to run the same BFNO-driven FWI pipeline on a held-out clinical USCT dataset from a different scanner, with tumor locations confirmed by biopsy or pathology; if reconstructed lesion boundaries do not match pathology within the expected margin, or if image quality collapses on this second dataset, the claimed transfer is not general.
Extended reading notes
Core claim
The paper's central claim is that a neural surrogate trained purely on synthetic breast anatomy can replace the numerical Helmholtz solver inside full-waveform inversion and still produce clinically useful reconstructions of real patient breasts. Using gradient-based optimization with a Born Fourier Neural Operator (BFNO) as the forward map, the authors reconstruct a malignant tumor with irregular boundaries and a benign cyst with smooth boundaries from clinical USCT data restricted to the dataset's eight frequencies, while direct inversion networks (NIO, InversionNet, DeepONet) fail to recover interior structure. The result is presented as evidence that the OpenBreastUS phantoms capture the scattering statistics of real tissue closely enough for transfer, and that forward operators, which learn only the conditional mapping from medium to wavefield, are more robust than inverse operators that must also learn the anatomical prior.
Load-bearing premise
The whole transfer result rests on the assumption that synthetic breast anatomies, after hand-set scaling and small random sound-speed perturbations, have the same spatial statistics as real breast tissue; the in vivo validation also assumes models trained on three frequencies and 64 sources apply to eight frequencies and 256 transmitters without explicit retraining.
Editorial extensions
If this is right
- In iterative full-waveform inversion, replacing each pair of Helmholtz solves with a forward neural operator cuts per-gradient cost to a single network pass, making quasi-real-time USCT reconstruction a realistic target instead of a numerical bottleneck.
- Forward surrogate models outperform direct inversion networks on realistic tissue because they learn the likelihood rather than the posterior, so they are less prone to memorizing the training anatomy distribution.
- OpenBreastUS-trained operators generalize to unseen breast types, unseen source locations, and even to media like Gaussian random fields, while models trained on simplified random media fail on breast tissue.
- Higher breast density and higher frequency systematically degrade all baselines, so future neural solvers will need to target dense-tissue scattering and high-wavenumber behavior.
- In the two clinical cases, gradient-based optimization with BFNO distinguishes malignant from benign lesions by boundary regularity, indicating a path toward computer-assisted breast-disease screening.
Reading between the lines
- A likely consequence the paper leaves implicit is that the same phantom-generation approach could synthesize training pairs for almost any ring-array USCT geometry, making scanner-specific retraining cheap once a forward surrogate is trusted.
- Because the in vivo test used one dataset and two patients, the strongest next test is external validation on a different device and population; positive results there would convert the demonstration into a general method.
- The frequency and source mismatch between training (three frequencies, 64 sources) and application (eight frequencies, 256 transmitters) suggests the model transfers more broadly than the benchmark explicitly trains for, and isolating whether that generalization is physics or coincidence would be a clean ablation.
- Extending the forward model to include acoustic attenuation, which the paper lists as future work, would likely improve tumor characterization and is a natural test of whether the dataset's realism bottleneck is tissue structure or missing physics.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. OpenBreastUS is a large-scale dataset of 8,000 anatomically realistic breast phantoms (VICTRE-based) together with 16.4 million frequency-domain Helmholtz wave simulations using a 256-transducer ring array at 8 frequencies. The paper benchmarks five forward neural operators (U-Net, FNO, AFNO, BFNO, MgNO), four inverse approaches (DeepONet, InversionNet, NIO, and optimization-based FWI with neural surrogates), and reports that BFNO-based gradient inversion reconstructs a malignant tumor and a benign cyst on two in vivo cases from the Karmanos Cancer Institute. The central claim is that models trained on OpenBreastUS generalize to clinical USCT data, enabling efficient in vivo imaging with neural operator solvers.
Significance. If the central claim holds, OpenBreastUS would be a substantial resource for neural operator research in wave imaging, combining realistic anatomy with a credible CBS reference solver, and the in vivo transfer would be a notable first. The paper's strengths include the scale and realism of the dataset, the use of an external clinical dataset never seen in training, the held-out phantom evaluation, and the comparison against a CBS numerical solver rather than a weaker reference. The OOD experiments (source locations, breast types, GRF media) also provide useful evidence about generalization. However, the internal inconsistency in training configuration and the purely qualitative in vivo evaluation mean the headline claim is not yet established.
major comments (4)
- [§IV-C, §IV-D, Fig. 5] §IV-C states that forward baselines were evaluated on a subset of three frequencies (300, 400, 500 kHz) and 64 of 256 sources, and that inverse baselines were trained and tested on the same three frequencies. §IV-D then says the neural operators 'were trained on data at 8 frequencies (300–650 kHz)' and the Figure 5 caption specifies BFNO with 8 frequencies and 256 transmitters. No retraining step is described anywhere in the paper. If the §IV-D models are the same as the §IV-C models, the 8-frequency/256-source clinical input is a large out-of-distribution shift; if they were retrained, the training setup is undocumented. Either way, the in vivo experiment as reported is not reproducible, and the headline claim depends on it.
- [Table II, §IV-C, §IV-D] Table II includes a 600 kHz row, while §IV-C says only 300, 400, and 500 kHz were used, and §IV-D says 8 frequencies (300–650 kHz). This inconsistency makes the actual training frequencies for the benchmark models ambiguous. The paper must state exactly which frequencies and source counts were used for each model in Tables II–III and for the Section IV-D in vivo experiments.
- [§IV-D, Figs. 5–6] The in vivo demonstration is entirely qualitative. There are no quantitative metrics (e.g., SSIM/PSNR against the FDFD reference, lesion contrast, or boundary error) and no statistical assessment. The claim that BFNO 'successfully reconstructed a clear malignant tumor' is supported only by visual inspection of two clinical cases. Since the abstract's 'first in vivo imaging' claim rests on these figures, quantitative evaluation should be added.
- [Tables II, III, V, VI, VII] The benchmark tables report a single point estimate per model and condition, with no standard deviation across training seeds or test folds. The paper's stated purpose is to benchmark neural operators, so the reported rankings (e.g., MgNO at RRMSE 0.0028 vs. BFNO at 0.0113 in Table II) cannot be assessed for statistical significance. At least three seeds with error bars and, where possible, significance tests should be reported.
minor comments (5)
- [§III-B] Section III-B refers to 'OpenWaves dataset' instead of OpenBreastUS.
- [Appendix B, InversionNet] In Appendix B, 'WIn this paper' appears to be a typo for 'In this paper'.
- [§IV-C] Section IV-C contains the typo 'neural operatos', which should be 'neural operators'.
- [Figs. 5–6] Figures 5(a) and 6(a) are labeled 'Ground Truth' but are themselves reconstructions produced by an FDFD solver; relabel them as 'Reference reconstruction' to avoid implying true ground truth.
- [§III-C2, Appendix A] The phantom generation relies on hand-set VICTRE parameters (a1b, a1t, a2l, a2r, a3, targetFatFrac ranges) with no sensitivity analysis; a brief discussion of how these choices affect the benchmark would help users interpret the dataset.
Circularity Check
No significant circularity: the FWI/operator framework is derived in-paper from the Helmholtz equation, benchmarks are checked against an independent CBS solver, and the only overlapping-author citation [30] is a non-load-bearing baseline credit; the training-configuration gap flagged by reviewers is a reproducibility concern, not a circular reduction.
full rationale
The derivation chain is self-contained: the forward model (Helmholtz equation, Eq. 1, with the Sommerfeld condition, Eq. 2) and the full-waveform-inversion Lagrangian/adjoint machinery (Eqs. 3–10) are derived in the paper itself, and the forward surrogate G and inverse map G^-1 are defined by Eqs. 9 and 10 with no fitted constant defined in terms of the target quantity. Benchmark accuracy is measured against an independent Convergent Born Series solver [29] on held-out phantoms (Tables II and III), and the in vivo validation uses external Karmanos clinical data whose reference reconstructions come from the independent FDFD/block-LU work of Ali and Duric [15]; neither the simulated benchmarks nor the in vivo evaluation relabels a fitted parameter as a prediction. The only citation with overlapping authorship is [30] (Zeng et al., "Neural Born Series Operator"), used in Section IV-B solely to name the gradient-based-optimization baseline; its mathematical content is derived in Section III-B, so the self-citation is minor and non-load-bearing. One internal-consistency gap should be flagged as a non-circularity concern: Section IV-C reports that the baselines were trained on three frequencies (300, 400, and 500 kHz) from 64 of 256 sources, while Section IV-D and the Figure 5 caption state that the in vivo models were trained on eight frequencies (300–650 kHz) with 256 transmitters, and no retraining step is documented; Table II also includes a 600 kHz row beyond the stated three-frequency configuration. This is a missing-support and reproducibility problem for the headline in vivo claim, but it is not a circular reduction, because the reported reconstructions are not forced by construction from the training inputs and the clinical data were never part of any fit.
Assumptions & free parameters
free parameters (4)
- VICTRE geometry scale parameters (a1b, a1t, a2l, a2r, a3) =
truncated Gaussian with mean 5.0 cm, sigma 2.0, range [3.5,7.5]; a3/a1b ~ TN(1.4, 0.1, 1.0, 1.5)
- targetFatFrac ranges =
EXD (0,0.25), HET (0.25,0.5), FIB (0.5,0.75), FAT (0.75,1.0)
- Tissue sound speed perturbations =
not quantified, described as small random perturbations
- Training frequency and source subset =
8 frequencies (300-650 kHz); 64 of 256 source locations for main benchmark
assumptions (5)
- domain assumption Scalar heterogeneous Helmholtz equation with Sommerfeld radiation condition is an adequate model of USCT wave propagation (Eqs. 1-2).
- domain assumption The Convergent Born Series (CBS) solver produces an accurate ground truth for the training wavefields.
- domain assumption The VICTRE breast phantom generator produces anatomically realistic tissue distributions.
- domain assumption The clinical dataset from Karmanos Cancer Institute is valid reference data and the FDFD reconstruction in [15] is a fair ground truth.
- standard math The adjoint-state gradient formula (Eq. 8) follows from the KKT conditions (standard math).
Cite this review
Pith. "Pith review of OpenBreastUS: Benchmarking Neural Operators for Wave Imaging Using Breast Ultrasound Computed Tomography." pith.science (2026). https://pith.science/paper/YN7ISEQG
@misc{pith2026250715035,
author = {Pith},
title = {Pith review of: OpenBreastUS: Benchmarking Neural Operators for Wave Imaging Using Breast Ultrasound Computed Tomography},
year = {2026},
howpublished = {\url{https://pith.science/paper/YN7ISEQG}},
note = {Machine review of arXiv:2507.15035}
}
read the original abstract
Accurate and efficient simulation of wave equations is crucial in computational wave imaging applications, such as ultrasound computed tomography (USCT), which reconstructs tissue material properties from observed scattered waves. Traditional numerical solvers for wave equations are computationally intensive and often unstable, limiting their practical applications for quasi-real-time image reconstruction. Neural operators offer an innovative approach by accelerating PDE solving using neural networks; however, their effectiveness in realistic imaging is limited because existing datasets oversimplify real-world complexity. In this paper, we present OpenBreastUS, a large-scale wave equation dataset designed to bridge the gap between theoretical equations and practical imaging applications. OpenBreastUS includes 8,000 anatomically realistic human breast phantoms and over 16 million frequency-domain wave simulations using real USCT configurations. It enables a comprehensive benchmarking of popular neural operators for both forward simulation and inverse imaging tasks, allowing analysis of their performance, scalability, and generalization capabilities. By offering a realistic and extensive dataset, OpenBreastUS not only serves as a platform for developing innovative neural PDE solvers but also facilitates their deployment in real-world medical imaging problems. For the first time, we demonstrate efficient in vivo imaging of the human breast using neural operator solvers.
Figures
Figures from the paper (7 more)
Reference graph
Works this paper leans on
-
[15]
R. Ali, T. M. Mitcham, T. Brevett, `O. C. Agudo, C. D. Martinez, C. Li, M. M. Doyley, and N. Duric, “2-d slicewise waveform inversion of sound speed and acoustic attenuation for ring array ultrasound tomography based on a block lu solver,”IEEE Transactions on Medical Imaging, 2024
work page 2024
-
[30]
G. Osnabrugge, S. Leedumrongwatthanakun, and I. M. Vellekoop, “A convergent born series for solving the inhomogeneous helmholtz equation in arbitrarily large media,”Journal of Computational Physics, vol. 322, pp. 113–124, 2016
work page 2016
-
[1]
L. Lu, P. Jin, and G. Karniadakis, “DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators,”arXiv, 2019
work page 2019
-
[2]
Neural operator: Graph kernel network for partial differential equations,
Z. Li, N. Kovachki, K. Azizzadenesheli, B. Liu, K. Bhattacharya, A. Stuart, and A. Anandkumar, “Neural operator: Graph kernel network for partial differential equations,”arXiv, 2020. [Online]. Available: http://arxiv.org/abs/2003.03485
arXiv 2020
-
[3]
Fourier neural operator for parametric partial differential equa- tions,
——, “Fourier neural operator for parametric partial differential equa- tions,” inICLR, 2021
work page 2021
-
[4]
Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators,
L. Lu, P. Jin, G. Pang, Z. Zhang, and G. E. Karniadakis, “Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators,”Nature Machine Intelligence, vol. 3, 2021. JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2021 13
work page 2021
-
[5]
Pdebench: An extensive benchmark for scientific machine learning,
M. Takamoto, T. Praditia, R. Leiteritz, D. MacKinlay, F. Alesiani, D. Pfl ¨uger, and M. Niepert, “Pdebench: An extensive benchmark for scientific machine learning,”Advances in Neural Information Processing Systems, vol. 35, pp. 1596–1611, 2022
work page 2022
-
[6]
Openfwi: Large-scale multi-structural benchmark datasets for full waveform inversion,
C. Deng, S. Feng, H. Wang, X. Zhang, P. Jin, Y . Feng, Q. Zeng, Y . Chen, and Y . Lin, “Openfwi: Large-scale multi-structural benchmark datasets for full waveform inversion,”Advances in Neural Information Processing Systems, vol. 35, pp. 6007–6020, 2022
work page 2022
Show all 32 references
-
[7]
Wavebench: Benchmarking data-driven solvers for linear wave propagation pdes,
T. Liu, J. A. L. Benitez, A. Khorashadizadeh, F. Faucher, M. V . de Hoop, and I. Dokmani ´c, “Wavebench: Benchmarking data-driven solvers for linear wave propagation pdes,”Transactions on Machine Learning Research Journal, 2024
2024
-
[8]
Full-waveform inversion imaging of the human brain,
L. Guasch, O. Calder ´on Agudo, M.-X. Tang, P. Nachev, and M. Warner, “Full-waveform inversion imaging of the human brain,”npj Digital Medicine, vol. 3, no. 1, p. 28, 2020
2020
-
[9]
3-d stochastic numerical breast phantoms for enabling virtual imaging trials of ultrasound com- puted tomography,
F. Li, U. Villa, S. Park, and M. A. Anastasio, “3-d stochastic numerical breast phantoms for enabling virtual imaging trials of ultrasound com- puted tomography,”IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, vol. 69, no. 1, pp. 135–146, 2022
2022
-
[10]
Spatial response identification enables ro- bust experimental ultrasound computed tomography,
C. Cueto, L. Guasch, J. Cudeiro, O. C. Agudo, T. Robins, O. Bates, G. Strong, and M.-X. Tang, “Spatial response identification enables ro- bust experimental ultrasound computed tomography,”IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, vol. 69, no. 1,...
2022
-
[11]
Ultrasound computed tomography based on full waveform inversion with source directivity calibration,
X. Wu, Y . Li, C. Su, P. Li, X. Wang, and W. Lin, “Ultrasound computed tomography based on full waveform inversion with source directivity calibration,”Ultrasonics, vol. 132, p. 107004, 2023
2023
-
[12]
Frequency-domain full-waveform inversion-based musculoskeletal ultrasound computed tomography,
C. Zhou, K. Xu, and D. Ta, “Frequency-domain full-waveform inversion-based musculoskeletal ultrasound computed tomography,” The Journal of the Acoustical Society of America, vol. 154, no. 1, pp. 279–294, 2023. [Online]. Available: https://doi.org/10.1121/10.0020151
2023 doi
-
[13]
Ultrasonic computed tomography based on full-waveform inversion for bone quan- titative imaging,
S. Bernard, V . Monteiller, D. Komatitsch, and P. Lasaygues, “Ultrasonic computed tomography based on full-waveform inversion for bone quan- titative imaging,”Physics in Medicine and Biology, vol. 62, no. 17, pp. 7011–7035, 2017
2017
-
[14]
Time domain reconstruction of sound speed and attenuation in ultrasound computed tomography using full wave inversion,
M. P ´erez-Liva, J. L. Herraiz, J. M. Ud´ıas, E. Miller, B. T. Cox, and B. E. Treeby, “Time domain reconstruction of sound speed and attenuation in ultrasound computed tomography using full wave inversion,”J Acoust Soc Am, vol. 141, no. 3, p. 1595, 2017
2017
-
[16]
U-net: Convolutional networks for biomedical image segmentation,
O. Ronneberger, P. Fischer, and T. Brox, “U-net: Convolutional networks for biomedical image segmentation,” inMedical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III
2015
-
[17]
U-FNO—an enhanced fourier neural operator-based deep-learning model for multiphase flow,
G. Wen, Z. Li, K. Azizzadenesheli, A. Anandkumar, and S. M. Benson, “U-FNO—an enhanced fourier neural operator-based deep-learning model for multiphase flow,”Advances in Water Resources, vol. 163, p. 104180, 2022. [Online]. Available: https://www.sciencedirect.com/ science/art...
2022
-
[18]
Springer, 2015, pp. 234–241
2015
-
[19]
Deep born operator learning for reflection tomographic imaging,
Q. Zhao, Y . Ma, P. Boufounos, S. Nabi, and H. Mansour, “Deep born operator learning for reflection tomographic imaging,” inICASSP, 2023
2023
-
[20]
Adaptive fourier neural operators: Efficient token mixers for transformers,
J. Guibas, M. Mardani, Z. Li, A. Tao, A. Anandkumar, and B. Catanzaro, “Adaptive fourier neural operators: Efficient token mixers for transformers,”arXiv, 2022. [Online]. Available: http: //arxiv.org/abs/2111.13587
2022 arXiv
-
[21]
Mgno: Efficient parameterization of linear operators via multigrid,
J. He, X. Liu, and J. Xu, “Mgno: Efficient parameterization of linear operators via multigrid,”arXiv preprint arXiv:2310.19809, 2023
2023 arXiv
-
[22]
InversionNet3d: Efficient and scalable learning for 3-d full-waveform inversion,
Q. Zeng, S. Feng, B. Wohlberg, and Y . Lin, “InversionNet3d: Efficient and scalable learning for 3-d full-waveform inversion,”IEEE Transac- tions on Geoscience and Remote Sensing, vol. 60, pp. 1–16, 2022
2022
-
[23]
DeepM&mnet: Inferring the electroconvection multiphysics fields based on operator approximation by neural networks,
S. Cai, Z. Wang, L. Lu, T. A. Zaki, and G. E. Karniadakis, “DeepM&mnet: Inferring the electroconvection multiphysics fields based on operator approximation by neural networks,”Journal of Computational Physics, vol. 436, p. 110296, 2021
2021
-
[24]
DeepONet prediction of linear instability waves in high-speed boundary layers,
P. C. Di Leoni, L. Lu, C. Meneveau, G. Karniadakis, and T. A. Zaki, “DeepONet prediction of linear instability waves in high-speed boundary layers,”arXiv, 2021
2021
-
[25]
Operator learning for predicting multiscale bubble growth dynamics,
C. Lin, Z. Li, L. Lu, S. Cai, M. Maxey, and G. E. Karniadakis, “Operator learning for predicting multiscale bubble growth dynamics,”J Chem Phys, vol. 154, no. 10, p. 104118, 2021
2021
-
[26]
Fourier-DeepONet: Fourier- enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustness,
M. Zhu, S. Feng, Y . Lin, and L. Lu, “Fourier-DeepONet: Fourier- enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustness,”Computer Methods in Applied Mechanics and Engineering, vol. 416, p. 116300, 2023. [Online]. Av...
2023 arXiv
-
[27]
Neural inverse operators for solving pde inverse problems,
R. Molinaro, Y . Yang, B. Engquist, and S. Mishra, “Neural inverse operators for solving pde inverse problems,” inInternational Conference on Machine Learning. PMLR, 2023, pp. 25 105–25 139
2023
-
[28]
Gradient-based learning applied to document recognition,
Y . LeCun, L. Bottou, Y . Bengio, and P. Haffner, “Gradient-based learning applied to document recognition,”Proceedings of the IEEE, vol. 86, no. 11, pp. 2278–2324, 1998
1998
-
[29]
3-d stochastic numerical breast phantoms for enabling virtual imaging trials of ultrasound computed tomography,
F. L. et al., “3-d stochastic numerical breast phantoms for enabling virtual imaging trials of ultrasound computed tomography,”IEEE trans- actions on ultrasonics, ferroelectrics, and frequency control, vol. 69, no. 1, pp. 135–146, 2021
2021
-
[31]
Neural born series operator for biomedical ultrasound computed tomography,
Z. Zeng, Y . Zheng, Y . Zheng, Y . Li, Z. Shi, and H. Sun, “Neural born series operator for biomedical ultrasound computed tomography,”arXiv preprint arXiv:2312.15575, 2023
2023 arXiv
-
[32]
Approximate separability of the green’s function of the helmholtz equation in the high frequency limit,
B. Engquist and H. Zhao, “Approximate separability of the green’s function of the helmholtz equation in the high frequency limit,”Com- munications on Pure and Applied Mathematics, vol. 71, no. 11, pp. 2220–2274, 2018
2018
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.