PET-Adapter: Test-Time Domain Adaptation for Full and Limited-Angle PET Image Reconstruction
Pith reviewed 2026-05-11 02:34 UTC · model grok-4.3
The pith
PET-Adapter adapts generative models pretrained on phantom data to clinical PET scans at test time without paired ground truth.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
PET-Adapter achieves superior 3D reconstruction performance on multiple clinical datasets for both full-angle and limited-angle PET by performing test-time adaptation of phantom-pretrained generative models, using layer-wise low-rank anatomical conditioning during adaptation and OSEM-based warm-starting to initialize generation from physics-informed reconstructions, thereby reducing diffusion steps from 50 to 2 without compromising quality.
What carries the argument
Layer-wise low-rank anatomical conditioning paired with OSEM-based warm-starting inside the PET-Adapter test-time adaptation framework, which bridges phantom-to-clinical distribution gaps by conditioning the generative model on anatomical features and starting from physics-based reconstructions without needing paired ground truth.
If this is right
- Reconstruction quality improves on clinical data without requiring paired ground truth or full model retraining for each new setup.
- Computational cost drops sharply because diffusion sampling is reduced from 50 steps to 2 steps while maintaining or increasing image fidelity.
- Performance gains hold for both complete and limited-angle acquisitions across multiple clinical datasets.
- The approach supports adaptation to different patient anatomies, tracers, and scanner geometries at inference time.
Where Pith is reading between the lines
- Hospitals could deploy the same base model across equipment from different vendors with only brief per-patient adaptation.
- The same conditioning-plus-warm-start pattern might apply to other tomographic modalities such as SPECT or cone-beam CT.
- Further reduction in adaptation time could be tested by replacing the low-rank layers with even lighter parameter-efficient modules.
Load-bearing premise
That low-rank anatomical conditioning and OSEM warm-starting alone can reliably shift a phantom-pretrained generative model to new clinical distributions across varying anatomies, tracers, and scanners without any paired ground truth.
What would settle it
A new clinical dataset with an unseen tracer or scanner configuration where the PET-Adapter output shows equal or lower quantitative metrics than the unadapted phantom model or a supervised baseline trained on clinical data.
Figures
read the original abstract
Positron Emission Tomography (PET) image reconstruction is inherently challenged by Poisson noise and physical degradation factors, which are further exacerbated in limited-angle acquisitions. While deep learning methods demonstrate promising performance, their generalization to unseen clinical data distributions remains limited without extensive retraining. We propose PET-Adapter, a test-time domain adaptation framework for generative PET reconstruction models pretrained solely on phantom data. Our method enables adaptation to clinical datasets with varying anatomies, tracers, and scanner configurations without requiring paired ground truth. PET-Adapter introduces layer-wise low-rank anatomical conditioning during adaptation and Ordered Subset Expectation Maximization-based warm-starting that initializes the generation from physics-informed reconstructions, reducing diffusion steps from 50 to 2 without compromising quality. Experiments across multiple clinical datasets demonstrate superior 3D reconstruction performance in both full-angle and limited-angle settings, highlighting the clinical feasibility and computational efficiency of the proposed approach.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes PET-Adapter, a test-time domain adaptation framework for generative PET reconstruction models. The model is pretrained exclusively on phantom data and then adapted at test time to clinical datasets with varying anatomies, tracers, and scanner configurations. Key technical contributions include layer-wise low-rank anatomical conditioning during adaptation and OSEM-based warm-starting that initializes generation from physics-informed reconstructions, reducing the number of diffusion steps from 50 to 2. Experiments on multiple clinical datasets are reported to demonstrate superior 3D reconstruction performance in both full-angle and limited-angle settings, with emphasis on clinical feasibility and computational efficiency.
Significance. If the quantitative claims are substantiated with appropriate metrics and controls, the work addresses a practically important gap in medical imaging: enabling high-quality PET reconstruction under domain shift without paired ground-truth data or full retraining. The combination of test-time adaptation, low-rank conditioning, and physics-informed initialization could improve applicability of diffusion-based methods to real-world clinical scenarios, particularly limited-angle acquisitions where data is incomplete.
major comments (3)
- [§4.2] §4.2 (Evaluation Protocol): The central claim of superior performance on clinical datasets is load-bearing, yet the manuscript does not specify the quantitative metrics used to establish superiority in the absence of paired ground truth. Standard reference-based metrics (PSNR, SSIM, RMSE) cannot be computed without references; if no-reference or perceptual metrics are employed instead, their correlation with clinical utility and their ability to rank methods across anatomies/tracers must be validated with explicit controls.
- [§3.3 and Table 3] §3.3 and Table 3: The reduction from 50 to 2 diffusion steps via OSEM warm-starting is presented as preserving quality, but no ablation isolates the contribution of the warm-start versus the low-rank conditioning, nor are statistical significance tests (e.g., paired t-tests or Wilcoxon) reported across the multiple clinical datasets to support the 'superior' label.
- [§5.1] §5.1 (Limited-Angle Results): The limited-angle experiments claim clinical feasibility, but the manuscript provides no comparison against established limited-angle reconstruction baselines (e.g., iterative methods with total variation or other DL approaches) under matched computational budgets, leaving the magnitude of improvement unclear.
minor comments (2)
- Notation for the low-rank matrices in the conditioning module is introduced without an explicit dimension table, making it difficult to verify the parameter count reduction.
- Figure 4 caption does not state the exact number of clinical cases per dataset or the specific tracers used, which would aid reproducibility.
Simulated Author's Rebuttal
We thank the referee for the constructive and detailed feedback. We address each major comment point by point below, indicating where revisions will be made to improve the manuscript.
read point-by-point responses
-
Referee: [§4.2] §4.2 (Evaluation Protocol): The central claim of superior performance on clinical datasets is load-bearing, yet the manuscript does not specify the quantitative metrics used to establish superiority in the absence of paired ground truth. Standard reference-based metrics (PSNR, SSIM, RMSE) cannot be computed without references; if no-reference or perceptual metrics are employed instead, their correlation with clinical utility and their ability to rank methods across anatomies/tracers must be validated with explicit controls.
Authors: We agree that the evaluation protocol requires explicit clarification in the absence of ground truth. The manuscript demonstrates superiority primarily via qualitative visual comparisons, consistency with anatomical priors, and clinical feasibility metrics such as reduced artifacts and reconstruction time. In the revision, we will update §4.2 to clearly state the evaluation approach, acknowledge that standard reference-based metrics are inapplicable, and add a limited validation correlating no-reference perceptual metrics with radiologist preference scores on a small subset of cases to support ranking across datasets. revision: yes
-
Referee: [§3.3 and Table 3] §3.3 and Table 3: The reduction from 50 to 2 diffusion steps via OSEM warm-starting is presented as preserving quality, but no ablation isolates the contribution of the warm-start versus the low-rank conditioning, nor are statistical significance tests (e.g., paired t-tests or Wilcoxon) reported across the multiple clinical datasets to support the 'superior' label.
Authors: We concur that isolating contributions and adding statistical tests would strengthen the claims. We will revise §3.3 and Table 3 to include a dedicated ablation study separating the effects of OSEM warm-starting from layer-wise low-rank conditioning on step reduction and image quality. We will also report statistical significance via Wilcoxon signed-rank tests across the clinical datasets to support the superiority statements. revision: yes
-
Referee: [§5.1] §5.1 (Limited-Angle Results): The limited-angle experiments claim clinical feasibility, but the manuscript provides no comparison against established limited-angle reconstruction baselines (e.g., iterative methods with total variation or other DL approaches) under matched computational budgets, leaving the magnitude of improvement unclear.
Authors: We appreciate this observation on the need for stronger baselines. In the revised manuscript, we will expand §5.1 to include direct comparisons against established limited-angle methods such as OSEM with total variation regularization and relevant deep learning approaches, all evaluated under matched computational budgets (runtime and memory). This will better quantify the improvements in reconstruction quality and efficiency. revision: yes
Circularity Check
No circularity: claims rest on external experimental evaluation rather than self-referential definitions or fitted inputs
full rationale
The paper describes a test-time adaptation method (layer-wise low-rank anatomical conditioning plus OSEM warm-starting) pretrained on phantom data and applied to clinical distributions without paired ground truth. Superiority is asserted via experiments on multiple clinical datasets in full- and limited-angle settings. No equations or steps reduce a claimed prediction to a fitted parameter by construction, no uniqueness theorem is imported from self-citations, and no ansatz is smuggled via prior work. The central performance claims are therefore independent of the method's own inputs and rest on external data evaluation.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption Generative models pretrained solely on phantom data capture transferable principles that can be adapted to clinical PET distributions via test-time techniques without paired ground truth.
Lean theorems connected to this paper
-
IndisputableMonolith/Cost/FunctionalEquation.leanwashburn_uniqueness_aczel unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
PET-Adapter introduces layer-wise low-rank anatomical conditioning during adaptation and Ordered Subset Expectation Maximization-based warm-starting that initializes the generation from physics-informed reconstructions, reducing diffusion steps from 50 to 2
-
IndisputableMonolith/Foundation/RealityFromDistinction.leanreality_from_one_distinction unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
We define an adaptation objective Ladapt combining a measurement-based loss (Lp) and an MRI-driven anatomical loss (La)
-
IndisputableMonolith/Foundation/DimensionForcing.leanalexander_duality_circle_linking unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
Experiments across multiple clinical datasets demonstrate superior 3D reconstruction performance
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Reference graph
Works this paper leans on
-
[1]
IEEE Transactions on Medical Imaging25(11), 1410–1416 (2006)
Aubert-Broche, B., Griffin, M., Pike, G.B., Evans, A.C., Collins, D.L.: Twenty new digital brain phantoms for creation of validation image data bases. IEEE Transactions on Medical Imaging25(11), 1410–1416 (2006)
work page 2006
-
[2]
IEEE Transactions on Medical Imaging44(5), 2093–2104 (2025)
Barbano, R., Denker, A., Chung, H., Roh, T.H., Arridge, S., Maass, P., Jin, B., Ye, J.C.: Steerable conditional diffusion for out-of-distribution adaptation in medical image reconstruction. IEEE Transactions on Medical Imaging44(5), 2093–2104 (2025)
work page 2093
-
[3]
In: IEEE Symposium Conference Record Nuclear Science 2004
Bowsher, J.E., Yuan, H., Hedlund, L.W., Turkington, T.G., Akabani, G., Badea, A., Kurylo, W.C., Wheeler, C.T., Cofer, G.P., Dewhirst, M.W., et al.: Utilizing MRI information to estimate F18-FDG distributions in rat flank tumors. In: IEEE Symposium Conference Record Nuclear Science 2004. vol. 4, pp. 2488–2492 (2004)
work page 2004
-
[4]
Cherry, S.R., Dahlbom, M.: PET: Physics, Instrumentation, and Scanners. Springer (2006)
work page 2006
-
[5]
IEEE Transactions on Medical Imaging (2026)
Hashimoto, F., Gong, K.: Pet image reconstruction using deep diffusion image prior. IEEE Transactions on Medical Imaging (2026)
work page 2026
-
[6]
Radiological Physics and Technology17(1), 24–46 (2024)
Hashimoto, F., Onishi, Y., Ote, K., Tashima, H., Reader, A.J., Yamaya, T.: Deep learning-based PET image denoising and reconstruction: a review. Radiological Physics and Technology17(1), 24–46 (2024)
work page 2024
-
[7]
Physics in Medicine & Biology68(15), 155009 (2023)
Hashimoto, F., Onishi, Y., Ote, K., Tashima, H., Yamaya, T.: Fully 3D implemen- tation of the end-to-end deep image prior-based PET image reconstruction using block iterative algorithm. Physics in Medicine & Biology68(15), 155009 (2023)
work page 2023
-
[8]
IEEE Transactions on Medical Imaging13(4), 601–609 (1994)
Hudson, H.M., Larkin, R.S.: Accelerated image reconstruction using ordered subsets of projection data. IEEE Transactions on Medical Imaging13(4), 601–609 (1994)
work page 1994
-
[9]
In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition
Kim, G., Kwon, T., Ye, J.C.: Diffusionclip: Text-guided diffusion models for robust image manipulation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 2426–2435 (2022)
work page 2022
-
[10]
Physics in Medicine & Biology64(11), 115004 (2019)
Liu, C.C., Qi, J.: Higher SNR PET image prediction using a deep learning model and MRI image. Physics in Medicine & Biology64(11), 115004 (2019)
work page 2019
-
[11]
Applied Sciences12(16), 8118 (2022)
Liu, Z., Ye, H., Liu, H.: Deep-learning-based framework for PET image reconstruc- tion from sinogram domain. Applied Sciences12(16), 8118 (2022)
work page 2022
-
[12]
In: 20th International Conference on the use of Computers in Radiation Therapy, Lyon, France
Makkar, S., Ye, S., Béguin, M., Dissertori, G., Hrbacek, J., Lomax, A., McNamara, K., Ritzer, C., Weber, D.C., Xing, L., et al.: Partial-ring PET image correction using implicit neural representation learning. In: 20th International Conference on the use of Computers in Radiation Therapy, Lyon, France. pp. 8–11 (2024)
work page 2024
-
[13]
IEEE Transactions on Radiation and Plasma Medical Sciences5(1), 54–64 (2021)
Mehranian, A., Reader, A.J.: Model-based deep learning PET image reconstruction using forward–backward splitting expectation–maximization. IEEE Transactions on Radiation and Plasma Medical Sciences5(1), 54–64 (2021)
work page 2021
-
[14]
EJNMMI Research11(1), 91 (2021)
Mérida, I., Jung, J., Bouvard, S., Le Bars, D., Lancelot, S., Lavenne, F., Bouillot, C., Redouté, J., Hammers, A., Costes, N.: CERMEP-IDB-MRXFDG: a database of 37 normal adult human brain [18F] FDG PET, T1 and FLAIR MRI, and CT images available for research. EJNMMI Research11(1), 91 (2021)
work page 2021
-
[15]
IEEE Transactions on Medical Imaging 42(6), 1822–1834 (2023)
Ote, K., Hashimoto, F., Onishi, Y., Isobe, T., Ouchi, Y.: List-mode PET image reconstruction using deep image prior. IEEE Transactions on Medical Imaging 42(6), 1822–1834 (2023)
work page 2023
-
[16]
In: Proceedings of the AAAI Conference on Artificial Intelligence
Perez, E., Strub, F., De Vries, H., Dumoulin, V., Courville, A.: Film: Visual reasoning with a general conditioning layer. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol. 32 (2018) PET-Adapter 11
work page 2018
-
[17]
Physics in Medicine & Biology69(5), 055028 (2024)
Raj, J., Millardet, M., Krishnamoorthy, S., Karp, J.S., Surti, S., Matej, S.: Recovery of the spatially-variant deformations in dual-panel PET reconstructions using deep-learning. Physics in Medicine & Biology69(5), 055028 (2024)
work page 2024
-
[18]
NeuroImage124, 1260–1262 (2016)
Sawiak, S.J., Morton, A.J.: The cambridge MRI database for animal models of huntington disease. NeuroImage124, 1260–1262 (2016)
work page 2016
-
[19]
EJNMMI Research10(1), 105 (2020)
Schaefferkoetter, J., Yan, J., Ortega, C., Sertic, A., Lechtman, E., Eshet, Y., Metser, U., Veit-Haibach, P.: Convolutional neural networks for improving image quality with noisy PET data. EJNMMI Research10(1), 105 (2020)
work page 2020
-
[20]
Frontiers in Nuclear Medicine3, 1324562 (2024)
Schramm, G., Thielemans, K.: Parallelproj—an open-source framework for fast calculation of projections in tomography. Frontiers in Nuclear Medicine3, 1324562 (2024)
work page 2024
-
[21]
Machine Learning for Biomedical Imaging2, 547–585 (2024)
Singh, I.R., Denker, A., Barbano, R., Kereta, Ž., Jin, B., Thielemans, K., Maass, P., Arridge, S., et al.: Score-based generative models for PET image reconstruction. Machine Learning for Biomedical Imaging2, 547–585 (2024)
work page 2024
-
[22]
In: International Conference on Learning Representations (2021)
Song, J., Meng, C., Ermon, S.: Denoising diffusion implicit models. In: International Conference on Learning Representations (2021)
work page 2021
-
[23]
Song, Y., Sohl-Dickstein, J., Kingma, D.P., Kumar, A., Ermon, S., Poole, B.: Score- basedgenerativemodelingthroughstochasticdifferentialequations.In:International Conference on Learning Representations (2021)
work page 2021
-
[24]
In: European Conference on Computer Vision
Stracke, N., Baumann, S.A., Susskind, J., Bautista, M.A., Ommer, B.: CTRLorAL- Ter: conditional loradapter for efficient 0-shot control and altering of t2i models. In: European Conference on Computer Vision. pp. 87–103. Springer (2024)
work page 2024
-
[25]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Tumanyan, N., Geyer, M., Bagon, S., Dekel, T.: Plug-and-play diffusion features for text-driven image-to-image translation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 1921–1930 (2023)
work page 1921
-
[26]
Neural Computation23(7), 1661–1674 (2011)
Vincent, P.: A connection between score matching and denoising autoencoders. Neural Computation23(7), 1661–1674 (2011)
work page 2011
-
[27]
European Journal of Nuclear Medicine and Molecular Imaging pp
Volpi, T., Toyonaga, T., Khattar, N., Gallezot, J.D., Naganawa, M., Vanderlinden, G., Honhar, P., Zeng, T., Fontaine, K., Mulnix, T., et al.: Exceptional brain PET images from the NeuroEXPLORER: scans with targeted radiopharmaceuticals and comparison to HRRT. European Journal of Nuclear Medicine and Molecular Imaging pp. 1–12 (2025)
work page 2025
-
[28]
Webber, G., Hammers, A., King, A., Reader, A.: Steerable conditional diffusion for domain adaptation in PET image reconstruction. In: 2025 IEEE Nuclear Science Symposium (NSS), Medical Imaging Conference (MIC) and Room Temperature Semiconductor Detector Conference (RTSD). pp. 1–1. IEEE (2025)
work page 2025
-
[29]
BJR| Artificial Intelligence1(1), ubae013 (2024)
Webber, G., Reader, A.J.: Diffusion models for medical image reconstruction. BJR| Artificial Intelligence1(1), ubae013 (2024)
work page 2024
-
[30]
Journal of Medical Imaging7(3), 032503–032503 (2020)
Whiteley, W., Luk, W.K., Gregor, J.: Directpet: full-size neural network PET reconstruction from sinogram data. Journal of Medical Imaging7(3), 032503–032503 (2020)
work page 2020
-
[31]
Physics in Medicine & Biology69(15), 155019 (2024)
Xie, T., Cui, Z.X., Luo, C., Wang, H., Liu, C., Zhang, Y., Wang, X., Zhu, Y., Chen, G., Liang, D., et al.: Joint diffusion: mutual consistency-driven diffusion model for PET-MRI co-reconstruction. Physics in Medicine & Biology69(15), 155019 (2024)
work page 2024
-
[32]
Yilmaz, R., Thull, J., Stegmaier, J., Schulz, V.: Diffusion-based sinogram interpo- lation for limited angle PET. In: 2025 IEEE Nuclear Science Symposium (NSS), MedicalImagingConference(MIC)andRoomTemperatureSemiconductorDetector Conference (RTSD). pp. 1–1 (2025)
work page 2025
-
[33]
In: International Conference on Medical Image Computing and Computer-Assisted Intervention
Yilmaz, R., Chen, Z., Wu, Y., Stegmaier, J.: Cellstyle: Improved zero-shot cell segmentation via style transfer. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. pp. 67–77. Springer (2025) 12 Yilmaz et al
work page 2025
-
[34]
Journal of Nuclear Medicine Technology46(2), 129–132 (2018)
Zeng, G.L.: Maximum-likelihood expectation-maximization algorithm versus win- dowed filtered backprojection algorithm: a case study. Journal of Nuclear Medicine Technology46(2), 129–132 (2018)
work page 2018
-
[35]
Zhang, M., Qin, Q., Zhang, S., Liu, W., Meng, H., Xu, M., Huang, X., Lin, X., Lin, M., Herman, P., et al.: Aerobic glycolysis imaging of epileptic foci during the inter-ictal period. EBioMedicine79(2022)
work page 2022
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.