REVIEW 4 major objections 5 minor 51 references
A dual-output diffusion transformer generates OCT images and their masks together, beating DDPM and LDM baselines on fidelity and downstream segmentation.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · deepseek-v4-flash
2026-08-03 09:03 UTC pith:VL6VMV2G
load-bearing objection A useful, clearly written application of DiTs to joint OCT/mask synthesis; the contribution is real but the quantitative evidence is thinner than the abstract implies, mainly due to missing error bars and unvalidated mask-latent fidelity. the 4 major comments →
DualDiT: A Conditional Dual-Output Diffusion Transformer for Joint OCT Image and Segmentation Mask Generation
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The central claim is that joint image-mask generation benefits from moving the denoiser from a convolutional U-Net to a diffusion transformer while keeping both modalities in one shared latent and one denoising trajectory. DualDiT concatenates the VAE latents of image and mask channel-wise, conditions the DiT backbone on the embedding-medium class via adaLN-Zero, and denoises the 8-channel joint latent; after the trajectory, the latent is split into image and mask components and each is independently decoded. The paper reports that this design achieves the best generative fidelity among the compared diffusion baselines and, more importantly, that its synthetic pairs are the only ones that co
What carries the argument
The central mechanism is the joint latent tensor z0 = [zx ‖ zm], formed by channel-wise concatenation of the frozen VAE latents of the OCT image and its binary mask. A single DiT denoiser — transformer blocks with adaLN-Zero conditioning on timestep and class embeddings — predicts the noise on this 8-channel tensor, so the image and mask share one diffusion trajectory and are forced to be denoised coherently. At inference the recovered joint latent is split and each half is decoded by the same frozen VAE decoder. Because both outputs come from one trajectory, the paper argues, spatial and anatomical coincidence of image and mask is preserved by construction.
Load-bearing premise
The whole joint-generation claim rests on the assumption that a VAE trained on natural images provides a faithful and balanced latent representation for both greyscale OCT B-scans and binary masks, so that the shared denoising trajectory actually preserves anatomical alignment once decoded.
What would settle it
Reconstruct real masks with the frozen VAE encoder-decoder and measure Dice between input mask and reconstruction; if thin URCL boundaries are consistently lost or blurred in latent space (e.g., Dice well below the 0.9+ range achieved downstream), then the joint latent trajectory cannot be the source of the reported anatomical alignment, and the augmentation gains would not transfer to a VAE that faithfully encodes masks.
If this is right
- DualDiT's synthetic OCT image-mask pairs can serve as data augmentation: at +1200 pairs, held-out segmentation Dice rises from 0.908 to 0.927 and IoU from 0.838 to 0.868, with gains concentrated on the harder resin-embedded subset.
- Transformer-based joint diffusion outperforms the tested U-Net DDPM and LDM baselines on both FID and sFID, globally and per embedding medium, so the DiT backbone is a competitive architecture for structured image-plus-label synthesis.
- Conditioning on embedding medium is sufficient for the model to reproduce domain-specific appearance: experts classified resin vs physiological media on synthetic images at rates statistically indistinguishable from real ones (p > 0.5).
- The approach is scalable to higher resolutions at increased compute cost, so the same architecture extends beyond the 512×256 setting studied here.
Where Pith is reading between the lines
- Since the paper does not evaluate how well the frozen VAE reconstructs binary masks, a natural extension is to measure mask latent fidelity; if the VAE distorts thin URCL boundaries, the joint-trajectory advantage may be partly an artifact of the latent space rather than the DiT itself.
- The channel-concatenation design invites a direct ablation: training the same DiT with separate image and mask denoisers that share no joint trajectory would quantify how much of the alignment gain actually comes from the joint latent versus the transformer backbone.
- The reported gains are measured against a strong baseline (Dice 0.908); on datasets with weaker baselines or more diverse anatomies, the augmentation benefit could plausibly be larger, which is testable on accessible human OCT datasets.
- The expert misclassification rate of ~46% for synthetic samples came from a 100-pair sample; a larger blinded study would test whether perceptual realism persists at scale.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes DualDiT, a diffusion-transformer model that jointly generates OCT B-scans of ex vivo mouse retina and binary segmentation masks of the upper retinal cell layers, conditioned on the embedding medium (resin vs. physiological). Both image and mask are encoded with the frozen sd-vae-ft-ema VAE, concatenated channel-wise, denoised as a single 8-channel latent tensor, then split and independently decoded. The authors compare DualDiT against adapted DDPM and LDM baselines, reporting lower FID/sFID, a downstream U-Net segmentation improvement when synthetic pairs are added to the training set, and an expert evaluation in which 46% of synthetic pairs were mistaken for real. The main claims are that transformer-based joint diffusion beats U-Net-based DDPM/LDM baselines and that the synthetic pairs provide a consistent augmentation benefit.
Significance. If the claims hold, the paper makes a useful contribution by extending DiT-based joint image-mask generation to a scarce-data medical imaging setting and by providing a systematic augmentation study with a held-out volume-level split, code release, and expert assessment. The per-B-scan analysis and the sweep over augmentation sizes are strengths. However, the central empirical claims currently rest on a small dataset, single-run comparisons, and an unvalidated assumption that a natural-image VAE latent space faithfully represents binary masks and preserves image-mask alignment. These issues are addressable and do not invalidate the approach, but they must be fixed before the conclusions can be considered established.
major comments (4)
- [§3, Eq. (5); §4.2] The joint-generation claim rests on two unvalidated premises: that the frozen sd-vae-ft-ema codec trained on natural images reconstructs binary masks with high fidelity, and that channel-wise concatenation (Eq. 1) followed by independent decoding (Eq. 5) preserves spatial alignment between generated image and mask. No mask latent reconstruction metric is reported. Table 3 scores images only; Table 4 is indirect and the confidence-weighted teacher loss down-weights uncertain synthetic regions, so modest Dice gains can coexist with systematically misaligned masks. Please add (i) encode-decode Dice/IoU of real masks, (ii) a quantitative alignment measure between generated image-mask pairs (e.g., distance from mask boundary to predicted URCL edges), and (iii) failure cases.
- [§5.2, Table 4] The central augmentation claim ("consistently improves the Baseline") is not statistically supported. Best DualDiT global Dice 0.927±0.048 vs. Baseline 0.908±0.066 and IoU 0.868±0.081 vs. 0.838±0.106; the intervals overlap. Table 4 reports one training run per condition (no seeds), and no paired test on the 61 test B-scans is given even though Fig. A.7 provides per-B-scan data. Report paired significance tests (e.g., Wilcoxon signed-rank), CIs on the mean difference, and re-runs with different seeds; otherwise the 2-3.5% improvement could be noise.
- [§4.2, Training hyper-parameters] The three compared models use different total epochs (DDPM 6000, LDM 9500, DualDiT 5000), described as achieving "optimal hyper-parameters" with no selection criterion given. If epoch/checkpoint selection used the same FID or downstream metric employed for the final comparison, the comparison is biased. State the model-selection protocol (e.g., validation FID, fixed checkpoint schedule) and ideally match compute or show a learning curve for baselines. Without this, the FID advantage in Table 3 cannot be attributed to architecture.
- [§5.3, Figure 5] The expert study's headline percentages aggregate only 50 synthetic and 50 real pairs judged by three experts, and no chance-level comparison or confidence intervals are given for the 46%/42% misclassification rates. Reporting per-expert counts and a binomial test would clarify whether the rates differ from chance. The embedding-medium AUC comparisons (Table 5) have wide uncertainty despite non-significant p-values.
minor comments (5)
- [Table 3] FID/sFID are point estimates with no seeds or confidence intervals; state the number of generated samples used and repeat sampling seeds.
- [§5.2 and §6] The relative improvement is given as 2.09%/3.58% in §5.2 and 2.07%/3.50% in §6; harmonize the numbers.
- [Eq. (7)] The notation for the BCE term is undefined; clarify the exact form of L_BCE and how α=0.5 weights it against Dice.
- [§4.3.1] sFID is not precisely defined; cite the exact implementation and state whether it uses the same Inception features as FID.
- [Figures A.1-A.6] The qualitative overlays are not an alignment check; add scale bars and, if possible, quantitative edge-error measurements.
Circularity Check
No significant circularity: DualDiT's claims are empirical and evaluated on held-out real data; remaining concerns are validation gaps, not reductions to inputs.
full rationale
Walking the paper's derivation chain, no load-bearing step reduces to its own inputs. The joint latent construction z0=[zx||zm] (Eq. 1) and the split-and-decode step (Eq. 5) are design choices, not derived predictions; the claim that they preserve anatomical coherence is asserted qualitatively, and the unmeasured fidelity of the frozen natural-image VAE for binary masks is a validity risk, not a circular reduction. Training optimizes the standard noise-prediction objective (Eq. 3) with no fitted parameter later renamed as a prediction. Generative quality is assessed with externally defined FID/sFID using a pretrained Inception network and OpenAI's evaluation pipeline, not with quantities derived from the model's own training objective. Downstream segmentation is evaluated on a strictly held-out real test set, with all augmentation methods (DDPM, LDM, DualDiT) treated under the same training protocol and the same teacher-student confidence weighting. The self-citations present in the paper ([19], [20], [23], [24], [42], [49]) support data provenance, background, and a method borrowed from a different application; none is invoked as a uniqueness theorem, none forbids alternatives, and none supplies the central generative or segmentation claim. The paper's own limitation statements acknowledge small dataset size and the need for further validation, which reinforces that the reported improvements are empirical rather than forced by construction. No circular step was found.
Axiom & Free-Parameter Ledger
free parameters (5)
- n_synth (augmentation set size) =
1200 (best global Dice/IoU)
- Noise schedule endpoints =
beta_start=1.5e-4, beta_end=1.95e-2 (linear)
- CFG unconditional probability =
0.1
- Training epochs per model =
DualDiT 5000, DDPM 6000, LDM 9500
- EMA decay =
0.9999
axioms (5)
- standard math The DDPM forward/reverse process and noise-prediction objective (Eq. 3) with T=1000 produce valid samples.
- domain assumption A VAE trained on natural images (sd-vae-ft-ema) is a valid encoder/decoder for OCT images and binary masks.
- domain assumption Channel-wise concatenation of image and mask latents in one denoising trajectory is sufficient to enforce anatomical alignment.
- domain assumption Inception-based FID/sFID is a meaningful realism metric for greyscale OCT images.
- domain assumption Volume-level splitting prevents inter-slice leakage, and manual URCL masks are correct ground truth.
read the original abstract
Background and Objective: Generating realistic medical images with anatomically accurate segmentation masks helps address the shortage of annotated data in medical imaging, particularly in optical coherence tomography (OCT) of mouse eyes, where manual retinal layer delineation is labour-intensive due to tiny structures and required expertise, resulting in scarce datasets. While diffusion models perform well in medical image synthesis, joint image-mask generation has relied mainly on U-Net-based denoisers, leaving diffusion transformers largely unexplored. Methods: We propose a conditional dual-output Diffusion Transformer (DualDiT) for joint synthesis of OCT B-scans and segmentation masks of the upper retinal cell layers in ex vivo mouse retina. DualDiT encodes both modalities into a shared latent space via a pretrained VAE, concatenates their latent representations, and performs conditional diffusion over the joint tensor. We compared DualDiT against two adapted diffusion baselines: DDPM and LDM. Generative quality was assessed via Fr\'echet Inception Distance (FID) and spatial FID (sFID); practical utility via synthetic data augmentation for downstream U-Net segmentation; and perceptual realism via evaluation by three domain experts. Results: DualDiT achieved the best generative quality (FID 56.14, sFID 114.35), outperforming DDPM and LDM. Expert panels misclassified 46% of synthetic samples as real and 42% of real samples as synthetic. Adding DualDiT-generated images and masks improved Dice and IoU scores on a held-out segmentation test set. Conclusions: DualDiT shows that transformer-based diffusion models can effectively learn the joint distribution of OCT images and segmentation masks, surpassing DDPM- and LDM-based baselines in generative fidelity, downstream utility, and perceptual realism, highlighting its potential for data augmentation in annotation-scarce medical imaging.
Figures
Reference graph
Works this paper leans on
-
[1]
A. Kebaili, J. Lapuyade-Lahorgue, S. Ruan, Deep learning ap- proachesfordataaugmentationinmedicalimaging:Areview,Journal of Imaging 9 (2023). doi:10.3390/jimaging9040081
-
[2]
P.Celard,E.L.Iglesias,J.M.Sorribes-Fdez,R.Romero,A.S.Vieira, L. Borrajo, A survey on deep learning applied to medical images: fromsimpleartificialneuralnetworkstogenerativemodels35(2023) 2291–2323. doi:10.1007/s00521-022-07953-4
-
[3]
P. Chlap, H. Min, N. Vandenberg, J. Dowling, L. Holloway, A. Ha- worth, A review of medical image data augmentation techniques for deep learning applications 65 (2021) 545–563. doi:10.1111/1754-948 5.13261
- [4]
-
[5]
doi:10.1016/ j.ijmedinf.2025.105903
C.Oulmalme,H.Nakouri,F.Jaafar,Asystematicreviewofgenerative AI approaches for medical image enhancement: Comparing GANs, transformers, and diffusion models 199 (2025) 105903. doi:10.1016/ j.ijmedinf.2025.105903
arXiv 2025
- [6]
-
[7]
Isola, J.-Y
P. Isola, J.-Y. Zhu, T. Zhou, A. A. Efros, Image-to-image translation with conditional adversarial networks, 2017, pp. 1125–1134. URL: https://openaccess.thecvf.com/content_cvpr_2017/html/Isola_Image -To-Image_Translation_With_CVPR_2017_paper.html
2017
-
[8]
G. Yang, S. Yu, H. Dong, G. Slabaugh, P. L. Dragotti, X. Ye, F. Liu, S. Arridge, J. Keegan, Y. Guo, et al., Dagan: deep de- aliasing generative adversarial networks for fast compressed sensing mri reconstruction, IEEE transactions on medical imaging 37 (2017) 1310–1321. doi:https://doi.org/10.1109/TMI.2017.2785879
arXiv 2017
-
[9]
D. P. Kingma, M. Welling, An introduction to variational autoen- coders 12 (2019) 307–392. doi:10.1561/2200000056
-
[10]
Z. Rguibi, A. Hajami, D. Zitouni, M. Yassine, A. Elqaraoui, Medical variational autoencoder and generative adversarial network for medi- cal imaging 32 (2023) 1–1x. doi:10.11591/ijeecs.v32.i1.pp494-505
-
[11]
Y. Shi, A. Abulizi, H. Wang, K. Feng, N. Abudukelimu, Y. Su, H. Abudukelimu, Diffusion models for medical image computing: A survey 30 (2025) 357–383. doi:10.26599/TST.2024.9010047
arXiv 2025
-
[12]
Müller-Franzes, J
G. Müller-Franzes, J. M. Niehues, F. Khader, S. T. Arasteh, C. Haar- burger, C. Kuhl, T. Wang, T. Han, T. Nolte, S. Nebelung, et al., A multimodal comparison of latent denoising diffusion probabilistic models and generative adversarial networks for medical image syn- thesis, Scientific reports 13 (2023) 12098. doi:https://doi.org/10.1 038/s41598-023-39278-0
2023
-
[13]
J. Ho, A. Jain, P. Abbeel, Denoising diffusion probabilistic models, in: Advances in Neural Information Processing Systems, volume 33, Curran Associates, Inc., 2020, pp. 6840–6851. URL:https://procee dings.neurips.cc/paper_files/paper/2020/file/4c5bcfec8584af0d967 f1ab10179ca4b-Paper.pdf
2020
-
[14]
R. Rombach, A. Blattmann, D. Lorenz, P. Esser, B. Ommer, High- resolution image synthesis with latent diffusion models, 2022. doi:10 .48550/arXiv.2112.10752.arXiv:2112.10752 [cs]
-
[15]
W. Wang, J. Xia, G. Luo, S. Dong, X. Li, J. Wen, S. Li, Diffusion model for medical image denoising, reconstruction and translation 124 (2025) 102593. doi:10.1016/j.compmedimag.2025.102593
arXiv 2025
-
[16]
S. Chataut, S. Bhatta, B. Dahal, G. Ojha, S. Raut, B. Subedi, B. Bas- takoti, Generative artificial intelligence in healthcare: A system- atic review of GANs, diffusion models, large language models, and variational autoencoders for medical applications 3 (2025) 182–203. doi:10.59324/ejaset.2025.3(4).16
-
[17]
A. F. Fercher, W. Drexler, C. K. Hitzenberger, T. Lasser, Optical co- herencetomography-principlesandapplications, Reportsonprogress in physics 66 (2003) 239–303. doi:10.1088/0034-4885/66/2/204
-
[18]
M. A. Mayer, J. Hornegger, C. Y. Mardin, R. P. Tornow, Retinal nervefiberlayersegmentationonfd-octscansofnormalsubjectsand glaucoma patients, Biomedical optics express 1 (2010) 1358–1383. doi:https://doi.org/10.1364/BOE.1.001358
-
[19]
S. Morales, A. Colomer, J. M. Mossi, R. del Amor, D. Woldbye, K. Klemp, M. Larsen, V. Naranjo, Retinal layer segmentation in rodent OCT images: Local intensity profiles & fully convolutional neuralnetworks198(2021)105788.doi:10.1016/j.cmpb.2020.105788
arXiv 2021
-
[20]
R. D. Amor, S. Morales, A. N. Colomer, J. M. Mossi, D. Woldbye, K. Klemp, M. Larsen, V. Naranjo, Towards automatic glaucoma assessment: An encoder-decoder CNN for retinal layer segmentation in rodent OCT images, in: 2019 27th European Signal Processing Conference (EUSIPCO), IEEE, 2019, pp. 1–5. doi:10.23919/EUSIPCO .2019.8902794
arXiv 2019
-
[21]
R. S. Allen, K. Bales, A. Feola, M. T. Pardue, In vivo structural assessments of ocular disease in rodent models using optical coher- ence tomography, Journal of visualized experiments: JoVE (2020) 10–3791. doi:10.3791/61588
-
[22]
Tschernig, L
T. Tschernig, L. Thrane, T. M. Jørgensen, J. Thommes, R. Pabst, T. Yelbuz, An elegant technique for ex vivo imaging in experimental research—optical coherence tomography (oct), Annals of Anatomy- Anatomischer Anzeiger 195 (2013) 25–27. doi:https://doi.org/10.1 016/j.aanat.2012.07.005
2013
-
[23]
A. Barroso, P. Heiduschka, G. Nettels-Hackert, S. Ketelhut, R. d. Amor,F.García-Torres,S.Morales-Martínez,V.Naranjo,B.Kemper, J.Schnekenburger, Durableexvivomouseretina3dtissuemodelsfor optical coherence tomography, in: Label-free Biomedical Imaging and Sensing (LBIS) 2024, volume 12854, SPIE, 2024, pp. 21–23. doi:10.1117/12.3002538
-
[24]
F. García-Torres, R. del Amor, S. Morales-Martínez, A. Barroso, B. Kemper, J. Schnekenburger, V. Naranjo, Using diffusion models for data augmentation on limited rodent oct datasets, in: Intelligent Data Engineering and Automated Learning – IDEAL 2024: 25th International Conference, Valencia, Spain, November 20–22, 2024, Proceedings, Part I, Springer-Verl...
-
[25]
Y. Tian, A. McCarthy, G. Gomide, N. Liddle, J. Golebka, R. Chen, J. Liebmann, K. Thakoor, OCTDiff: Bridged diffusion model for portable OCT super-resolution and enhancement 38 (2026) 41445– 41465
2026
-
[26]
N.Abbasi,A.Wong,K.Bizheva,Aphysics-informeddiffusionmodel for super-resolved reconstruction of optical coherence tomography data 72 (2025) 2937–2946. doi:10.1109/TBME.2025.3556794
arXiv 2025
-
[27]
H.Ahmed,Q.Zhang,R.Donnan,A.Alomainy, Denoisingofoptical coherencetomographyimagesinophthalmologyusingdeeplearning: A systematic review 10 (2024) 86. doi:10.3390/jimaging10040086. F. García-Torres et al.:Preprint submitted to ElsevierPage 13 of 21 Conditional Dual-Output Diffusion Transformer (DualDiT)
-
[28]
S. Li, M. Dan, Y. Chu, J. Yu, Y. Zhao, P. Zhao, RetiDiff: Diffusion- based synthesis of retinal OCT images for enhanced segmentation, in: J. C. Gee, D. C. Alexander, J. Hong, J. E. Iglesias, C. H. Sudre, A. Venkataraman, P. Golland, J. H. Kim, J. Park (Eds.), Medical Image Computing and Computer Assisted Intervention – MICCAI 2025, Springer Nature Switzer...
2025
-
[29]
Y. Wu, W. He, D. Eschweiler, N. Dou, Z. Fan, S. Mi, P. Walter, J. Stegmaier, Retinal OCT synthesis with denoising diffusion prob- abilistic models for layer segmentation, in: 2024 IEEE International Symposium on Biomedical Imaging (ISBI), 2024, pp. 1–5. doi:10.1 109/ISBI56570.2024.10635836
arXiv 2024
-
[30]
K. Du, U. Doshi, B. DiCenzo, J. Jiang, E. Wu, A. Gadari, S. C. Vupparaboina,E.Sadeghi,S.C.Bollepalli,J.-A.Sahel,J.Chhablani, K.K.Vupparaboina,Benchmarkingdiffusionmodelsagainststate-of- the-artarchitecturesforOCTfluidbiomarkersegmentation20(2025) e0335615. doi:10.1371/journal.pone.0335615
-
[31]
K. Huang, X. Ma, Y. Zhang, N. Su, S. Yuan, Y. Liu, Q. Chen, H. Fu, Memory-efficient high-resolution OCT volume synthesis withcascadedamortizedlatentdiffusionmodels, in:M.G.Linguraru, Q. Dou, A. Feragen, S. Giannarou, B. Glocker, K. Lekadir, J. A. Schnabel (Eds.), Medical Image Computing and Computer Assisted Intervention–MICCAI2024,SpringerNatureSwitzerla...
-
[32]
R. H. Badhon, A. C. Thompson, J. I. Lim, T. Leng, M. N. Alam, Diffusion model based OCT to OCTA translation 12 (2025). doi:10 .3389/fmed.2025.1655453
arXiv 2025
-
[33]
B. Yang, J. Li, J. Wang, R. Li, K. Gu, B. Liu, DiffusionDCI: A novel diffusion-based unified framework for dynamic full-field OCT image generationandsegmentation12(2024)37702–37714.doi:10.1109/AC CESS.2024.3372863
arXiv 2024
-
[34]
Toker, M
A. Toker, M. Eisenberger, D. Cremers, L. Leal-Taixé, SatSynth: Augmenting image-mask pairs through diffusion models for aerial semantic segmentation, 2024, pp. 27695–27705. URL:https://op enaccess.thecvf.com/content/CVPR2024/html/Toker_SatSynth_Augment ing_Image-Mask_Pairs_through_Diffusion_Models_for_Aerial_Semant ic_CVPR_2024_paper.html
2024
-
[35]
J. Mao, Y. Wang, Y. Tang, D. Xu, K. Wang, Y. Yang, Z. Zhou, Y. Zhou, MedSegFactory: Text-guided generation of medical image- maskpairs, 2025,pp.21525–21535.URL:https://openaccess.thecv f.com/content/ICCV2025/html/Mao_MedSegFactory_Text-Guided_Genera tion_of_Medical_Image-Mask_Pairs_ICCV_2025_paper.html
2025
-
[36]
Y.Frisch,C.Bornberg,M.Fuchs,A.Mukhopadhyay, GAUDA:Gen- erativeadaptiveuncertainty-guideddiffusion-basedaugmentationfor surgical segmentation, in: 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2025, pp. 3762–3771. doi:10.1109/WACV61041.2025.00370, ISSN: 2642-9381
arXiv 2025
-
[37]
W. Wu, Y. Zhao, M. Z. Shou, H. Zhou, C. Shen, DiffuMask: Synthe- sizingimageswithpixel-levelannotationsforsemanticsegmentation using diffusion models, 2023, pp. 1206–1217. URL:https://openac cess.thecvf.com/content/ICCV2023/html/Wu_DiffuMask_Synthesizing_ Images_with_Pixel-level_Annotations_for_Semantic_Segmentation_U sing_ICCV_2023_paper.html
2023
-
[38]
Z. Li, Q. Zhou, X. Zhang, Y. Zhang, Y. Wang, W. Xie, Open- vocabulary object segmentation with diffusion models, 2023, pp. 7667–7676. URL:https://openaccess.thecvf.com/content/ICCV 2023/html/Li_Open-vocabulary_Object_Segmentation_with_Diffusion _Models_ICCV_2023_paper.html
2023
-
[39]
J. H. Park, K. Jo, S. Baik, SeeDiff: Off-the-shelf seeded mask generation from diffusion models 39 (2025) 6406–6415. doi:10.160 9/aaai.v39i6.32686
2025
-
[40]
URL:https://huggin gface.co/stabilityai/sd-vae-ft-ema
stabilityai/sd-vae-ft-ema·hugging face, 2022. URL:https://huggin gface.co/stabilityai/sd-vae-ft-ema
2022
-
[41]
Peebles, S
W. Peebles, S. Xie, Scalable diffusion models with transformers, 2023, pp. 4195–4205. URL:https://openaccess.thecvf.com/cont ent/ICCV2023/html/Peebles_Scalable_Diffusion_Models_with_Transfo rmers_ICCV_2023_paper.html
2023
-
[42]
A. Barroso, S. Ketelhut, G. Nettels-Hackert, P. Heiduschka, R. d. Amor,V.Naranjo,B.Kemper,J.Schnekenburger, Durable3dmurine exvivoretinaglaucomamodelsforopticalcoherencetomography14 (2023) 4421–4438. doi:10.1364/BOE.494271
-
[43]
D. P. Kingma, J. Ba, Adam: A method for stochastic optimization,
-
[44]
J. Ho, T. Salimans, Classifier-free diffusion guidance, 2022. URL: https://arxiv.org/abs/2207.12598.arXiv:2207.12598
Pith/arXiv arXiv 2022
-
[45]
Heusel, H
M. Heusel, H. Ramsauer, T. Unterthiner, B. Nessler, S. Hochreiter, GANs trained by a two time-scale update rule converge to a local nash equilibrium, in: Advances in Neural Information Processing Systems, volume 30, Curran Associates, Inc., 2017. URL:https: //proceedings.neurips.cc/paper/2017/hash/8a1d694707eb0fefe65 871369074926d-Abstract.html
2017
-
[46]
P. Dhariwal, A. Nichol, Diffusion models beat GANs on image synthesis, 2021. doi:10.48550/arXiv.2105.05233.arXiv:2105.05233 [cs]
-
[47]
O. Ronneberger, P. Fischer, T. Brox, U-net: Convolutional networks forbiomedicalimagesegmentation,in:N.Navab,J.Hornegger,W.M. Wells,A.F.Frangi(Eds.),MedicalImageComputingandComputer- Assisted Intervention – MICCAI 2015, Springer International Pub- lishing, 2015, pp. 234–241. doi:10.1007/978-3-319-24574-4_28
-
[48]
doi:https://doi.org/10.1016/j.media.2021.10203 5
J.Ma,J.Chen,M.Ng,R.Huang,Y.Li,C.Li,X.Yang,A.L.Martel, Lossodysseyinmedicalimagesegmentation, Medicalimageanalysis 71 (2021) 102035. doi:https://doi.org/10.1016/j.media.2021.10203 5
arXiv 2021
-
[49]
R. del Amor, A. Colomer, S. Morales, C. Pulgarín-Ospina, L. Ter- radez, J. Aneiros-Fernandez, V. Naranjo, A self-contrastive learning framework for skin cancer detection using histological images, in: 2022 IEEE International Conference on Image Processing (ICIP), 2022, pp. 2291–2295. doi:10.1109/ICIP46576.2022.9897435
arXiv 2022
-
[50]
doi:https://doi.org/10.1186/s13104-022-06096-y
D.Müller,I.Soto-Rey,F.Kramer, Towardsaguidelineforevaluation metrics in medical image segmentation, BMC research notes 15 (2022) 210. doi:https://doi.org/10.1186/s13104-022-06096-y. A. Qualitative Results of Joint Synthetic Image and Mask Generation F. García-Torres et al.:Preprint submitted to ElsevierPage 14 of 21 Conditional Dual-Output Diffusion Trans...
-
[2017]
doi:10.48550/arXiv.141 2.6980.arXiv:1412.6980 [cs.LG]
URL:http://arxiv.org/abs/1412.6980. doi:10.48550/arXiv.141 2.6980.arXiv:1412.6980 [cs.LG]
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.