Pith. sign in

REVIEW 3 major objections 6 minor 220 references

Prompt Mechanisms in Medical Imaging: A Comprehensive Survey

T0 review · 3 major / 6 minor · reviewed 2026-08-06 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read Prompt-based mechanisms are becoming the default way to adapt medical imaging AI, steering generation, segmentation, and classification with text, clicks, boxes, and learned embeddings.

desk verdict A useful narrative survey with a workable taxonomy, but the 'systematic' label is unsupported and the editorial slips need cleanup before it can be trusted as a reference index. read the letter →

arxiv 2507.01055 v1 pith:R452MKOY submitted 2025-06-28 eess.IV cs.AIcs.CV

Hao Yang , Xinlong Liang , Zhang Li , Yue Sun , Zheyu Hu , Xinghe Xie , Behdad Dashtbozorg , Jincheng Huang
show 7 more authors
Shiwei Zhu Luyi Han Jiong Zhang Shanshan Wang Ritse Mann Qifeng Yu Tao Tan
This is my paper
classification eess.IVcs.AIcs.CV
keywords promptengineeringmedicalimagesegmentationclassificationgenerationvision-languagemodelsfoundationvisualpromptslearnable
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This survey argues that prompt-based mechanisms — textual instructions, visual clicks or boxes, and learnable embedding vectors — have become a decisive way to adapt deep learning models to medical imaging, especially large vision-language and segmentation foundation models. The authors claim that prompting improves image generation, segmentation, and classification by injecting domain knowledge without full retraining, and that this makes models more accurate, more robust to data scarcity and distribution shifts, and more interpretable. They organize the field with a two-dimensional classification framework: the core technology behind a prompt (how it is designed, generated, and integrated) and the clinical task it serves. The review's central message is that prompt engineering is the path from single-task medical AI to flexible, multimodal generalist systems. The paper is a survey, so this claim rests on the completeness and representativeness of its literature synthesis.

What carries the argument

The organizing apparatus is a two-axis classification framework. One axis categorizes prompt mechanisms by their core technology: textual prompts encoded by biomedical language models, visual prompts such as points, boxes, and masks encoded by prompt encoders, and learnable or adaptive prompts such as prompt tokens, self-prompt modules, and domain-specific vectors. The other axis categorizes by clinical application: image generation, segmentation, and classification. Within this framework, the recurring technical machinery is a frozen pre-trained backbone — a vision-language model such as CLIP or a segmentation model such as SAM — with prompts injected at the input stage, through cross-attention, or into decoders, so that the prompt carries task-specific knowledge the backbone did not train on. The framework is what lets the authors compare methods that otherwise look very different and extract cross-cutting trends such as the shift from static text templates to learnable prompt vectors and the emergence of text-to-visual prompt conversion.

What would settle it

A systematic replication using a defined search protocol (databases, dates, inclusion and exclusion criteria) that identifies a substantial body of prompt-based medical imaging work the survey omits, or a period of publications whose distribution over prompt types and tasks contradicts the reported trend lines, would show the review's synthesis is not representative. The same replication could check the claim of exponential growth by counting prompt-driven medical imaging papers per quarter in a fixed set of venues and comparing to Figure 2.

Watch

Extended reading notes

Core claim

On the paper's own terms, the discovery is that a small external conditioning signal — a phrase, a point, a box, a learnable vector — can steer a pre-trained model toward a specific medical task while leaving most of the network frozen. Across the surveyed studies, prompts appear as a common mechanism in three task families: text-conditioned generation of chest X-rays, CT, MRI, pathology, and ultrasound; visual- and text-guided segmentation of organs, lesions, and nuclei, often built around SAM-style prompt encoders; and zero- or few-shot classification mediated by vision-language encoders such as CLIP and its medical variants. The paper claims this convergence is not incidental: prompting constrains the model's hypothesis space, modulates attention, and projects features toward task-relevant regions, which is why it can deliver task adaptation with parameter efficiency and improved robustness. The review further claims that the main obstacles are now prompt brittleness across scanners and institutions, non-standardized prompt design, and the need for scalable clinical deployment, and that future work should move toward multimodal, personalized, and automatically optimized prompts.

Load-bearing premise

The load-bearing premise is that the literature search is comprehensive and unbiased enough that the taxonomy, trends, and challenge list faithfully represent the whole field of prompt-based medical imaging; the paper does not disclose a search protocol, inclusion criteria, or quality assessment that would allow this to be checked.

Editorial extensions

If this is right

  • If the claim is right, prompt-based adaptation becomes a default interface for medical foundation models, allowing one model to serve multiple tasks and modalities by swapping prompts instead of retraining.
  • Prompt-driven generation can supply synthetic medical images for data augmentation and education, directly targeting the data-scarcity bottleneck described in the survey.
  • Text-guided segmentation and classification should keep improving with richer medical text encoders and hierarchical prompts, enabling zero-shot and few-shot workflows where pixel-level labels are scarce.
  • The identified obstacles — prompt brittleness under distribution shift and lack of standardized prompt evaluation — become the field's core research agenda, with prompt optimization and benchmarks as expected next steps.
  • Multimodal and personalized prompting should move medical AI toward systems that integrate images, reports, genomics, and patient history, supporting diagnostics and treatment planning.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The survey's taxonomy implies a testable ranking: prompt mechanisms can be compared by how much task knowledge they transfer per trainable parameter, a metric the reviewed papers rarely report uniformly.
  • The centrality of SAM and CLIP architectures suggests that medical-prompt research will co-evolve with generalist vision models; if those backbones change, prompt designs may need to be rebuilt.
  • An independent replication of the literature search — with explicit inclusion criteria — could verify whether the reported trends, such as the dominance of text prompts, reflect the actual publication distribution or a sampling bias.
  • Prompt brittleness across scanners is presented as a challenge, but the reviewed low-frequency and domain-prompt methods suggest a concrete research program: characterizing which prompt types are invariant to which distribution shifts.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 6 minor

Summary. This manuscript is a survey of prompt-based mechanisms in medical imaging. It proposes that prompts—text, visual, learnable, structural, and multimodal—can guide deep learning models toward improved generation, segmentation, and classification, particularly in data-scarce and distribution-shift settings. The paper is organized around the three clinical tasks, with additional sections on theoretical foundations, medical image foundation models, and future directions, and it includes five reference tables covering representative works in generation, segmentation, and classification. The central claims are that prompt mechanisms are a transformative advance in medical imaging and that the paper systematically surveys this landscape through a novel classification framework and trend analysis.

Significance. If taken as a narrative review, the manuscript is useful: it collects a large and recent body of work, organizes it in a mostly sensible task-based manner, and highlights relevant challenges such as prompt brittleness, lack of standardization, and clinical deployment. The discussion of foundation models in pathology, radiology, and ophthalmology is a helpful complement to the task-based tables. The self-citations do not appear to drive the conclusions, and the descriptions of specific methods are broadly consistent with the cited literature. However, the paper's value as a systematic survey is currently limited because the corpus behind the taxonomy, tables, and trend analysis is not auditable, and the promised two-dimensional classification framework is not actually operationalized in the body. The manuscript is best viewed as a broad narrative compilation with useful reference tables rather than as a reproducible systematic review.

major comments (3)
  1. [Introduction] The abstract and the contributions list describe the work as a systematic review, but the only methodological statement is 'Our approach involves an extensive literature search' in the Introduction. No databases, query terms, date range, screening rules, inclusion or exclusion criteria, or quality-assessment procedure are reported. As a result, the reference sets in Tables 1-5 cannot be reconstructed and the quantitative trend in Figure 2 is not a verifiable measurement. Please add a methods section or appendix with a search protocol and corpus-selection details, or revise the 'systematic' claim to describe a narrative survey.
  2. [Theoretical Foundations and Taxonomies of Prompt Mechanisms] The Introduction promises a classification system with two dimensions: 'the core technologies underpinning prompt mechanisms' and 'clinical application paradigms.' However, the body is organized exclusively by clinical task (generation, segmentation, classification) and by prompt modality; no section defines or applies the core-technology dimension (design, generation, integration, transfer/multimodal synergy), and the tables list only Reference, Year, Task, Prompt Type, and Link. Please add an explicit taxonomy with definitions and assign each included work to its categories, or revise the claim to describe a task-and-modality-based organization rather than a two-dimensional classification framework.
  3. [Figure 2] Figure 2 reports the 'Number of papers' per half-year from 2022-Q1/2 to 2025-Q1/2. Since the manuscript is dated June 2025, the final interval is necessarily partial, and the monotone growth shown cannot be checked without knowing the corpus, retrieval date, and inclusion rules. The figure should be accompanied by the underlying counts, the search and screening protocol that produced them, and a clear label that 2025-Q1/2 is a partial interval; otherwise the trend claim is not independently verifiable.
minor comments (6)
  1. [Introduction] The phrase 'intense learning models such as convolutional neural networks' should be 'deep learning models such as convolutional neural networks.'
  2. [Medical Image Segmentation (application section)] In the paragraph comparing visual and text prompts, the sentence beginning 'On the other hand, text-prompt-based models can be trained with multiple types and modalities of data simultaneously...' appears twice, with slightly different wording; please remove the duplicate.
  3. [Medical Image Foundation Models] The sentence 'Representative works in this area include references187, 188, 188, 189, 189, 190' contains repeated citation numbers; please clean up the citation list.
  4. [References] References 21 and 60 (and references 13 and 67) appear to be the same works cited under different numbers; please merge or cross-reference them to avoid duplication.
  5. [Table 4] The row for Huang et al. 141 has an empty Prompt Type entry; please fill in the value or mark it as not applicable so that the table is self-consistent.
  6. [Figure 2] Please state the retrieval date for the literature corpus and label the 2025-Q1/2 bar as partial data, since the manuscript is dated June 2025.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity found: the survey makes no predictions, fits no parameters, and its central organizational claims do not reduce to its inputs.

full rationale

This paper is a narrative literature survey; it contains no derivation chain, no fitted quantities, and no predictive claim whose output could equal an input by construction. The central claim that prompt mechanisms improve medical image generation, segmentation, and classification is supported by citing external, independently published methods (e.g., MedSAM, the CLIP-driven Universal Model, BiomedCLIP) and by summarizing their reported results. The proposed taxonomy (core technologies vs. clinical applications) is an organizational scheme, not a derived result; it does not pretend to be entailed by the surveyed papers. Figure 2 reports a paper count from the authors' literature corpus; although the search is not described in enough detail to reproduce, that is an auditability limitation rather than circularity, because the trend line is a descriptive statistic of the collected corpus and not a validation of a claim by the same data in a way that is forced by definition. Some cited works are authored by members of the survey team (e.g., refs. 39, 40, and 206 by Luyi Han and colleagues), but these citations are used as examples of sequence prompting and multi-sequence MRI synthesis; the survey's own conclusions do not load on the correctness of those specific papers. No uniqueness theorem, self-citation chain, or ansatz-smuggling step is invoked to forbid alternatives or to justify the framework. The honest finding is therefore no significant circularity, with the caveat that the 'systematic' label needs a reported search protocol to be independently evaluated.

Assumptions & free parameters 0 free parameters · 1 assumptions · 0 invented entities

A review paper introduces no fitted parameters and no new physical entities. Its only structural assumption is that the cited set of papers is representative and correctly summarized.

assumptions (1)
  • domain assumption The surveyed literature is representative of prompt mechanisms in medical imaging
    The survey's synthesis and trend analysis (Introduction, Figure 2) assume that the works collected through the undisclosed literature search are comprehensive and accurately interpreted.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Prompt Mechanisms in Medical Imaging: A Comprehensive Survey." pith.science (2026). https://pith.science/paper/R452MKOY

@misc{pith2026250701055,
  author       = {Pith},
  title        = {Pith review of: Prompt Mechanisms in Medical Imaging: A Comprehensive Survey},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/R452MKOY}},
  note         = {Machine review of arXiv:2507.01055}
}
read the original abstract

Deep learning offers transformative potential in medical imaging, yet its clinical adoption is frequently hampered by challenges such as data scarcity, distribution shifts, and the need for robust task generalization. Prompt-based methodologies have emerged as a pivotal strategy to guide deep learning models, providing flexible, domain-specific adaptations that significantly enhance model performance and adaptability without extensive retraining. This systematic review critically examines the burgeoning landscape of prompt engineering in medical imaging. We dissect diverse prompt modalities, including textual instructions, visual prompts, and learnable embeddings, and analyze their integration for core tasks such as image generation, segmentation, and classification. Our synthesis reveals how these mechanisms improve task-specific outcomes by enhancing accuracy, robustness, and data efficiency and reducing reliance on manual feature engineering while fostering greater model interpretability by making the model's guidance explicit. Despite substantial advancements, we identify persistent challenges, particularly in prompt design optimization, data heterogeneity, and ensuring scalability for clinical deployment. Finally, this review outlines promising future trajectories, including advanced multimodal prompting and robust clinical integration, underscoring the critical role of prompt-driven AI in accelerating the revolution of diagnostics and personalized treatment planning in medicine.

Figures

Figures reproduced from arXiv: 2507.01055 by the authors.

Figure 1
Figure 1. An overview of the framework for prompt-based AI in medical imaging. The process begins with various medical imaging data sources, which are processed by an AI model capable of accepting multiple prompt types (visual, text, sequence, etc.). By performing classification, segmentation, or generation tasks, the model ultimately serves a range of clinical applications to improve diagnostic efficiency and accuracy. The c… view at source ↗
Figure 2
Figure 2. Rapid increase of the number of Prompt-driven Medical imaging papers. Generation, Classification, and Segmentation are the three main taxonomy categories introduced in this survey. of prompt mechanisms in medical imaging are still confronted by several critical limitations deeply intertwined with the nature of prompting. While prompting is often positioned as a solution for data scarcity11, the design and validation… view at source ↗
Figure 3
Figure 3. The MedCLIP22 framework for vision-language pre-training. It aligns medical image and text representations by training encoders to match a fine-grained semantic similarity matrix (bottom) derived from medical knowledge extraction (top). Strategies for Optimizing Text-Conditioned Generation Various advanced strategies and auxiliary modules are often incorporated to enhance textual conditional control further and ensu… view at source ↗
Figures from the paper (5 more)
Figure 4
Figure 4. Figure 4: The CXRL framework34, which utilizes textual reports as prompts to condition CXR generation. A key feature is using a reward feedback loop to refine the learnable prompt embeddings, ensuring alignment between the generated image and the diagnostic information in the re…
Figure 5
Figure 5. Figure 5: A CLIP-driven universal segmentation model7 where text prompts, generated from class names, are used to dynamically steer the network towards segmenting specific organs and tumors. conditions into the generative network. For example, in39, sequence prompts, in conjunct…
Figure 6
Figure 6. Figure 6: The architecture of MedSAM42, which utilizes bounding boxes as prompts to guide the segmentation process. The prompts are encoded and fused with the image embedding, directing the mask decoder to generate precise segmentations for the specified target regions. Prompt M…
Figure 7
Figure 7. Figure 7: Typical applications of prompts in three major medical imaging tasks: segmentation, classification, and generation. Note: P represents positive cases, N represents negative cases, C-scopy refers to colonoscopy, DR refers to Diabetic Retinopathy and D-scope refers to de…
Figure 8
Figure 8. Figure 8: The future development of traditional deep learning and the future development of prompt-based deep learning. Designing Superior, Robust, and Standardized Prompting Methodologies The efficacy of current prompt-based systems heavily relies on the quality and design of t…

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

220 extracted references · 38 canonical work pages

  1. [1]

    Mattjie, C. et al. Zero-shot performance of the segment anything model (sam) in 2d medical imaging: A comprehensive evaluation and practical guidelines. In 2023 IEEE 23rd International Conference on Bioinformatics and Bioengineering (BIBE), 108–112 (IEEE Computer Society, 2023)

    2023

  2. [2]

    Akrout, M. et al. Diffusion-based data augmentation for skin disease classification: Impact across original medical datasets to fully synthetic images. arXiv preprint arXiv:2301.04802 (2023)

    arXiv 2023

  3. [3]

    Pinaya, W. H. et al. Brain imaging generation with latent diffusion models. In MICCAI Workshop on Deep Generative Models, 117–126 (Springer, 2022)

    2022

  4. [4]

    & Yang, B

    Fischer, M., Bartler, A. & Yang, B. Prompt tuning for parameter-efficient medical image segmentation. Med. Image Analysis 91, 103024 (2024)

    2024

  5. [5]

    Yan, S. et al. Prompt-driven latent domain generalization for medical image classification. IEEE Transactions on Med. Imaging (2024)

    2024

  6. [6]

    Chambon, P., Bluethgen, C., Langlotz, C. P. & Chaudhari, A. Adapting pretrained vision-language foundational models to medical imaging domains. arXiv preprint arXiv:2210.04133 (2022)

    arXiv 2022

  7. [7]

    Liu, J. et al. Clip-driven universal model for organ segmentation and tumor detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision, 21152–21164 (2023)

    2023

  8. [8]

    & Yuan, Y

    Chen, Z., Xu, Q., Liu, X. & Yuan, Y . Un-sam: Universal prompt-free segmentation for generalized nuclei images.arXiv preprint arXiv:2402.16663 (2024)

    arXiv 2024

Show all 220 references
  1. [9]

    & Gao, X

    Gao, Y ., Xia, W., Hu, D. & Gao, X. Desam: Decoupling segment anything model for generalizable medical image segmentation. arXiv preprint arXiv:2306.00499 (2023)

    2023 arXiv

  2. [10]

    Cheng, D. et al. Sam on medical images: A comprehensive study on three prompt modes.arXiv preprint arXiv:2305.00035 (2023)

    2023 arXiv

  3. [11]

    Zhang, Y . et al. Text-guided foundation model adaptation for pathological image classification. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 272–282 (Springer, 2023)

    2023

  4. [12]

    & Heng, P

    Zhu, Y ., Li, K., Yu, L. & Heng, P. A. Memory-efficient prompt tuning for incremental histopathology classification. In Proceedings of the AAAI Conference on Artificial Intelligence, vol. 38, 7802–7810 (2024)

    2024

  5. [13]

    & Ayed, I

    Silva-Rodriguez, J., Chakor, H., Kobbi, R., Dolz, J. & Ayed, I. B. A foundation language-image model of the retina (flair): Encoding expert knowledge in text supervision. Med. Image Analysis 99, 103357 (2025)

    2025

  6. [14]

    & Xia, Y

    Ye, Y ., Xie, Y ., Zhang, J., Chen, Z. & Xia, Y . Uniseg: A prompt-driven universal segmentation model as well as a strong representation learner. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 508–518 (Springer, 2023)

    2023

  7. [15]

    & Yang, X

    Cao, Q., Xu, Z., Chen, Y ., Ma, C. & Yang, X. Domain prompt learning with quaternion networks. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 26637–26646 (2024)

    2024

  8. [16]

    Zhou, N. et al. Medsam-u: Uncertainty-guided auto multi-prompt adaptation for reliable medsam. arXiv preprint arXiv:2409.00924 (2024)

    2024 arXiv

  9. [17]

    Singhal, K. et al. Large language models encode clinical knowledge. arXiv preprint arXiv:2212.13138 (2022)

    2022 arXiv

  10. [18]

    Wahd, A. S. et al. Sam2rad: A segmentation model for medical images with learnable prompts. arXiv preprint arXiv:2409.06821 (2024)

    2024 arXiv

  11. [19]

    Yellapragada, S. et al. Pathldm: Text conditioned latent diffusion model for histopathology. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 5182–5191 (2024)

    2024

  12. [20]

    Medsyn: Text-guided anatomy-aware synthesis of high-fidelity 3d ct images

    Xu, Y .et al. Medsyn: Text-guided anatomy-aware synthesis of high-fidelity 3d ct images. IEEE Transactions on Med. Imaging (2024)

    2024

  13. [22]

    & Sun, J

    Wang, Z., Wu, Z., Agarwal, D. & Sun, J. Medclip: Contrastive learning from unpaired medical images and text. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 3876–3887 (2022)

    2022

  14. [23]

    Domain-specific language model pretraining for biomedical natural language processing

    Gu, Y .et al. Domain-specific language model pretraining for biomedical natural language processing. ACM Transactions on Comput. for Healthc. (HEALTH) 3, 1–23 (2021)

    2021

  15. [24]

    & Ranganath, R

    Huang, K., Altosaar, J. & Ranganath, R. Clinicalbert: Modeling clinical notes and predicting hospital readmission. arXiv preprint arXiv:1904.05342 (2019)

    2019 arXiv

  16. [25]

    Huang, Z. et al. Ccnet: Criss-cross attention for semantic segmentation. In Proceedings of the IEEE/CVF international conference on computer vision, 603–612 (2019)

    2019

  17. [26]

    R., Fan, Q

    Chen, C.-F. R., Fan, Q. & Panda, R. Crossvit: Cross-attention multi-scale vision transformer for image classification. In Proceedings of the IEEE/CVF international conference on computer vision, 357–366 (2021)

    2021

  18. [27]

    Petit, O. et al. U-net transformer: Self and cross attention for medical image segmentation. In Machine Learning in Medical Imaging: 12th International Workshop, MLMI 2021, Held in Conjunction with MICCAI 2021, Strasbourg, France, September 27, 2021, Proceedings 12, 267–276 (S...

    2021

  19. [28]

    & Shen, D

    Lin, H., Cheng, X., Wu, X. & Shen, D. Cat: Cross attention in vision transformer. In 2022 IEEE international conference on multimedia and expo (ICME), 1–6 (IEEE, 2022)

    2022

  20. [29]

    & Zhang, X

    Dai, L., Zhang, R., Huang, Z. & Zhang, X. Guidegen: A text-guided framework for joint ct volume and anatomical structure generation. arXiv preprint arXiv:2403.07247 (2024)

    2024

  21. [30]

    Bluethgen, C. et al. A vision–language foundation model for the generation of realistic chest x-ray images. Nat. Biomed. Eng. 1–13 (2024)

    2024

  22. [31]

    Chambon, P. et al. Roentgen: vision-language foundation model for chest x-ray generation. arXiv preprint arXiv:2211.12737 (2022)

    2022 arXiv

  23. [32]

    Hashmi, A. U. R. et al. Xreal: Realistic anatomy and pathology-aware x-ray generation via controllable diffusion model. arXiv preprint arXiv:2403.09240 (2024)

    2024 arXiv

  24. [33]

    & Antani, S

    Liang, Z., Xue, Z., Rajaraman, S. & Antani, S. Covid-19 pneumonia chest x-ray pattern synthesis by stable diffusion. In 2024 IEEE Southwest Symposium on Image Analysis and Interpretation (SSIAI), 21–24 (IEEE, 2024)

    2024

  25. [34]

    & Hwang, S

    Han, W., Kim, C., Ju, D., Shim, Y . & Hwang, S. J. Advancing text-driven chest x-ray generation with policy-based reinforcement learning. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 56–66 (Springer, 2024)

    2024

  26. [35]

    & Wang, Y

    Liu, C., Yuan, X., Yu, Z. & Wang, Y . Texdc: Text-driven disease-aware 4d cardiac cine mri images generation. In Proceedings of the Asian Conference on Computer Vision, 3005–3021 (2024)

    2024

  27. [36]

    Hofmanninger, J. et al. Automatic lung segmentation in routine imaging is primarily a data diversity problem, not a methodology problem. Eur. Radiol. Exp. 4, 1–13 (2020)

    2020

  28. [37]

    Wang, A., Tam, T. C. C., Poon, H. M., Yu, K.-C. & Lee, W.-N. Naviairway: a bronchiole-sensitive deep learning-based airway segmentation pipeline. arXiv preprint arXiv:2203.04294 (2022)

    2022 arXiv

  29. [38]

    Wasserthal, J. et al. Totalsegmentator: robust segmentation of 104 anatomic structures in ct images. Radiol. Artif. Intell. 5 (2023)

    2023

  30. [39]

    Han, L. et al. Non-adversarial learning: Vector-quantized common latent space for multi-sequence mri. In Linguraru, M. G. et al. (eds.) Medical Image Computing and Computer Assisted Intervention – MICCAI 2024, 481–491 (Springer Nature Switzerland, Cham, 2024)

    2024

  31. [40]

    Han, L. et al. Synthesis-based imaging-differentiation representation learning for multi-sequence 3d/4d mri. Med. Image Analysis 92, 103044 (2024)

    2024

  32. [41]

    Moghadam, P. A. et al. A morphology focused diffusion probabilistic model for synthesis of histopathology images. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2000–2009 (2023)

    2023

  33. [42]

    Ma, J. et al. Segment anything in medical images. Nat. Commun. 15, 654 (2024)

    2024

  34. [43]

    & Oguz, I

    Li, H., Liu, H., Hu, D., Wang, J. & Oguz, I. Promise: Prompt-driven 3d medical image segmentation using pretrained image foundation models. In 2024 IEEE International Symposium on Biomedical Imaging (ISBI), 1–5 (IEEE, 2024)

    2024

  35. [44]

    Deng, G. et al. Sam-u: Multi-box prompts triggered uncertainty estimation for reliable sam in medical image. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 368–377 (Springer, 2023). 25/33

    2023

  36. [45]

    Wang, G. et al. Sam-med3d-moe: Towards a non-forgetting segment anything model via mixture of experts for 3d medical image segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 552–561 (Springer, 2024)

    2024

  37. [46]

    & Zhao, B

    Du, Y ., Bai, F., Huang, T. & Zhao, B. Segvol: Universal and interactive volumetric medical image segmentation.arXiv preprint arXiv:2311.13385 (2023)

    2023 arXiv

  38. [47]

    B., Iytha Sridhar, R., Upadhyaya, P

    Ramesh, D. B., Iytha Sridhar, R., Upadhyaya, P. & Kamaleswaran, R. Lugsam: A novel framework for integrating text prompts to segment anything model (sam) for segmentation tasks of icu chest x-rays. Pulakesh Kamaleswaran, Rishikesan, Lugsam: A Nov. Framew. for Integrating Text ...

  39. [48]

    & Xiao, Y

    Koleilat, T., Asgariandehkordi, H., Rivaz, H. & Xiao, Y . Medclip-samv2: Towards universal text-driven medical image segmentation. arXiv preprint arXiv:2409.19483 (2024)

    2024 arXiv

  40. [49]

    Kirillov, A. et al. Segment anything. arXiv preprint arXiv:2304.02643 (2023)

    2023 arXiv

  41. [50]

    Zhong, Y ., Xu, M., Liang, K., Chen, K. & Wu, M. Ariadne’s thread: Using text prompts to improve segmentation of infected areas from chest x-ray images. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 724–733 (Springer, 2023)

    2023

  42. [51]

    & Chen, G

    Xie, Y ., Zhou, T., Zhou, Y . & Chen, G. Simtxtseg: Weakly-supervised medical image segmentation with simple text cues. arXiv preprint arXiv:2406.19364 (2024)

    2024 arXiv

  43. [52]

    Li, W., Xiong, X., Xia, P., Ju, L. & Ge, Z. Tp-drseg: Improving diabetic retinopathy lesion segmentation with explicit text-prompts assisted sam. arXiv preprint arXiv:2406.15764 (2024)

    2024 arXiv

  44. [53]

    & Xia, Y

    Ye, Y ., Chen, Z., Zhang, J., Xie, Y . & Xia, Y . Meduniseg: 2d and 3d medical image segmentation via a prompt-driven universal model. arXiv preprint arXiv:2410.05905 (2024)

    2024 arXiv

  45. [54]

    Liu, J. et al. Dctp-net: Dual-branch clip-enhance textual prompt-aware network for acute ischemic stroke lesion segmentation from ct image. IEEE J. Biomed. Heal. Informatics (2024)

    2024

  46. [55]

    Lin, L. et al. Fedlppa: Learning personalized prompt and aggregation for federated weakly-supervised medical image segmentation. arXiv preprint arXiv:2402.17502 (2024)

    2024 arXiv

  47. [56]

    Multi-target domain adaptation with prompt learning for medical image segmentation

    Lin, Y .et al. Multi-target domain adaptation with prompt learning for medical image segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 717–727 (Springer, 2023)

    2023

  48. [57]

    & Huang, J

    Na, S., Guo, Y ., Jiang, F., Ma, H. & Huang, J. Segment any cell: A sam-based auto-prompting fine-tuning framework for nuclei segmentation. arXiv preprint arXiv:2401.13220 (2024)

    2024 arXiv

  49. [58]

    Luo, W. et al. Universal medical image segmentation with task-specific prompt-guided transformer model. In 2023 International Annual Conference on Complex Systems and Intelligent Science (CSIS-IAC), 569–575 (IEEE, 2023)

    2023

  50. [59]

    & Xia, Y

    Chen, Z., Pan, Y ., Ye, Y ., Lu, M. & Xia, Y . Each test image deserves a specific prompt: Continual test-time adaptation for 2d medical image segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 11184–11193 (2024)

    2024

  51. [60]

    Zhang, S. et al. Biomedclip: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs. arXiv preprint arXiv:2303.00915 (2023)

    2023 arXiv

  52. [61]

    & De Melo, G

    Eslami, S., Meinel, C. & De Melo, G. Pubmedclip: How much does clip benefit visual question answering in the medical domain? In Findings of the Association for Computational Linguistics: EACL 2023, 1181–1193 (2023)

    2023

  53. [62]

    & Meinel, C

    Eslami, S., de Melo, G. & Meinel, C. Does clip benefit visual question answering in the medical domain as much as it does in the general domain? arXiv preprint arXiv:2112.13906 (2021)

    2021 arXiv

  54. [63]

    & Chen, H

    Bie, Y ., Luo, L., Chen, Z. & Chen, H. Xcoop: Explainable prompt learning for computer-aided diagnosis via concept- guided context optimization. arXiv preprint arXiv:2403.09410 (2024)

    2024 arXiv

  55. [64]

    Han, M. et al. Mscpt: Few-shot whole slide image classification with multi-scale and context-focused prompt tuning. arXiv preprint arXiv:2408.11505 (2024)

    2024 arXiv

  56. [65]

    Qu, L., Fu, K., Wang, M., Song, Z. et al. The rise of ai language pathologists: Exploring two-level prompt learning for few-shot weakly-supervised whole slide image classification. Adv. Neural Inf. Process. Syst. 36 (2024)

    2024

  57. [66]

    & Park, S

    Chikontwe, P., Kang, M., Luna, M., Nam, S. & Park, S. H. Low-shot prompt tuning for multiple instance learning based histology classification. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 285–295 (Springer, 2024). 26/33

    2024

  58. [67]

    & Ayed, I

    Silva-Rodriguez, J., Chakor, H., Kobbi, R., Dolz, J. & Ayed, I. B. A foundation language-image model of the retina (flair): Encoding expert knowledge in text supervision. arXiv preprint arXiv:2308.07898 (2023)

    2023 arXiv

  59. [68]

    Y .et al

    Lu, M. Y .et al. Visual language pretrained multiple instance zero-shot transfer for histopathology images. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 19764–19775 (2023)

    2023

  60. [69]

    Huang, J., Li, H., Sun, W., Wan, X. & Li, G. Prompt-based grouping transformer for nucleus detection and classification. In International Conference on Medical Image Computing and Computer-Assisted Intervention , 569–579 (Springer, 2023)

    2023

  61. [70]

    Zhu, W. et al. Segprompt: Using segmentation map as a better prompt to finetune deep models for kidney stone classification. In Medical Imaging with Deep Learning, 1680–1690 (PMLR, 2024)

    2024

  62. [71]

    Huang, J., Li, H., Wan, X. & Li, G. Unicell: Universal cell nucleus classification via prompt learning. arXiv preprint arXiv:2402.12938 (2024)

    2024 arXiv

  63. [72]

    & Shi, H

    Ye, Y ., Zhang, J. & Shi, H. Pseudo-prompt generating in pre-trained vision-language models for multi-label medical image classification. In Chinese Conference on Pattern Recognition and Computer Vision (PRCV), 279–298 (Springer, 2024)

    2024

  64. [73]

    & Chen, H

    Lin, Y ., Zhu, Z., Cheng, K.-T. & Chen, H. Prompt-guided adaptive model transformation for whole slide image classification. arXiv preprint arXiv:2403.12537 (2024)

    2024 arXiv

  65. [74]

    Exploring large vision-language models with prompt engineering for peripheral blood cell image analysis and classification

    Sánchez Quijada, M. Exploring large vision-language models with prompt engineering for peripheral blood cell image analysis and classification. Univ. Oberta de Catalunya (UOC) (2024)

    2024

  66. [75]

    Hamamci, I. E. et al. Generatect: Text-conditional generation of 3d chest ct volumes. In European Conference on Computer Vision, 126–143 (Springer, 2025)

    2025

  67. [76]

    Towards general text-guided image synthesis for customized multimodal brain mri generation

    Wang, Y .et al. Towards general text-guided image synthesis for customized multimodal brain mri generation. arXiv preprint arXiv:2409.16818 (2024)

    2024 arXiv

  68. [77]

    & Wang, X

    Shi, S., Li, H., Zhang, Y . & Wang, X. Semantic information-guided attentional gan-based ultrasound image synthesis method. Biomed. Signal Process. Control. 102, 107273 (2025)

    2025

  69. [78]

    Dahan, E. et al. Csg: A context-semantic guided diffusion approach in de novo musculoskeletal ultrasound image generation. arXiv preprint arXiv:2412.05833 (2024)

    2024 arXiv

  70. [79]

    Ct synthesis with conditional diffusion models for abdominal lymph node segmentation

    Yu, Y .et al. Ct synthesis with conditional diffusion models for abdominal lymph node segmentation. arXiv preprint arXiv:2403.17770 (2024)

    2024

  71. [80]

    & Zhao, L

    Xiao, Q. & Zhao, L. End-to-end 3d liver ct image synthesis from vasculature using a multi-task conditional generative adversarial network. Appl. Sci. 13, 6784 (2023)

    2023

  72. [81]

    & Rügamer, D

    Weber, T., Ingrisch, M., Bischl, B. & Rügamer, D. Cascaded latent diffusion models for high-resolution chest x-ray synthesis. In Pacific-Asia Conference on Knowledge Discovery and Data Mining, 180–191 (Springer, 2023)

    2023

  73. [82]

    & Al Moubayed, N

    Shentu, J. & Al Moubayed, N. Cxr-irgen: An integrated vision and language model for the generation of clinically accurate chest x-ray image-report pairs. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 5212–5221 (2024)

    2024

  74. [83]

    & Calegari, R

    Borghesi, A. & Calegari, R. Generation of clinical skin images with pathology with scarce data. In AI for Health Equity and Fairness: Leveraging AI to Address Social Determinants of Health, 47–64 (Springer, 2024)

    2024

  75. [84]

    Fang, Z. et al. Conditional diffusion model for x-ray segmentation data generation. J. Artif. Intell. Pract. 7, 7–10 (2024)

    2024

  76. [85]

    Sagers, L. W. et al. Improving dermatology classifiers across populations using images generated by large diffusion models. arXiv preprint arXiv:2211.13352 (2022)

    2022 arXiv

  77. [86]

    Toward general text-guided multimodal brain mri synthesis for diagnosis and medical image analysis

    Wang, Y .et al. Toward general text-guided multimodal brain mri synthesis for diagnosis and medical image analysis. Cell Reports Medicine (2025)

    2025

  78. [87]

    Li, L. et al. Interactive gadolinium-free mri synthesis: A transformer with localization prompt learning. arXiv preprint arXiv:2503.01265 (2025)

    2025 arXiv

  79. [88]

    Fetalflex: Anatomy-guided diffusion model for flexible control on fetal ultrasound image synthesis

    Duan, Y .et al. Fetalflex: Anatomy-guided diffusion model for flexible control on fetal ultrasound image synthesis. arXiv preprint arXiv:2503.14906 (2025)

    2025 arXiv

  80. [89]

    Liu, Q. et al. Treatment-aware diffusion probabilistic model for longitudinal mri generation and diffuse glioma growth prediction. IEEE Transactions on Med. Imaging (2025). 27/33

    2025

  81. [90]

    Wu, J. & Xu, M. One-prompt to segment all medical images. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 11302–11312 (2024)

    2024

  82. [91]

    Chang, A. et al. Pe-med: Prompt enhancement for interactive medical image segmentation. In International Workshop on Machine Learning in Medical Imaging, 257–266 (Springer, 2023)

    2023

  83. [92]

    Bai, F. et al. Slpt: Selective labeling meets prompt tuning on label-limited lesion segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 14–24 (Springer, 2023)

    2023

  84. [93]

    & Shen, L

    Wu, C., Restrepo, D., Shuai, Z., Liu, Z. & Shen, L. Efficient in-context medical segmentation with meta-driven visual prompt selection. In International Conference on Medical Image Computing and Computer-Assisted Intervention , 255–265 (Springer, 2024)

    2024

  85. [94]

    & Chen, Q

    Xu, Y ., Tang, J., Men, A. & Chen, Q. Eviprompt: A training-free evidential prompt generation method for segment anything model in medical images. arXiv preprint arXiv:2311.06400 (2023)

    2023 arXiv

  86. [95]

    & Yan, Y

    Xie, B., Tang, H., Duan, B., Cai, D. & Yan, Y . Masksam: Towards auto-prompt sam with mask classification for medical image segmentation. arXiv preprint arXiv:2403.14103 (2024)

    2024 arXiv

  87. [96]

    & Hotta, K

    Kato, S. & Hotta, K. One-shot and partially-supervised cell image segmentation using small visual prompt. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 4295–4304 (2023)

    2023

  88. [97]

    Continual learning for abdominal multi-organ and tumor segmentation

    Zhang, Y .et al. Continual learning for abdominal multi-organ and tumor segmentation. In International conference on medical image computing and computer-assisted intervention, 35–45 (Springer, 2023)

    2023

  89. [98]

    K., Jha, D., Bagci, U

    Tomar, N. K., Jha, D., Bagci, U. & Ali, S. Tganet: Text-guided attention for improved polyp segmentation. InInternational Conference on Medical Image Computing and Computer-Assisted Intervention, 151–160 (Springer, 2022)

    2022

  90. [99]

    Zhao, Z. et al. One model to rule them all: Towards universal segmentation for medical images with text prompts. arXiv preprint arXiv:2312.17183 (2023)

    2023 arXiv

  91. [100]

    Polyp-sam++: Can a text guided sam perform better for polyp segmentation? arXiv preprint arXiv:2308.06623 (2023)

    Biswas, R. Polyp-sam++: Can a text guided sam perform better for polyp segmentation? arXiv preprint arXiv:2308.06623 (2023)

    2023 arXiv

  92. [101]

    & Xie, Z

    Chen, Y ., Wang, Y . & Xie, Z. Vp-sfda: Visual prompt source-free domain adaptation for cross-modal medical image. Heal. Data Sci

  93. [102]

    & Yang, H

    Han, X., Chen, Q., Xie, Z., Li, X. & Yang, H. Multiscale progressive text prompt network for medical image segmentation. Comput. & Graph. 116, 262–274 (2023)

    2023

  94. [103]

    Saeed, N., Ridzuan, M., Majzoub, R. A. & Yaqub, M. Prompt-based tuning of transformer models for multi-center medical image segmentation of head and neck cancer. Bioengineering 10, 879 (2023)

    2023

  95. [104]

    & Zhao, L

    Li, X., Zhang, Y . & Zhao, L. Multi-prompt fine-tuning of foundation models for enhanced medical image segmentation. arXiv preprint arXiv:2310.02381 (2023)

    2023 arXiv

  96. [105]

    & Agam, G

    Xie, B., Tang, H., Cai, D., Yan, Y . & Agam, G. Self-prompt sam: Medical image segmentation via automatic prompt sam adaptation. arXiv preprint arXiv:2502.00630 (2025)

    2025 arXiv

  97. [106]

    Xu, Q. et al. Sppnet: A single-point prompt network for nuclei image segmentation. In Cao, X., Xu, X., Rekik, I., Cui, Z. & Ouyang, X. (eds.) Machine Learning in Medical Imaging, 227–236 (Springer Nature Switzerland, Cham, 2024)

    2024

  98. [107]

    Sridhar, R. I. & Kamaleswaran, R. Lung segment anything model (lusam): A prompt-integrated framework for automated lung segmentation on icu chest x-ray images. Authorea Prepr. (2023)

    2023

  99. [108]

    & Wang, G

    Zhang, S., Yue, J., Wang, C., Liu, X. & Wang, G. Box2pseudo: A semi-supervised learning framework for pulmonary nodule segmentation with box-prompt pseudo supervision. In 2023 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), 1696–1703 (IEEE, 2023)

    2023

  100. [109]

    & Shusen, L

    Glatt, R. & Shusen, L. Topology data analysis guided prompt optimization of segment anything model for zero-shot segmentation of biological images. Tech. Rep., Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States) (2023)

    2023

  101. [110]

    & Zhang, X

    Zhou, Q., Feng, Y ., Huang, Z., Ding, M. & Zhang, X. Specific instance and cross prompt based robust 3d semi-supervised medical image segmentation. IEEE Transactions on Instrumentation Meas. (2024)

    2024

  102. [111]

    Robust box prompt based sam for medical image segmentation

    Huang, Y .et al. Robust box prompt based sam for medical image segmentation. In International Workshop on Machine Learning in Medical Imaging, 1–11 (Springer, 2024)

    2024

  103. [112]

    Ouyang, X. et al. Prompt-based segmentation model of anatomical structures and lesions in ct images. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 522–532 (Springer, 2024). 28/33

    2024

  104. [113]

    Segmentation by registration-enabled sam prompt engineering using five reference images

    Chen, Y .et al. Segmentation by registration-enabled sam prompt engineering using five reference images. InInternational Workshop on Biomedical Image Registration, 241–252 (Springer, 2024)

    2024

  105. [114]

    & Wolf, L

    Shaharabany, T. & Wolf, L. Zero-shot medical image segmentation based on sparse prompt using finetuned sam. In Medical Imaging with Deep Learning (2024)

    2024

  106. [115]

    & Cai, R

    Wang, R., Zhuang, L., Chen, H., Xu, B. & Cai, R. Tp-unet: Temporal prompt guided unet for medical image segmentation. arXiv preprint arXiv:2411.11305 (2024)

    2024 arXiv

  107. [116]

    & Khanal, B

    Adhikari, R., Thapaliya, S., Dhakal, M. & Khanal, B. Tunevlseg: Prompt tuning benchmark for vision-language segmentation models. In Proceedings of the Asian Conference on Computer Vision, 126–144 (2024)

    2024

  108. [117]

    Kong, Y ., Kim, K., Jeong, S., Lee, K. E. & Kong, H. Swiftmedsam: An ultra-lightweight prompt-based universal medical image segmentation model for highly constrained environments. In CVPR 2024: Segment Anything In Medical Images On Laptop

    2024

  109. [118]

    Liu, X. et al. Feature-prompting gbmseg: One-shot reference guided training-free prompt engineering for glomerular basement membrane segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 276–285 (Springer, 2024)

    2024

  110. [119]

    Chen, H. et al. Multi-organ foundation model for universal ultrasound image segmentation with task prompt and anatomical prior. IEEE Transactions on Med. Imaging (2024)

    2024

  111. [120]

    Cui, C. et al. Enhancing physician flexibility: Prompt-guided multi-class pathological segmentation for diverse outcomes. In IEEE-EMBS International Conference on Biomedical and Health Informatics

  112. [121]

    Xie, J. et al. Promamba: Prompt-mamba for polyp segmentation. arXiv preprint arXiv:2403.13660 (2024)

    2024 arXiv

  113. [122]

    Cervical-yosa: Utilizing prompt engineering and pre-trained large-scale models for automated segmentation of multi-sequence mri images in cervical cancer

    Xia, Y .et al. Cervical-yosa: Utilizing prompt engineering and pre-trained large-scale models for automated segmentation of multi-sequence mri images in cervical cancer. IET Image Process. 18, 3556–3569 (2024)

    2024

  114. [123]

    Teng, L. et al. Knowledge-guided prompt learning for lifespan brain mr image segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 238–248 (Springer, 2024)

    2024

  115. [124]

    Chen, Z. et al. Adaptation of prompt-enabled segment-anything-model enhance the accuracy and generalizability of cine cardiac magnetic resonance segmentation. Circulation 150, A4143921–A4143921 (2024)

    2024

  116. [125]

    & Zhang, J

    Guan, H., Dai, B. & Zhang, J. Lite class-prompt tiny-vit for multi-modality medical image segmentation. In Ma, J., Zhou, Y . & Wang, B. (eds.)Medical Image Segmentation Foundation Models. CVPR 2024 Challenge: Segment Anything in Medical Images on Laptop, 151–166 (Springer Natu...

    2024

  117. [126]

    & Lee, S

    Song, J., Yun, S., Yoon, S., Kim, J. & Lee, S. Ep-sam: Weakly supervised histopathology segmentation via enhanced prompt with segment anything. arXiv preprint arXiv:2410.13621 (2024)

    2024 arXiv

  118. [127]

    Khor, H. G. et al. Unified prompt-visual interactive segmentation of clinical target volume in ct for nasopharyngeal carcinoma with prior anatomical information. In International Conference on Medical Image Computing and Computer- Assisted Intervention, 659–669 (Springer, 2024)

    2024

  119. [128]

    Xue, X. et al. Deep learning-based segmentation for high-dose-rate brachytherapy in cervical cancer using 3d prompt- resunet. Phys. Medicine & Biol. 69, 195008 (2024)

    2024

  120. [129]

    Cui, C. et al. All-in-sam: from weak annotation to pixel-wise nuclei segmentation with prompt-based finetuning. In Journal of Physics: Conference Series, vol. 2722, 012012 (IOP Publishing, 2024)

    2024

  121. [130]

    Lyu, F., Xu, J., Zhu, Y ., Wong, G. L.-H. & Yuen, P. C. Superpixel-guided segment anything model for liver tumor segmentation with couinaud segment prompt. In International Conference on Medical Image Computing and Computer- Assisted Intervention, 678–688 (Springer, 2024)

    2024

  122. [131]

    & Qiu, G

    Yang, J., Huang, Y ., He, X., Shen, L. & Qiu, G. Tavp: Task-adaptive visual prompt for cross-domain few-shot segmentation. arXiv preprint arXiv:2409.05393 (2024)

    2024 arXiv

  123. [132]

    Xue, X. et al. A deep learning-based 3d prompt-nnunet model for automatic segmentation in brachytherapy of postopera- tive endometrial carcinoma. J. Appl. Clin. Med. Phys. e14371 (2024)

    2024

  124. [133]

    & Zhao, Y

    Dai, P., Ou, Y ., Yang, Y ., Liu, Y . & Zhao, Y . Sparse anatomical prompt semi-supervised learning with masked image modeling for cbct tooth segmentation. In 2024 IEEE International Symposium on Biomedical Imaging (ISBI), 1–5 (IEEE, 2024)

    2024

  125. [134]

    Cui, C. et al. Pfps: Prompt-guided flexible pathological segmentation for diverse potential outcomes using large vision and language models. arXiv preprint arXiv:2407.09979 (2024). 29/33

    2024 arXiv

  126. [135]

    Hu, K. & Xu, C. Lpam: A lightweight medical segmentation network based on mamba improved by prompt attention. IET Image Process. 18, 3545–3555 (2024)

    2024

  127. [136]

    & Lian, C

    Sun, Y ., Liu, M. & Lian, C. Aepl: Automated and editable prompt learning for brain tumor segmentation. arXiv preprint arXiv:2410.19847 (2024)

    2024 arXiv

  128. [137]

    Song, Y ., Zhang, Y . & Li, M. An automatic laryngoscopic image segmentation system based on sam prompt engineering: From glottis annotation to vocal fold segmentation. Authorea Prepr. (2024)

    2024

  129. [138]

    & Zheng, Y

    Cheng, Y . & Zheng, Y . Frequency filtering prompt tuning for medical image semantic segmentation with missing modalities. Big Data Inf. Anal. 8, 109–128 (2024)

    2024

  130. [139]

    & Xie, X

    Li, Y ., Ren, H., Deng, J., Ma, X. & Xie, X. Centersam: Fully automatic prompt for dense nucleus segmentation. In 2024 IEEE International Symposium on Biomedical Imaging (ISBI), 1–5 (IEEE, 2024)

    2024

  131. [140]

    & Wang, Y

    Zhang, Q., Guo, H., Yang, S., Li, Q. & Wang, Y . Progressive vision-language prompt for multi-organ multi-class cell semantic segmentation with single branch. arXiv preprint arXiv:2412.02978 (2024)

    2024 arXiv

  132. [141]

    & Wang, X

    Huang, X., He, D., Li, Z., Zhang, X. & Wang, X. Iossam: Label efficient multi-view prompt-driven tooth segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 632–642 (Springer, 2024)

    2024

  133. [142]

    Li, W. et al. Btsspro: Prompt-guided multimodal co-learning for breast cancer tumor segmentation and survival prediction. IEEE J. Biomed. Heal. Informatics (2024)

    2024

  134. [143]

    Shan, D. et al. Stpnet: Scale-aware text prompt network for medical image segmentation. IEEE Transactions on Image Process. (2025)

    2025

  135. [144]

    Wang, H. et al. Weakmedsam: Weakly-supervised medical image segmentation via sam with sub-class exploration and prompt affinity mining. IEEE Transactions on Med. Imaging (2025)

    2025

  136. [145]

    & Wang, Q

    Yin, D., Zheng, Q., Chen, L., Hu, Y . & Wang, Q. Apg-sam: Automatic prompt generation for sam-based breast lesion segmentation with boundary-aware optimization. Expert. Syst. with Appl. 276, 127048 (2025)

    2025

  137. [146]

    & Hao, X

    Liu, S., Zhang, D. & Hao, X. Efficient deformable convolutional prompt for continual test-time adaptation in medical image segmentation. In Proceedings of the AAAI Conference on Artificial Intelligence, vol. 39, 5550–5557 (2025)

    2025

  138. [147]

    & Wang, M

    Yin, S., Liu, S. & Wang, M. Ddfp: Data-dependent frequency prompt for source free domain adaptation of medical image segmentation. Knowledge-Based Syst. 113651 (2025)

    2025

  139. [148]

    Dual-prompt-enhanced multiorgan segmentation model for total-body pet images

    Gao, Y .et al. Dual-prompt-enhanced multiorgan segmentation model for total-body pet images. IEEE Transactions on Radiat. Plasma Med. Sci. (2025)

    2025

  140. [149]

    Tian, C. et al. Self-prompt contextual learning with axialmamba for multi-label segmentation in carotid ultrasound. Expert. Syst. with Appl. 274, 126749 (2025)

    2025

  141. [150]

    Zou, J. et al. Acea-net: Weakly supervised prostate 3d mri image segmentation via advanced prompt points. IEEE J. Biomed. Heal. Informatics (2025)

    2025

  142. [151]

    & Yuan, Y

    Chen, Z., Xu, Q., Liu, X. & Yuan, Y . Un-sam: Domain-adaptive self-prompt segmentation for universal nuclei images. Med. Image Analysis 103607 (2025)

    2025

  143. [152]

    Category prompt mamba network for nuclei segmentation and classification

    Zhang, Y .et al. Category prompt mamba network for nuclei segmentation and classification. In Proceedings of the AAAI Conference on Artificial Intelligence, vol. 39, 10284–10292 (2025)

    2025

  144. [153]

    Zhao, J. et al. Uncertainty-driven edge prompt generation network for medical image segmentation. IEEE Transactions on Med. Imaging (2025)

    2025

  145. [154]

    Guo, M. et al. Multiple prompt fusion for zero-shot lesion detection using vision-language models. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 283–292 (Springer, 2023)

    2023

  146. [155]

    & Yang, X

    Cao, Q., Xu, Z., Chen, Y ., Ma, C. & Yang, X. Domain prompt learning with quaternion networks. arXiv preprint arXiv:2312.08878 (2023)

    2023 arXiv

  147. [156]

    Zheng, F. et al. Exploring low-resource medical image classification with weakly supervised prompt learning. Pattern Recognit. 149, 110250 (2024)

    2024

  148. [157]

    & Tang, X

    Huang, Y ., Cheng, P., Tam, R. & Tang, X. Fine-grained prompt tuning: A parameter and memory efficient transfer learning method for high-resolution medical image classification. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 120–130 ...

    2024

  149. [158]

    Yang, L. & Qu, W. Using text-augmented visual prompt learning for histopathology image classification. In 2024 5th International Conference on Big Data & Artificial Intelligence & Software Engineering (ICBASE), 272–276 (IEEE, 2024)

    2024

  150. [159]

    & Liang, J

    Bai, Y ., Bai, L., Yang, X. & Liang, J. Label-semantic-based prompt tuning for vision transformer adaptation in medical image analysis. IEEE Transactions on Circuits Syst. for Video Technol.(2025)

    2025

  151. [160]

    & Xiao, Y

    Koleilat, T., Asgariandehkordi, H., Rivaz, H. & Xiao, Y . Biomedcoop: Learning to prompt for biomedical vision-language models. In Proceedings of the Computer Vision and Pattern Recognition Conference, 14766–14776 (2025)

    2025

  152. [161]

    He, A., Wu, Y ., Wang, Z., Li, T. & Fu, H. Dvpt: Dynamic visual prompt tuning of large pre-trained models for medical image analysis. Neural Networks 185, 107168 (2025)

    2025

  153. [162]

    Llm-guided decoupled probabilistic prompt for continual learning in medical image diagnosis

    Luo, Y .et al. Llm-guided decoupled probabilistic prompt for continual learning in medical image diagnosis. IEEE Transactions on Med. Imaging (2025)

    2025

  154. [163]

    Shin, H.-C. et al. Medical image synthesis for data augmentation and anonymization using generative adversarial networks. In Simulation and Synthesis in Medical Imaging: Third International Workshop, SASHIMI 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, September...

    2018

  155. [164]

    Li, X. et al. Artificial general intelligence for medical imaging. arXiv preprint arXiv:2306.05480 (2023)

    2023 arXiv

  156. [165]

    & Ommer, B

    Rombach, R., Blattmann, A., Lorenz, D., Esser, P. & Ommer, B. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 10684–10695 (2022)

    2022

  157. [166]

    Goodfellow, I. et al. Generative adversarial networks. Commun. ACM 63, 139–144 (2020)

    2020

  158. [167]

    Bowles, C. et al. Gan augmentation: Augmenting training data using generative adversarial networks. arXiv preprint arXiv:1810.10863 (2018)

    2018 arXiv

  159. [168]

    & Kim, D.-s

    Kwon, G., Han, C. & Kim, D.-s. Generation of 3d brain mri using auto-encoding generative adversarial networks. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 118–126 (Springer, 2019)

    2019

  160. [169]

    Sun, L. et al. Hierarchical amortized gan for 3d high resolution medical image synthesis. IEEE journal biomedical health informatics 26, 3966–3975 (2022)

    2022

  161. [170]

    Radford, A. et al. Learning transferable visual models from natural language supervision. In International conference on machine learning, 8748–8763 (PMLR, 2021)

    2021

  162. [171]

    & Shen, C

    Zhang, J., Xie, Y ., Xia, Y . & Shen, C. Dodnet: Learning to segment multi-organ and tumors from multiple partially labeled datasets. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 1195–1204 (2021)

    2021

  163. [172]

    Tg-lmm: Enhancing medical image segmentation accuracy through text-guided large multi-modal model

    Zhao, Y .et al. Tg-lmm: Enhancing medical image segmentation accuracy through text-guided large multi-modal model. arXiv preprint arXiv:2409.03412 (2024)

    2024 arXiv

  164. [173]

    Boecking, B. et al. Making the most of text semantics to improve biomedical vision–language processing. In European conference on computer vision, 1–21 (Springer, 2022)

    2022

  165. [174]

    Mazurowski, M. A. et al. Segment anything model for medical image analysis: an experimental study. Med. Image Analysis 89, 102918 (2023)

    2023

  166. [175]

    Hu, C. & Li, X. When sam meets medical images: An investigation of segment anything model (sam) on multi-phase liver tumor segmentation. arXiv preprint arXiv:2304.08506 (2023)

    2023 arXiv

  167. [176]

    Deng, R. et al. Segment anything model (sam) for digital pathology: Assess zero-shot segmentation on whole slide imaging. arXiv preprint arXiv:2304.04155 (2023)

    2023 arXiv

  168. [177]

    Roy, S. et al. Sam. md: Zero-shot medical image segmentation capabilities of the segment anything model. arXiv preprint arXiv:2304.05396 (2023)

    2023 arXiv

  169. [178]

    Cheng, J. et al. Sam-med2d. arXiv preprint arXiv:2308.16184 (2023)

    2023 arXiv

  170. [179]

    Wang, H. et al. Sam-med3d. arXiv preprint arXiv:2310.15161 (2023)

    2023 arXiv

  171. [180]

    Bert: Pre-training of deep bidirectional transformers for language understanding

    Devlin, J. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)

    2018 arXiv

  172. [181]

    & Nguyen, A

    Chen, P., Li, Q., Biaz, S., Bui, T. & Nguyen, A. gscorecam: What objects is clip looking at? In Proceedings of the Asian Conference on Computer Vision, 1959–1975 (2022)

    2022

  173. [182]

    Hamamci, I. E. et al. A foundation model utilizing chest ct volumes and radiology reports for supervised-level zero-shot detection of abnormalities. CoRR (2024). 31/33

    2024

  174. [183]

    A., Dillman, J

    Lu, Z., Li, H., Parikh, N. A., Dillman, J. R. & He, L. Radclip: Enhancing radiologic image analysis through contrastive language-image pre-training. arXiv preprint arXiv:2403.09948 (2024)

    2024 arXiv

  175. [184]

    Zhou, K., Yang, J., Loy, C. C. & Liu, Z. Learning to prompt for vision-language models. Int. J. Comput. Vis. 130, 2337–2348 (2022)

    2022

  176. [185]

    Bommasani, R. et al. On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258 (2021)

    2021 arXiv

  177. [186]

    Moor, M. et al. Foundation models for generalist medical artificial intelligence. Nature 616, 259–265 (2023)

    2023

  178. [187]

    Wang, X. et al. A pathology foundation model for cancer diagnosis and prognosis prediction. Nature 634, 970–978 (2024)

    2024

  179. [188]

    A foundation model for clinical-grade computational pathology and rare cancers detection

    V orontsov, E.et al. A foundation model for clinical-grade computational pathology and rare cancers detection. Nat. medicine 1–12 (2024)

    2024

  180. [189]

    Xiang, J. et al. A vision–language foundation model for precision oncology. Nature 1–10 (2025)

    2025

  181. [190]

    Huang, Z., Bianchi, F., Yuksekgonul, M., Montine, T. J. & Zou, J. A visual–language foundation model for pathology image analysis using medical twitter. Nat. medicine 29, 2307–2316 (2023)

    2023

  182. [191]

    Tiu, E. et al. Expert-level detection of pathologies from unannotated chest x-ray images via self-supervised learning. Nat. Biomed. Eng. 6, 1399–1406 (2022)

    2022

  183. [192]

    You, K. et al. Cxr-clip: Toward large scale chest x-ray language-image pre-training. In International Conference on Medical Image Computing and Computer-Assisted Intervention, 101–111 (Springer, 2023)

    2023

  184. [193]

    Dai, T. et al. Unichest: Conquer-and-divide pre-training for multi-source chest x-ray classification. IEEE Transactions on Med. Imaging (2024)

    2024

  185. [194]

    & Xie, W

    Wu, C., Zhang, X., Zhang, Y ., Wang, Y . & Xie, W. Medklip: Medical knowledge enhanced language-image pre-training for x-ray diagnosis. In Proceedings of the IEEE/CVF International Conference on Computer Vision, 21372–21383 (2023)

    2023

  186. [195]

    & Shan, H

    Lei, Y ., Li, Z., Shen, Y ., Zhang, J. & Shan, H. Clip-lung: Textual knowledge-guided lung nodule malignancy prediction. In International Conference on Medical Image Computing and Computer-Assisted Intervention , 403–412 (Springer, 2023)

    2023

  187. [196]

    Niu, C. et al. Medical multimodal-multitask foundation model for superior chest ct performance. arXiv preprint arXiv:2304.02649 (2023)

    2023 arXiv

  188. [197]

    & Xie, W

    Wu, C., Zhang, X., Zhang, Y ., Wang, Y . & Xie, W. Towards generalist foundation model for radiology.arXiv preprint arXiv:2308.02463 (2023)

    2023 arXiv

  189. [198]

    Bai, F., Du, Y ., Huang, T., Meng, M. Q.-H. & Zhao, B. M3d: Advancing 3d medical image analysis with multi-modal large language models. arXiv preprint arXiv:2404.00578 (2024)

    2024 arXiv

  190. [199]

    Blankemeier, L. et al. Merlin: A vision language foundation model for 3d computed tomography. Res. Sq. rs–3 (2024)

    2024

  191. [200]

    A foundation model for generalizable disease detection from retinal images

    Zhou, Y .et al. A foundation model for generalizable disease detection from retinal images. Nature 622, 156–163 (2023)

    2023

  192. [201]

    & Bernabeu, M

    Engelmann, J. & Bernabeu, M. O. Training a high-performance retinal foundation model with half-the-data and 400 times less compute. arXiv preprint arXiv:2405.00117 (2024)

    2024 arXiv

  193. [202]

    Men, Y . et al. Drstagenet: Deep learning for diabetic retinopathy staging from fundus images. arXiv preprint arXiv:2312.14891 (2023)

    2023 arXiv

  194. [203]

    Qiu, J. et al. Visionfm: a multi-modal multi-task vision foundation model for generalist ophthalmic artificial intelligence. arXiv preprint arXiv:2310.04992 (2023)

    2023 arXiv

  195. [204]

    Shi, D. et al. Eyefound: A multimodal generalist foundation model for ophthalmic imaging. arXiv preprint arXiv:2405.11338 (2024)

    2024 arXiv

  196. [205]

    & Antani, S

    Zamzmi, G., Rajaraman, S. & Antani, S. Unified representation learning for efficient medical image analysis. arXiv preprint arXiv:2006.11223 (2020)

    2020 arXiv

  197. [206]

    Han, L. et al. An explainable deep framework: Towards task-specific fusion for multi-to-one mri synthesis. InInternational Conference on Medical Image Computing and Computer-Assisted Intervention, 45–55 (Springer, 2023)

    2023

  198. [207]

    Zhou, K., Yang, J., Loy, C. C. & Liu, Z. Conditional prompt learning for vision-language models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 16816–16825 (2022)

    2022

  199. [208]

    Jiang, F. et al. Artificial intelligence in healthcare: past, present and future. Stroke vascular neurology 2 (2017). 32/33

    2017

  200. [209]

    & Dolz, J

    Sinha, A. & Dolz, J. Multi-scale self-guided attention for medical image segmentation. IEEE journal biomedical health informatics 25, 121–130 (2020)

    2020

  201. [210]

    Le Vuong, T. T. & Kwak, J. T. Moma: momentum contrastive learning with multi-head attention-based knowledge distillation for histopathology image analysis. Med. Image Analysis 101, 103421 (2025)

    2025

  202. [211]

    Huang, K. et al. Learnable prompting sam-induced knowledge distillation for semi-supervised medical image segmenta- tion. IEEE Transactions on Med. Imaging (2025)

    2025

  203. [212]

    Xie, L. et al. Mh-pflid: Model heterogeneous personalized federated learning via injection and distillation for medical data analysis. arXiv preprint arXiv:2405.06822 (2024)

    2024 arXiv

  204. [213]

    & Pan, S

    Shi, H., Ren, S., Zhang, T. & Pan, S. J. Deep multitask learning with progressive parameter sharing. In Proceedings of the IEEE/CVF International Conference on Computer Vision, 19924–19935 (2023)

    2023

  205. [214]

    Liu, P., Gao, Z.-F., Chen, Y ., Zhao, W. X. & Wen, J.-R. Enhancing scalability of pre-trained language models via efficient parameter sharing. In Findings of the Association for Computational Linguistics: EMNLP 2023, 13771–13785 (2023)

    2023

  206. [215]

    Qiu, Z. et al. Learning co-plane attention across mri sequences for diagnosing twelve types of knee abnormalities. Nat. Commun. 15, 7637 (2024)

    2024

  207. [216]

    Kim, H.-E. et al. Changes in cancer detection and false-positive recall in mammography using artificial intelligence: a retrospective, multireader study. The Lancet Digit. Heal. 2, e138–e148 (2020)

    2020

  208. [217]

    Tschandl, P. et al. Human–computer collaboration for skin cancer recognition. Nat. medicine 26, 1229–1234 (2020)

    2020

  209. [218]

    & Wang, J

    Zhang, Z., Chai, W. & Wang, J. Mani-gpt: A generative model for interactive robotic manipulation. Procedia Comput. Sci. 226, 149–156 (2023)

    2023

  210. [219]

    Diaggpt: An llm-based chatbot with automatic topic management for task-oriented dialogue

    Cao, L. Diaggpt: An llm-based chatbot with automatic topic management for task-oriented dialogue. arXiv preprint arXiv:2308.08043 (2023)

    2023 arXiv

  211. [220]

    Shi, R. et al. From general to specific: Tailoring large language models for personalized healthcare. arXiv preprint arXiv:2412.15957 (2024)

    2024 arXiv

  212. [221]

    & Pacchiano, A

    Shenfeld, I., Faltings, F., Agrawal, P. & Pacchiano, A. Language model personalization via reward factorization. arXiv preprint arXiv:2503.06358 (2025). 33/33

    2025 arXiv

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.