Pith. sign in

REVIEW 11 cited by

MaskSAM: Towards Auto-prompt SAM with Mask Classification for Volumetric Medical Image Segmentation

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2403.14103 v2 pith:H26SJDTR submitted 2024-03-21 cs.CV

Bin Xie , Hao Tang , Bin Duan , Dawen Cai , Yan Yan , Gady Agam This is my paper · ORCID
classification cs.CV
keywords imageauxiliarymasksegmentationclassifiermedicalperformanceprompts
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Segment Anything Model (SAM), a prompt-driven foundation model for natural image segmentation, has demonstrated impressive zero-shot performance. However, SAM does not work when directly applied to medical image segmentation, since SAM lacks the ability to predict semantic labels, requires additional prompts, and presents suboptimal performance. Following the above issues, we propose MaskSAM, a novel mask classification prompt-free SAM adaptation framework for medical image segmentation. We design a prompt generator combined with the image encoder in SAM to generate a set of auxiliary classifier tokens, auxiliary binary masks, and auxiliary bounding boxes. Each pair of auxiliary mask and box prompts can solve the requirements of extra prompts. The semantic label prediction can be addressed by the sum of the auxiliary classifier tokens and the learnable global classifier tokens in the mask decoder of SAM. Meanwhile, we design a 3D depth-convolution adapter for image embeddings and a 3D depth-MLP adapter for prompt embeddings to efficiently fine-tune SAM. Our method achieves state-of-the-art performance on AMOS2022, 90.52% Dice, which improved by 2.7% compared to nnUNet. Our method surpasses nnUNet by 1.7% on ACDC and 1.0% on Synapse datasets.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 11 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. SEG-SAM: Semantic-Guided SAM for Unified Medical Image Segmentation

    cs.CV 2024-12 conditional novelty 6.0 of 10

    SEG-SAM adds a semantic-aware decoder, LLM text summaries, and a mask-agreement loss to SAM for unified binary and semantic medical segmentation.

  2. Annotation-Efficient Task Guidance for Medical Segment Anything

    cs.CV 2024-12 conditional novelty 6.0 of 10

    SAM-Mix couples a GradCAM classifier to SAM through auto-generated box prompts, reaching 0.948 Dice on liver segmentation from 50 labeled CT slices.

  3. CoSAM: Self-Correcting SAM for Domain Generalization in 2D Medical Image Segmentation

    cs.CV 2024-11 conditional novelty 6.0 of 10

    CoSAM improves domain generalization in 2D medical image segmentation by using a trained error decoder to correct SAM's prompt-free coarse masks and cyclically refining predictions with point, box, and mask prompts.

  4. Quickly Tuning Foundation Models for Image Segmentation

    cs.CV 2025-08 conditional novelty 5.0 of 10

    Meta-learning over dataset features and learning curves lets QTT-SEG find SAM fine-tuning configurations that beat zero-shot and a strong AutoML baseline in under three minutes.

  5. Hierarchical Self-Prompting SAM: A Prompt-Free Medical Image Segmentation Framework

    cs.CV 2025-06 conditional novelty 5.0 of 10

    HSP-SAM adds learned abstract prompt pairs to SAM, achieving prompt-free medical image segmentation with reported zero-shot improvements of up to 14.04 percent Dice.

  6. RFMedSAM 2: Automatic Prompt Refinement for Enhanced Volumetric Medical Image Segmentation with SAM 2

    cs.CV 2025-02 conditional novelty 5.0 of 10

    RFMedSAM 2, a SAM 2 variant with adapters and a U-Net prompt generator, reports state-of-the-art Dice scores on AMOS2022 (90.7%) and BTCV (86.7%).

  7. Prompt Mechanisms in Medical Imaging: A Comprehensive Survey

    eess.IV 2025-06 conditional novelty 4.0 of 10

    A broad survey that organizes prompt mechanisms for medical image generation, segmentation, and classification into a two-dimensional taxonomy of core technologies and clinical applications.

  8. Detection of Breast Cancer Lumpectomy Margin with SAM-incorporated Forward-Forward Contrastive Learning

    cs.CV 2025-06 reject novelty 4.0 of 10

    FFCL-SAM, a patch-level classifier plus SAM-based refinement, reports AUC 0.8455 and improved margin segmentation on intraoperative breast radiographs, but the test set excludes negative patients.

  9. SAMba-UNet: SAM2-Mamba UNet for Cardiac MRI in Medical Robotic Perception

    cs.CV 2025-05 conditional novelty 4.0 of 10

    A combined SAM2, Mamba, and UNet architecture reports state-of-the-art Dice of 0.9103 on the ACDC cardiac MRI benchmark, with no code or error bars yet released.

  10. Diffusion-empowered AutoPrompt MedSAM

    eess.IV 2025-02 conditional novelty 4.0 of 10

    A class-index-driven diffusion-style prompt encoder turns MedSAM into a fully automatic segmenter that outputs semantically labeled masks, with reported gains on CT, MRI, endoscopy, and X-ray benchmarks.

  11. Self-Prompt SAM: Medical Image Segmentation via Automatic Prompt SAM Adaptation

    cs.CV 2025-02 conditional novelty 3.0 of 10

    Self-Prompt-SAM automatically generates point, box, and mask prompts for a fine-tuned SAM and reports state-of-the-art Dice scores on three medical segmentation benchmarks.

Pith tools