Segment Anything in Medical Images and Videos: Benchmark and Deployment
read the original abstract
Recent advances in segmentation foundation models have enabled accurate and efficient segmentation across a wide range of natural images and videos, but their utility to medical data remains unclear. In this work, we first present a comprehensive benchmarking of the Segment Anything Model 2 (SAM2) across 11 medical image modalities and videos and point out its strengths and weaknesses by comparing it to SAM1 and MedSAM. Then, we develop a transfer learning pipeline and demonstrate SAM2 can be quickly adapted to medical domain by fine-tuning. Furthermore, we implement SAM2 as a 3D slicer plugin and Gradio API for efficient 3D image and video segmentation. The code has been made publicly available at \url{https://github.com/bowang-lab/MedSAM}.
This paper has not been read by Pith yet.
Forward citations
Cited by 3 Pith papers
-
Comparing SAM 2 and SAM 3 for Zero-Shot Segmentation of 3D Medical Data
SAM 3 outperforms SAM 2 under click prompting for zero-shot 3D medical segmentation across 16 datasets and 54 structures, with fewer failure modes in prompt-frame over-segmentation and prediction retention.
-
Enhancing MedSAM with a Lightweight Box Predictor for Medical Image Segmentation
Enhances MedSAM with a 1.6M-parameter Box Predictor trained in two stages to convert single clicks to bounding boxes, reporting Dice scores of 0.89-0.98 on four medical datasets across CT, MRI, and ultrasound.
-
Clinical utility of foundation models in musculoskeletal MRI for biomarker fidelity and predictive outcomes
Fine-tuned foundation models produce reliable MSK MRI biomarkers that support workload-reducing triage and calibrated 48-month prediction of knee replacement and incident OA.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.