REVIEW 5 cited by
Revisiting MAE pre-training for 3D medical image segmentation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Self-Supervised Learning (SSL) presents an exciting opportunity to unlock the potential of vast, untapped clinical datasets, for various downstream applications that suffer from the scarcity of labeled data. While SSL has revolutionized fields like natural language processing and computer vision, its adoption in 3D medical image computing has been limited by three key pitfalls: Small pre-training dataset sizes, architectures inadequate for 3D medical image analysis, and insufficient evaluation practices. In this paper, we address these issues by i) leveraging a large-scale dataset of 39k 3D brain MRI volumes and ii) using a Residual Encoder U-Net architecture within the state-of-the-art nnU-Net framework. iii) A robust development framework, incorporating 5 development and 8 testing brain MRI segmentation datasets, allowed performance-driven design decisions to optimize the simple concept of Masked Auto Encoders (MAEs) for 3D CNNs. The resulting model not only surpasses previous SSL methods but also outperforms the strong nnU-Net baseline by an average of approximately 3 Dice points setting a new state-of-the-art. Our code and models are made available here.
Forward citations
Cited by 5 Pith papers
-
Benchmarking and Explaining Deep Learning Cortical Lesion MRI Segmentation in Multiple Sclerosis
A standard nnU-Net with blob loss achieves the best cortical lesion segmentation in a multi-center benchmark, with out-of-domain F1 of 0.50.
-
Brain Imaging Foundation Models, Are We There Yet? A Systematic Review of Foundation Models for Brain Imaging and Biomedical Research
A systematic review of brain imaging foundation models covering 86 models and 161 datasets, with a performance tournament, dataset atlas, and duplicated-data warnings.
-
An OpenMind for 3D medical vision self-supervised learning
OpenMind is a 114k-volume open brain MRI pretraining dataset and a standardized benchmark showing MAE-style pretraining improves 3D segmentation, while contrastive methods help classification.
-
Precision ICU Resource Planning: A Multimodal Model for Brain Surgery Outcomes
Combining T1 MRI latents with clinical data via the DAFT fusion model yields a small F1 improvement (0.37 to 0.41) for ICU admission prediction after brain surgery, though statistical significance is not established.
-
General Methods Make Great Domain-specific Foundation Models: A Case-study on Fetal Ultrasound
A DINOv2 model pretrained from scratch on 2M fetal ultrasound images beats natural-image and general-ultrasound foundation models on fetal ultrasound classification, segmentation, and few-shot tasks.
Discussion (0). Continue with ORCID to comment.