REVIEW 21 cited by
Phikon-v2, A large and public feature extractor for biomarker prediction
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Phikon-v2, A large and public feature extractor for biomarker prediction
read the original abstract
Gathering histopathology slides from over 100 publicly available cohorts, we compile a diverse dataset of 460 million pathology tiles covering more than 30 cancer sites. Using this dataset, we train a large self-supervised vision transformer using DINOv2 and publicly release one iteration of this model for further experimentation, coined Phikon-v2. While trained on publicly available histology slides, Phikon-v2 surpasses our previously released model (Phikon) and performs on par with other histopathology foundation models (FM) trained on proprietary data. Our benchmarks include eight slide-level tasks with results reported on external validation cohorts avoiding any data contamination between pre-training and evaluation datasets. Our downstream training procedure follows a simple yet robust ensembling strategy yielding a +1.75 AUC increase across tasks and models compared to one-shot retraining (p<0.001). We compare Phikon (ViT-B) and Phikon-v2 (ViT-L) against 14 different histology feature extractors, making our evaluation the most comprehensive to date. Our result support evidences that DINOv2 handles joint model and data scaling better than iBOT. Also, we show that recent scaling efforts are overall beneficial to downstream performance in the context of biomarker prediction with GigaPath and H-Optimus-0 (two ViT-g with 1.1B parameters each) standing out. However, the statistical margins between the latest top-performing FMs remain mostly non-significant; some even underperform on specific indications or tasks such as MSI prediction - deposed by a 13x smaller model developed internally. While latest foundation models may exhibit limitations for clinical deployment, they nonetheless offer excellent grounds for the development of more specialized and cost-efficient histology encoders fueling AI-guided diagnostic tools.
Forward citations
Cited by 21 Pith papers
-
Self-supervision drives representational convergence in medical foundation models more than clinical supervision
Representational convergence among medical image encoders is modest, driven mainly by the self-supervised pretraining objective rather than clinical supervision or scale, yet still sufficient for cross-encoder and cro...
-
Benchmarking Pathology Foundation Models for Spatial Domain Understanding
SpaPath-Bench evaluates spatial representation in 19 pathology foundation models via spatial domain identification on 42 paired WSI-ST slides using three agreement criteria across 83K runs.
-
Topology-Driven Transferability Estimation for 3D Medical Vision Foundation Models
MST-based local boundary leakage and global topology divergence, fused by task complexity, rank SSL 3D medical encoders for segmentation without fine-tuning, beating prior TE metrics by 0.36 weighted Kendall τ at 56× speed.
-
From Multi-Resolution Cells to Gigapixel Whole Slide Images Foundation Model for Computational Pathology
MRPT, a multi-resolution hierarchical transformer pre-trained on 36K whole-slide images, is reported to outperform prior pathology foundation models on 34 classification, captioning, and VQA datasets.
-
Beyond Counts: A Distributional Robustness Margin For Pathology Foundation Models
CRoMa scores each pathology image embedding by the margin between cross-site biological matches and same-site biological distractors, revealing distributional lower tails that pooled robustness scores hide.
-
CANDOR: Chance-Calibrated Discordance in Frozen Foundation Encoders
A chance-calibrated discordance measure shows frozen encoders encode fine-grained clinical findings weakly rather than blindly, with collapse rates ranging from 4.5% (bird species) to 50.0% (glaucoma).
-
LaGuadia: Language-Guided Adaptive Distillation from Pathology Foundation Models
Language-guided adaptive multi-teacher distillation yields an 87M pathology encoder that matches or exceeds GigaPath and UNI on WSI captioning, VQA, and MIL tasks.
-
Towards Autonomous and Auditable Medical Imaging Model Development
AMID, a verification-guided multi-agent MLE system for medical imaging, outperforms general MLE agents on 20 ReX-MLE challenges and approaches human challenge solutions on several tasks.
-
DaX: Learning General Pathology Representations Across Scales
DaX is a pathology vision foundation model that extends DINOv3 with continuous magnification training and cross-scale consistency, achieving top average performance on a benchmark of 161 tasks from 44 datasets coverin...
-
MOOZY: A Patient-First Foundation Model for Computational Pathology
Patient-level pretraining with a case transformer and multi-task public supervision yields transferable WSI embeddings that beat larger slide-centric models on held-out pathology tasks.
-
Enabling clinical use of foundation models for computational pathology
Novel robustness losses added during downstream training on foundation-model features from pathology slides improve both robustness to technical variation and classification accuracy.
-
HistoFID- Calibrating Frechet-distance evaluation across pathology foundation models
Raw Fréchet distances in pathology vary ~30-fold across encoders; dividing by each encoder's own within-cohort floor cuts cross-encoder variation by ~89% within and ~58% across cohorts.
-
APRIL-MedSeg: A Modular Medical Image Segmentation Toolbox Embracing Modern Paradigms
APRIL-MedSeg is a new open-source modular toolbox that uses YAML configuration and component registries to unify multiple advanced paradigms for medical image segmentation.
-
Mitigating Batch Effects in Histopathology via Language-Mediated Robust Embedding Generation
GLMP generates robust pathology embeddings by routing histology images through an intermediate textual representation produced by general-purpose MLLMs to mitigate batch effects.
-
Beyond ViT Tokens: Masked-Diffusion Pretrained Convolutional Pathology Foundation Model for Cell-Level Dense Prediction
A masked-diffusion pretrained convolutional model outperforms ViT pathology foundation models on cell-level dense prediction tasks in histology.
-
Federated Distillation for Whole Slide Image via Gaussian-Mixture Feature Alignment and Curriculum Integration
FedHD is a federated learning framework for whole slide images that distills one-to-one synthetic features aligned via Gaussian mixtures and progressively integrates cross-site features through curriculum learning to ...
-
Federated Distillation for Whole Slide Image via Gaussian-Mixture Feature Alignment and Curriculum Integration
FedHD performs federated distillation for whole slide images by generating one synthetic feature set per real slide via Gaussian-mixture alignment and adding them via curriculum integration, outperforming prior federa...
-
Atlas 2 -- Foundation models for clinical deployment
Atlas 2 and its distilled variants set new average state-of-the-art results across 80 pathology benchmarks, with larger robustness margins over prior models.
-
CellPrior-Net: Prior-Guided Nuclei Detection and Classification for H&E Whole-Slide Images
CellPrior-Net integrates hematoxylin channel prior into a lightweight CNN for nuclei detection and classification in H&E WSIs, claiming comparable accuracy to SOTA with significantly reduced inference time across 10.4...
-
APRIL-MedSeg: A Modular Medical Image Segmentation Toolbox Embracing Modern Paradigms
Presents APRIL-MedSeg, a modular YAML-configurable toolbox for 2D medical image segmentation integrating semi-supervised, domain adaptation, distillation, weakly supervised, text-guided, and foundation model paradigms...
-
Artificial Intelligence and Innovation Ecosystem: Evolutionary Developments, Challenges, and Future Directions
AIIE is framed as an AI-dominated innovation ecosystem whose participant mix, coopetition, and goals shift by lifecycle stage, illustrated with Owkin and four open challenges.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.