Pith. sign in

REVIEW 3 major objections 4 minor 96 references

RankByGene: Gene-Guided Histopathology Representation Learning Through Cross-Modal Ranking Consistency

T0 review · 3 major / 4 minor · reviewed 2026-08-12 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read RankByGene claims that transferring similarity rankings from gene expression space to histology image space, rather than matching exact distances, yields image features that align with gene activity and improve slide-level clinical…

desk verdict Genuine improvements on gene expression prediction, but the co-trained gene encoder leaves the 'gene-guided' mechanism underdetermined until a frozen-encoder ablation is shown. read the letter →

arxiv 2411.15076 v3 pith:K53X6HAB submitted 2024-11-22 eess.IV cs.CVq-bio.QM

Wentao Huang , Meilong Xu , Xiaoling Hu , Shahira Abousamra , Aniruddha Ganguly , Saarthak Kapse , Alisa Yurovsky , Prateek Prasanna
show 4 more authors
Tahsin Kurc Joel Saltz Michael L. Miller Chao Chen
This is my paper · ORCID
classification eess.IVcs.CVq-bio.QM
keywords spatialtranscriptomicshistopathologyimageanalysiscross-modalrepresentationlearningrankinglossknowledgedistillationgeneexpressionpredictionwholeslideimagesmulti-modalalignment
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper tries to establish that the right way to align spatial transcriptomics with histology images is to match the ranking of similarities between tissue spots across modalities, not the distances themselves. It introduces RankByGene, a training objective that combines a gene-image contrastive loss for local spot matching with a cross-modal ranking consistency loss that enforces, for sampled triples of spots, that image-feature similarity gaps are at least as large as gene-feature similarity gaps. A teacher-student distillation loss stabilizes this alignment against the sparsity, noise, and high dimensionality of gene expression. If the claim holds, image features learned from paired gene-image data can capture functional, gene-related visual cues, improving gene expression prediction and slide-level clinical tasks on image-only cohorts.

What carries the argument

The load-bearing mechanism is the cross-modal ranking consistency loss. For each anchor tissue spot $p$ and pairs $(q,r)$, it defines $\ell(p,q,r) = \operatorname{sign}(S^G_{p,q}-S^G_{p,r})\cdot((S^G_{p,q}-S^G_{p,r})-(S^I_{p,q}-S^I_{p,r}))$ and penalizes positive values with a hinge loss over all sampled triplets. This is a modified ordinal ranking loss: beyond requiring the image similarities to preserve the gene-similarity order, it pushes the image-feature gap to meet or exceed the gene-feature gap, which the authors argue accelerates alignment and counteracts the tendency of image features to be tightly packed. The ranking loss is combined with an InfoNCE gene-image contrastive loss and an intra-modal distillation loss in which a teacher encoder processes weakly augmented patches and a student processes strongly augmented ones, with teacher weights updated by exponential moving average.

What would settle it

Shuffle the pairing between tissue-spot images and their gene profiles during training; if RankByGene's Pearson correlation gains over contrastive-only training persist under shuffled pairing, the ranking loss is not actually transferring gene information and the alignment claim fails.

Watch

Extended reading notes

Core claim

The paper's central discovery is that cross-modal alignment improves when similarity rankings are transferred from gene space to image space at both local and global scales, instead of relying on point-wise or pair-wise distance matching. Concretely, RankByGene outperforms the best prior baseline on gene expression prediction with Pearson correlation improvements of 9% to 34% on the top 250 highly expressed genes and 7% to 35% on the top 250 cancer-specific genes across breast and lung datasets, and it achieves the highest AUC on most mutation-status classification endpoints and the highest C-Index in both survival cohorts tested. The learned teacher image encoder is the only component used at inference, so the benefit transfers to image-only histopathology data.

Load-bearing premise

The method's gains rest on the assumption that making image-feature similarity gaps at least as large as gene-feature similarity gaps, for sampled groups of three tissue spots, improves rather than distorts the learned image representation; the paper supports this only empirically on breast and lung data.

Editorial extensions

If this is right

  • Gene expression prediction from histology improves: PCC rises by 9% to 34% for the top 250 highly expressed genes and 7% to 35% for the top 250 cancer-specific genes over the best baseline on breast and lung test slides.
  • Slide-level classification improves on most endpoints: RankByGene achieves the highest AUC on BCNB receptor-status classification and on most TCGA-LUAD mutation-status tasks in the paper's comparisons.
  • Survival prediction improves: RankByGene reaches a C-Index of 0.681 on TCGA-BRCA and 0.595 on TCGA-LUAD, the highest among the compared image encoders.
  • The benefit survives transfer to image-only cohorts: at inference only the teacher image encoder is used, so the alignment learned from spatial transcriptomics pairs can be applied to whole slide images without gene data.
  • The ranking loss adds value beyond local contrastive alignment: the paper's ablation on Breast-ST1 shows the best PCC (0.1874) requires both the ranking loss and the distillation loss, versus 0.1419 with neither and intermediate values with only one.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the ranking loss works by transferring ordinal structure rather than exact distances, the same objective could be applied to other paired modalities where one side is sparse or noisy, such as aligning histology with proteomics or methylation arrays, as long as a meaningful similarity order exists.
  • The reported gains might partly come from the gap-enlargement term acting as a feature-space regularizer rather than from alignment per se; a controlled comparison against a ranking loss that only enforces order, without the gene-gap target, would separate the two effects.
  • The method's transfer promise suggests a testable pathway: fine-tune on one organ's spatial transcriptomics pairs and evaluate whether the learned image encoder improves gene-guided tasks on other organs; the authors note only breast and lung have been tested, so the natural next experiment is brain, kidney, or skin data.
  • Because the teacher encoder starts from a foundation model and is fine-tuned with gene ranking signals, the resulting representation could serve as a drop-in initializer for weakly supervised whole slide models, potentially improving tasks where molecular subtype is the label but only slides are available.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 4 minor

Summary. The paper proposes RankByGene, a representation learning framework for aligning spatial transcriptomics (ST) gene expression with histopathology image patches. The method combines three losses: a gene-image InfoNCE contrastive loss for spot-level alignment, a cross-modal ranking consistency loss that encourages the image-feature similarity ranking of spot triplets to match the gene-feature ranking (with the additional requirement that image similarity gaps be at least as large as gene similarity gaps), and an intra-modal teacher-student distillation loss for robustness to augmentation and gene-expression noise. The image encoder is trained on ST data and then evaluated on gene expression prediction (three ST test sets), slide-level classification (BCNB, TCGA-LUAD mutation), and survival analysis (TCGA-BRCA, TCGA-LUAD). The central claim is that the ranking-based alignment produces image features that better reflect gene expression, yielding 9--34% relative PCC improvements over the best baseline in Table 1 and improved downstream performance on most endpoints.

Significance. If the mechanism holds, the ranking-consistency idea is a plausible and potentially useful alternative to direct distance alignment for cross-modal ST-histology learning, and the paper's grounding in cancer-specific gene lists from the Human Protein Atlas is a strength. The experimental work is systematic: consistent improvements on gene expression prediction across three ST test sets, ablations of each loss component and hyperparameter, and evaluation on multiple downstream tasks. The manuscript is generally clearly written, and the computational acceleration of the O(N^3) ranking loss to O(N^2) sampled triplets is practical. However, the central mechanism is not yet fully established: the ranking loss is computed using the output of a jointly trained gene encoder without a stop-gradient, so the improvement could be partly attributable to reshaping the gene-feature geometry rather than to genuinely gene-guided image features. This is a correctness risk that requires an additional experiment, not just a wording change. Reproducibility is also incomplete because no code or gene lists are released.

major comments (3)
  1. [Section 3.2, Eq. (4); Section 8] The ranking loss Lrank is computed using SG values from the same 3-layer MLP gene encoder that is trained jointly with the image encoder, and no stop-gradient is applied to the gene encoder for Lrank. The constraint SI_p,q - SI_p,r >= SG_p,q - SG_p,r can therefore be satisfied by deforming gene-feature similarities instead of improving image-to-gene alignment. The gene encoder is anchored by InfoNCE so it cannot collapse, but its similarity geometry is free to drift, and the rank-accuracy criterion in Section 8 is measured on those gene embeddings. This undermines the central claim that the learned image features are gene-guided. Please add an ablation with a frozen gene encoder (or with gradients detached from the gene encoder for Lrank) and confirm that the improvement in Table 1 persists, or show that the benefit of Lrank is not primarily due to gene-feature adaptation.
  2. [Section 4.3 and Supplementary Section 8] Rank Accuracy is computed using gene embeddings rather than raw gene expression values and is used as the criterion for model convergence. Because those embeddings are produced by the co-trained gene encoder, this metric is partly self-referential: an increase in Rank Accuracy can reflect changes in gene-feature geometry induced by Lrank rather than a genuine correspondence with the raw transcriptomic signal. Please recompute Rank Accuracy using raw expression profiles or a held-out gene encoder and report it in Figure 6, so that Figure 6 supports the claim that rank relationships in the gene features are captured by the image features.
  3. [Table 2 and Section 4.1] The survival and several classification improvements over the strongest baseline are within one standard deviation when the reported error bars are considered. For example, TCGA-BRCA C-Index is 0.681±0.051 for RankByGene versus 0.672±0.039 for BLEEP, and EGFR AUC is 0.855±0.037 for RankByGene versus 0.862±0.028 for BLEEP, with overlapping intervals. The text in Section 4.1 states that RankByGene 'achieves strong AUC performance on most mutation statuses' and 'achieves the highest C-Index'; this overstates the evidence. Please add a statistical significance test (e.g., paired bootstrap over cross-validation folds) or soften the downstream claims and present the gene expression prediction results in Table 1 as the primary evidence for the alignment improvement.
minor comments (4)
  1. [Section 3.2, text after Eq. (4)] The sentence 'we need a loss to enforce ℓ(·) to be nonnega-tive' contradicts the intended goal; it should read 'non-positive', since the hinge loss max{0, ℓ(p,q,r)} penalizes positive values of ℓ.
  2. [Figure 3 caption] The caption states 'the gap between gene feature similarities SI_p,q and SI_p,r'; the superscript should be G, not I, to denote gene-feature similarities.
  3. [Supplementary Section 6 and Implementation Details] The cancer-specific gene lists are stated to be available 'upon acceptance' and no code is released; please provide the complete gene lists and code to support reproducibility.
  4. [Abstract and Section 4] The abstract says 'seven public datasets,' but the main text reports three ST test sets, two classification sets, and two survival cohorts. Please clarify whether these are seven evaluation datasets (some from the same TCGA/BCNB collections) to avoid ambiguity.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity found: the central gene-expression and downstream claims are evaluated on held-out data and independent clinical benchmarks, not on quantities equivalent to the training losses by construction.

full rationale

RankByGene's derivation chain is a representation-learning pipeline rather than a closed-form derivation, and I found no step where a predicted quantity is equal to an input or fitted parameter by construction. The ranking loss (Eqs. 3-4) penalizes inconsistency between image-feature similarity rankings and gene-feature similarity rankings, but the gene-feature rankings are outputs of a separately parameterized MLP; the loss is minimized only through training and is not satisfied by definition. The gene encoder is jointly trained, so improved rank consistency could in principle reflect gene-feature adaptation rather than image-side alignment (the skeptic's concern), but this is a training-dynamics correctness risk, not a circular reduction: the paper's headline PCC numbers in Table 1 are computed against raw held-out gene expression values (Section 9.1), not against the co-trained gene embeddings. The cancer-specific gene lists come from the external Human Protein Atlas, not from the test folds, and the downstream evaluations on BCNB, TCGA-LUAD, and TCGA-BRCA are independent image-only tasks. Self-citations in the related work ([5], [34], [35], [80]) are descriptive and not load-bearing for the method's claims. The acknowledged organ-generalization limitation (Supplementary Section 13) is a scope limitation, not evidence of circularity. One minor diagnostic caveat is that rank accuracy during training is measured on gene embeddings rather than raw expression values (Supplementary Section 8), which makes Figure 6 partly self-referential as a visualization, but the main quantitative claims do not depend on that metric. Overall, the result is self-contained against external benchmarks and no constructional equivalence between output and input is exhibited.

Assumptions & free parameters 4 free parameters · 6 assumptions · 0 invented entities

The central claim rests on hyperparameters tuned on a single dataset (lambda_1, lambda_2), standard contrastive and distillation assumptions, and two ad hoc assumptions specific to the proposed ranking loss. No new physical or categorical entities are introduced. The gene list comes from an external resource but its selection for downstream tasks injects a domain assumption.

free parameters (4)
  • lambda_1 (ranking loss weight) = 5
    Weight of the cross-modal ranking loss, tuned on Breast-ST1 validation; values tested 0, 2, 5, 10, best at 5 (Table 3a).
  • lambda_2 (distillation loss weight) = 1
    Weight of the intra-modal distillation loss, tuned on Breast-ST1 validation; values tested 0, 0.5, 1, 2, best at 1 (Table 3b).
  • temperature tau = 0.1
    Temperature for the InfoNCE and distillation losses, set to 0.1 following prior work [77], not ablated in the paper.
  • EMA momentum rate = 0.96
    Exponential moving average rate for teacher weights, chosen by hand (Supplementary Section 8), not ablated.
assumptions (6)
  • domain assumption Gene expression and image morphology of the same tissue spot align in a shared latent space.
    The premise of the Gene-Image Contrastive Loss (Eq. 1), which assumes positive pairs (same spot) should be pulled together.
  • ad hoc to paper Relative similarity rankings between spots are comparable across image and gene modalities.
    Core premise of the Cross-Modal Ranking Consistency Loss (Section 3.2, Eq. 3), not derived from first principles.
  • ad hoc to paper Enforcing image similarity gaps to be at least as large as gene similarity gaps improves alignment.
    The modified margin in Eq. (3) that forces image features to spread at least as much as gene features; a heuristic choice with empirical support only.
  • domain assumption Teacher-student EMA distillation with strong/weak augmentations yields stable gene-guided image features.
    Standard self-supervised distillation assumption (Section 3.3), adapted from DINO-style methods [11,55].
  • domain assumption The Human Protein Atlas prognosis-related gene list is a suitable supervision signal for downstream survival and classification.
    Used in the cancer-specific gene selection (Section 4); the list is external but its relevance to the specific downstream tasks is assumed.
  • domain assumption L1 normalization, log transformation, and 8-neighborhood smoothing preserve biological gene expression signal.
    Preprocessing pipeline following HEST-1k [32], applied to all ST data before training and evaluation.

how reviews work

0 comments
Cite this review

Pith. "Pith review of RankByGene: Gene-Guided Histopathology Representation Learning Through Cross-Modal Ranking Consistency." pith.science (2026). https://pith.science/paper/K53X6HAB

@misc{pith2026241115076,
  author       = {Pith},
  title        = {Pith review of: RankByGene: Gene-Guided Histopathology Representation Learning Through Cross-Modal Ranking Consistency},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/K53X6HAB}},
  note         = {Machine review of arXiv:2411.15076}
}
read the original abstract

Spatial transcriptomics (ST) provides essential spatial context by mapping gene expression within tissue, enabling detailed study of cellular heterogeneity and tissue organization. However, aligning ST data with histology images poses challenges due to inherent spatial distortions and modality-specific variations. Existing methods largely rely on direct alignment, which often fails to capture complex cross-modal relationships. To address these limitations, we propose a novel framework that aligns gene and image features using a ranking-based alignment loss, preserving relative similarity across modalities and enabling robust multi-scale alignment. To further enhance the alignment's stability, we employ self-supervised knowledge distillation with a teacher-student network architecture, effectively mitigating disruptions from high dimensionality, sparsity, and noise in gene expression data. Extensive experiments on seven public datasets that encompass gene expression prediction, slide-level classification, and survival analysis demonstrate the efficacy of our method, showing improved alignment and predictive performance over existing methods.

Figures

Figures reproduced from arXiv: 2411.15076 by the authors.

Figure 1
Figure 1. t-SNE [70] visualization of image features of different spots in a ST slide. We show the feature learned using different methods, including (a) SSL on natural images, (b) SSL on histopathology images, (c) CL on ST data using InfoNCE loss [32], and (d) RankByGene. Learning with gene information (c) clearly outperforms learning with images alone ((a) and (b)). Furthermore, our method (d) achieves even greater improvem… view at source ↗
Figure 2
Figure 2. Overview of our RankbyGene framework. The framework begins with WSI Tiling, where WSIs are cut into patches, each paired with a gene spot. In feature extraction, weak and strong augmentations of the patches are processed through a teacher and student encoder, while a gene encoder extracts features from the gene profile. The feature alignment stage ensures that weakly and strongly augmented image features are aligned… view at source ↗
Figure 3
Figure 3. Illustration of the ranking loss intuition, when the gene features [PITH_FULL_IMAGE:figures/full_fig_p005_3.png] view at source ↗
Figures from the paper (6 more)
Figure 4
Figure 4. Figure 4: Comparison of gene-image distances from 100 randomly sampled spot pairs. Each point represents the gene and image distance [PITH_FULL_IMAGE:figures/full_fig_p008_4.png]
Figure 5
Figure 5. Figure 5: Visualization of FASN gene expression predictions from different methods, with all values normalized to the range of 0 to 1. [PITH_FULL_IMAGE:figures/full_fig_p008_5.png]
Figure 6
Figure 6. Figure 6: Rank accuracy for different methods during training. [PITH_FULL_IMAGE:figures/full_fig_p008_6.png]
Figure 7
Figure 7. Figure 7: Additional visualizations of gene expression predictions for different genes using various methods, with all values normalized to [PITH_FULL_IMAGE:figures/full_fig_p016_7.png]
Figure 8
Figure 8. Figure 8: Additional visualizations of gene expression predictions for different genes using various methods, with all values normalized [PITH_FULL_IMAGE:figures/full_fig_p017_8.png]
Figure 9
Figure 9. Figure 9: Additional t-SNE visualizations of different samples from the breast ST dataset [ [PITH_FULL_IMAGE:figures/full_fig_p018_9.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

96 extracted references · 73 canonical work pages

  1. [1]

    https : / / www

    The cancer genome atlas program. https : / / www . cancer.gov/tcga, 2019. 6, 13

    2019

  2. [2]

    https://www

    Human breast cancer (block a section 1). https://www. 10xgenomics . com / datasets / human - breast - cancer- block- a- section- 1- 1- standard- 1- 1-0, 2020. 13

    2020

  3. [3]

    https : / / www

    Human breast cancer: Visium fresh frozen, whole tran- scriptome. https : / / www . 10xgenomics . com / datasets / human - breast - cancer - visium - fresh - frozen - whole - transcriptome - 1 - standard, 2022. 13

    2022

  4. [4]

    https : / / www

    The human protein atlas. https : / / www . proteinatlas . org / humanproteome / cancer ,

  5. [5]

    Multi-class cell detec- tion using spatial context representation

    Shahira Abousamra, David Belinsky, John Van Arnam, Fe- licia Allard, Eric Yee, Rajarsi Gupta, Tahsin Kurc, Dimitris Samaras, Joel Saltz, and Chao Chen. Multi-class cell detec- tion using spatial context representation. In ICCV, 2021. 1

    2021

  6. [6]

    Novatest: identifying genes with location-dependent noise variance in spatial transcrip- tomics data

    Mohammed Abid Abrar, M Kaykobad, M Saifur Rahman, and Md Abul Hassan Samee. Novatest: identifying genes with location-dependent noise variance in spatial transcrip- tomics data. Bioinformatics, 2023. 2

    2023

  7. [7]

    Spatial de- convolution of her2-positive breast cancer delineates tumor- associated cell type interactions

    Alma Andersson, Ludvig Larsson, Linnea Stenbeck, Fredrik Salm´en, Anna Ehinger, Sunny Z Wu, Ghamdan Al-Eryani, Daniel Roden, Alex Swarbrick, ˚Ake Borg, et al. Spatial de- convolution of her2-positive breast cancer delineates tumor- associated cell type interactions. Nature communications,

  8. [8]

    Robust cross-modal representation learning with progressive self- distillation

    Alex Andonian, Shixing Chen, and Raffay Hamid. Robust cross-modal representation learning with progressive self- distillation. In CVPR, 2022. 3

    2022

Show all 96 references
  1. [9]

    Digital pathology and computational image analysis in nephropathology

    Laura Barisoni, Kyle J Lafata, Stephen M Hewitt, Anant Madabhushi, and Ulysses GJ Balis. Digital pathology and computational image analysis in nephropathology. Nature Reviews Nephrology, 2020. 3

    2020

  2. [10]

    Learning to rank using gradient descent

    Chris Burges, Tal Shaked, Erin Renshaw, Ari Lazier, Matt Deeds, Nicole Hamilton, and Greg Hullender. Learning to rank using gradient descent. In ICML, 2005. 4

    2005

  3. [11]

    Emerg- ing properties in self-supervised vision transformers

    Mathilde Caron, Hugo Touvron, Ishan Misra, Herv ´e J´egou, Julien Mairal, Piotr Bojanowski, and Armand Joulin. Emerg- ing properties in self-supervised vision transformers. In ICCV, 2021. 3, 5, 15

    2021

  4. [12]

    Stimage-1k4m: A histopathology image-gene expression dataset for spatial transcriptomics

    Jiawen Chen, Muqing Zhou, Wenrong Wu, Jinwei Zhang, Yun Li, and Didong Li. Stimage-1k4m: A histopathology image-gene expression dataset for spatial transcriptomics. In NeurIPS, 2024. 1, 3, 7, 16

    2024

  5. [13]

    Multimodal co-attention transformer for survival prediction in gigapixel whole slide images

    Richard J Chen, Ming Y Lu, Wei-Hung Weng, Tiffany Y Chen, Drew FK Williamson, Trevor Manz, Maha Shady, and Faisal Mahmood. Multimodal co-attention transformer for survival prediction in gigapixel whole slide images. InICCV,

  6. [14]

    Scaling vision transformers to gigapixel images via hierarchical self-supervised learning

    Richard J Chen, Chengkuan Chen, Yicong Li, Tiffany Y Chen, Andrew D Trister, Rahul G Krishnan, and Faisal Mah- mood. Scaling vision transformers to gigapixel images via hierarchical self-supervised learning. In CVPR, 2022. 2, 3

    2022

  7. [15]

    Towards a general-purpose foundation model for com- putational pathology

    Richard J Chen, Tong Ding, Ming Y Lu, Drew FK Williamson, Guillaume Jaume, Bowen Chen, Andrew Zhang, Daniel Shao, Andrew H Song, Muhammad Shaban, et al. Towards a general-purpose foundation model for com- putational pathology. Nature Medicine, 2024. 2, 3, 6, 7, 13, 16

    2024

  8. [16]

    A simple framework for contrastive learning of visual representations

    Ting Chen, Simon Kornblith, Mohammad Norouzi, and Ge- offrey Hinton. A simple framework for contrastive learning of visual representations. In ICML, 2020. 3

    2020

  9. [17]

    Accurate spatial gene expression prediction by integrating multi-resolution features

    Youngmin Chung, Ji Hun Ha, Kyeong Chan Im, and Joo Sang Lee. Accurate spatial gene expression prediction by integrating multi-resolution features. In CVPR, 2024. 3, 6, 7, 13

    2024

  10. [18]

    Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning

    Nicolas Coudray, Paolo Santiago Ocampo, Theodore Sakel- laropoulos, Navneet Narula, Matija Snuderl, David Feny ¨o, Andre L Moreira, Narges Razavian, and Aristotelis Tsirigos. Classification and mutation prediction from non–small cell lung cancer histopathology images using dee...

    2018

  11. [19]

    Solving the multiple instance problem with axis-parallel rectangles

    Thomas G Dietterich, Richard H Lathrop, and Tom ´as Lozano-P´erez. Solving the multiple instance problem with axis-parallel rectangles. Artificial intelligence, 1997. 3

    1997

  12. [20]

    Image analysis reveals molec- ularly distinct patterns of tils in nsclc associated with treat- ment outcome

    Ruiwen Ding, Prateek Prasanna, Germ ´an Corredor, Cristian Barrera, Philipp Zens, Cheng Lu, Priya Velu, Patrick Leo, Niha Beig, Haojia Li, et al. Image analysis reveals molec- ularly distinct patterns of tils in nsclc associated with treat- ment outcome. NPJ precision oncology...

    2022

  13. [21]

    A system- atic comparison of deep learning methods for gleason grad- ing and scoring

    Juan P Dominguez-Morales, Lourdes Duran-Lopez, Nic- col`o Marini, Saturnino Vicente-Diaz, Alejandro Linares- Barranco, Manfredo Atzori, and Henning M¨uller. A system- atic comparison of deep learning methods for gleason grad- ing and scoring. MedIA, 2024. 1

    2024

  14. [22]

    Cyclip: Cyclic contrastive language-image pretraining

    Shashank Goel, Hritik Bansal, Sumit Bhatia, Ryan Rossi, Vishwa Vinay, and Aditya Grover. Cyclip: Cyclic contrastive language-image pretraining. In NeruIPS, 2022. 3

    2022

  15. [23]

    Hover-net: Simultaneous segmentation and clas- sification of nuclei in multi-tissue histology images

    Simon Graham, Quoc Dang Vu, Shan E Ahmed Raza, Ayesha Azam, Yee Wah Tsang, Jin Tae Kwak, and Nasir Rajpoot. Hover-net: Simultaneous segmentation and clas- sification of nuclei in multi-tissue histology images. MedIA,

  16. [24]

    Integrating spatial gene expression and breast tumour morphology via deep learning

    Bryan He, Ludvig Bergenstr ˚ahle, Linnea Stenbeck, Abubakar Abid, Alma Andersson, ˚Ake Borg, Jonas 9 Maaskola, Joakim Lundeberg, and James Zou. Integrating spatial gene expression and breast tumour morphology via deep learning. Nature biomedical engineering, 2020. 6, 8, 16

    2020

  17. [25]

    Deep residual learning for image recognition

    Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. In CVPR,

  18. [26]

    Momentum contrast for unsupervised visual rep- resentation learning

    Kaiming He, Haoqi Fan, Yuxin Wu, Saining Xie, and Ross Girshick. Momentum contrast for unsupervised visual rep- resentation learning. In CVPR, 2020. 3

    2020

  19. [27]

    Cellvit: Vision trans- formers for precise cell segmentation and classification

    Fabian H ¨orst, Moritz Rempe, Lukas Heine, Constantin Sei- bold, Julius Keyl, Giulia Baldini, Selma Ugurel, Jens Siveke, Barbara Gr ¨unwald, Jan Egger, et al. Cellvit: Vision trans- formers for precise cell segmentation and classification. Me- dIA, 2024. 1

    2024

  20. [28]

    A visual–language foundation model for pathology image analysis using medical twitter

    Zhi Huang, Federico Bianchi, Mert Yuksekgonul, Thomas J Montine, and James Zou. A visual–language foundation model for pathology image analysis using medical twitter. Nature Medicine, 2023. 3

    2023

  21. [29]

    Position: The platonic representation hypothesis

    Minyoung Huh, Brian Cheung, Tongzhou Wang, and Phillip Isola. Position: The platonic representation hypothesis. In ICML, 2024. 2

    2024

  22. [30]

    Attention-based deep multiple instance learning

    Maximilian Ilse, Jakub Tomczak, and Max Welling. Attention-based deep multiple instance learning. In ICML,

  23. [31]

    nnu-net: a self-configuring method for deep learning-based biomedical image segmen- tation

    Fabian Isensee, Paul F Jaeger, Simon AA Kohl, Jens Pe- tersen, and Klaus H Maier-Hein. nnu-net: a self-configuring method for deep learning-based biomedical image segmen- tation. Nature Methods, 2021. 1

    2021

  24. [32]

    Hest-1k: A dataset for spatial transcriptomics and his- tology image analysis

    Guillaume Jaume, Paul Doucet, Andrew H Song, Ming Y Lu, Cristina Almagro-P ´erez, Sophia J Wagner, Anurag J Vaidya, Richard J Chen, Drew FK Williamson, Ahrong Kim, et al. Hest-1k: A dataset for spatial transcriptomics and his- tology image analysis. In NeurIPS, 2024. 1, 2, 3, ...

    2024

  25. [33]

    Multimodal analysis of composition and spatial ar- chitecture in human squamous cell carcinoma

    Andrew L Ji, Adam J Rubin, Kim Thrane, Sizun Jiang, David L Reynolds, Robin M Meyers, Margaret G Guo, Ben- son M George, Annelie Mollbrink, Joseph Bergenstr ˚ahle, et al. Multimodal analysis of composition and spatial ar- chitecture in human squamous cell carcinoma. Cell, 2020. 1

    2020

  26. [34]

    Si-mil: Taming deep mil for self-interpretability in gigapixel histopathology

    Saarthak Kapse, Pushpak Pati, Srijan Das, Jingwei Zhang, Chao Chen, Maria Vakalopoulou, Joel Saltz, Dimitris Sama- ras, Rajarsi R Gupta, and Prateek Prasanna. Si-mil: Taming deep mil for self-interpretability in gigapixel histopathology. In CVPR, 2024. 1

    2024

  27. [35]

    Uti- lizing automated breast cancer detection to identify spatial distributions of tumor-infiltrating lymphocytes in invasive breast cancer

    Han Le, Rajarsi Gupta, Le Hou, Shahira Abousamra, Danielle Fassler, Luke Torre-Healy, Richard A Moffitt, Tahsin Kurc, Dimitris Samaras, Rebecca Batiste, et al. Uti- lizing automated breast cancer detection to identify spatial distributions of tumor-infiltrating lymphocytes in ...

    2020

  28. [36]

    Dual-stream multi- ple instance learning network for whole slide image classi- fication with self-supervised contrastive learning

    Bin Li, Yin Li, and Kevin W Eliceiri. Dual-stream multi- ple instance learning network for whole slide image classi- fication with self-supervised contrastive learning. In CVPR,

  29. [37]

    Sd2: spatially resolved transcriptomics deconvolution through in- tegration of dropout and spatial information

    Haoyang Li, Hanmin Li, Juexiao Zhou, and Xin Gao. Sd2: spatially resolved transcriptomics deconvolution through in- tegration of dropout and spatial information. Bioinformatics,

  30. [38]

    A comprehensive benchmarking with practical guidelines for cellular deconvolution of spatial tran- scriptomics

    Haoyang Li, Juexiao Zhou, Zhongxiao Li, Siyuan Chen, Xingyu Liao, Bin Zhang, Ruochi Zhang, Yu Wang, Shiwei Sun, and Xin Gao. A comprehensive benchmarking with practical guidelines for cellular deconvolution of spatial tran- scriptomics. Nature Communications, 2023. 2

    2023

  31. [39]

    Task-specific fine-tuning via variational information bottle- neck for weakly-supervised pathology whole slide image classification

    Honglin Li, Chenglu Zhu, Yunlong Zhang, Yuxuan Sun, Zhongyi Shui, Wenwei Kuang, Sunyi Zheng, and Lin Yang. Task-specific fine-tuning via variational information bottle- neck for weakly-supervised pathology whole slide image classification. In CVPR, 2023. 3

    2023

  32. [40]

    Scaling language-image pre-training via masking

    Yanghao Li, Haoqi Fan, Ronghang Hu, Christoph Feichten- hofer, and Kaiming He. Scaling language-image pre-training via masking. In CVPR, 2023. 3

    2023

  33. [41]

    Interventional bag multi-instance learning on whole-slide pathological images

    Tiancheng Lin, Zhimiao Yu, Hongyu Hu, Yi Xu, and Chang- Wen Chen. Interventional bag multi-instance learning on whole-slide pathological images. In CVPR, 2023. 3

    2023

  34. [42]

    Multiple instance learning via iterative self-paced supervised contrastive learning

    Kangning Liu, Weicheng Zhu, Yiqiu Shen, Sheng Liu, Narges Razavian, Krzysztof J Geras, and Carlos Fernandez- Granda. Multiple instance learning via iterative self-paced supervised contrastive learning. In CVPR, 2023. 3, 13

    2023

  35. [43]

    Ai- based pathology predicts origins for cancers of unknown pri- mary

    Ming Y Lu, Tiffany Y Chen, Drew FK Williamson, Melissa Zhao, Maha Shady, Jana Lipkova, and Faisal Mahmood. Ai- based pathology predicts origins for cancers of unknown pri- mary. Nature, 2021. 3

    2021

  36. [44]

    Data-efficient and weakly supervised computational pathology on whole- slide images

    Ming Y Lu, Drew FK Williamson, Tiffany Y Chen, Richard J Chen, Matteo Barbieri, and Faisal Mahmood. Data-efficient and weakly supervised computational pathology on whole- slide images. Nature biomedical engineering, 2021. 1, 13, 14

    2021

  37. [45]

    Visual language pre- trained multiple instance zero-shot transfer for histopathol- ogy images

    Ming Y Lu, Bowen Chen, Andrew Zhang, Drew FK Williamson, Richard J Chen, Tong Ding, Long Phi Le, Yung- Sung Chuang, and Faisal Mahmood. Visual language pre- trained multiple instance zero-shot transfer for histopathol- ogy images. In CVPR, 2023. 3

    2023

  38. [46]

    A visual- language foundation model for computational pathology

    Ming Y Lu, Bowen Chen, Drew FK Williamson, Richard J Chen, Ivy Liang, Tong Ding, Guillaume Jaume, Igor Odintsov, Long Phi Le, Georg Gerber, et al. A visual- language foundation model for computational pathology. Nature Medicine, 2024. 3

    2024

  39. [47]

    Method of the year: spatially resolved tran- scriptomics

    Vivien Marx. Method of the year: spatially resolved tran- scriptomics. Nature methods, 2021. 1

    2021

  40. [48]

    Multimodal contrastive learning for spatial gene expression prediction using histology images

    Wenwen Min, Zhiceng Shi, Jun Zhang, Jun Wan, and Chang- miao Wang. Multimodal contrastive learning for spatial gene expression prediction using histology images. arXiv, 2024. 1, 2, 3

    2024

  41. [49]

    Spatially resolved transcriptomic profiling of degraded and challenging fresh frozen samples

    Reza Mirzazadeh, Zaneta Andrusivova, Ludvig Larsson, Phillip T Newton, Leire Alonso Galicia, Xes ´us M Abalo, Mahtab Avijgan, Linda Kvastad, Alexandre Denadai-Souza, Nathalie Stakenborg, et al. Spatially resolved transcriptomic profiling of degraded and challenging fresh froze...

    2023

  42. [50]

    Molecular, spatial, and functional single-cell profiling of the hypothalamic preoptic region.Science, 2018

    Jeffrey R Moffitt, Dhananjay Bambah-Mukku, Stephen W Eichhorn, Eric Vaughn, Karthik Shekhar, Julio D Perez, 10 Nimrod D Rubinstein, Junjie Hao, Aviv Regev, Catherine Dulac, et al. Molecular, spatial, and functional single-cell profiling of the hypothalamic preoptic region.Scie...

    2018

  43. [51]

    Mapping and quantifying mammalian transcriptomes by rna-seq

    Ali Mortazavi, Brian A Williams, Kenneth McCue, Lorian Schaeffer, and Barbara Wold. Mapping and quantifying mammalian transcriptomes by rna-seq. Nature methods ,

  44. [52]

    A note on a general definition of the coefficient of determination

    Nico JD Nagelkerke et al. A note on a general definition of the coefficient of determination. biometrika, 1991. 8

    1991

  45. [53]

    Digital pathology and artificial intelli- gence

    Muhammad Khalid Khan Niazi, Anil V Parwani, and Metin N Gurcan. Digital pathology and artificial intelli- gence. The lancet oncology, 2019. 3

    2019

  46. [54]

    Repre- sentation learning with contrastive predictive coding

    Aaron van den Oord, Yazhe Li, and Oriol Vinyals. Repre- sentation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748, 2018. 4

    2018 arXiv

  47. [55]

    Dinov2: Learning robust visual features without supervision

    Maxime Oquab, Timoth ´ee Darcet, Th ´eo Moutakanni, Huy V o, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, et al. Dinov2: Learning robust visual features without supervision. arXiv preprint arXiv:2304.07193, 2023. 5

    2023 arXiv

  48. [56]

    Leverag- ing information in spatial transcriptomics to predict super- resolution gene expression from histology images in tumors

    Minxing Pang, Kenong Su, and Mingyao Li. Leverag- ing information in spatial transcriptomics to predict super- resolution gene expression from histology images in tumors. BioRxiv, 2021. 6, 16

    2021

  49. [57]

    Bi- directional weakly supervised knowledge distillation for whole slide image classification

    Linhao Qu, Manning Wang, Zhijian Song, et al. Bi- directional weakly supervised knowledge distillation for whole slide image classification. In NeurIPS, 2022. 3

    2022

  50. [58]

    Boosting whole slide image classification from the perspectives of dis- tribution, correlation and magnification

    Linhao Qu, Zhiwei Yang, Minghong Duan, Yingfan Ma, Shuo Wang, Manning Wang, and Zhijian Song. Boosting whole slide image classification from the perspectives of dis- tribution, correlation and magnification. In CVPR, 2023. 3

    2023

  51. [59]

    Learn- ing transferable visual models from natural language super- vision

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learn- ing transferable visual models from natural language super- vision. In ICML, 2021. 2, 3

    2021

  52. [60]

    Exploring tissue architecture using spatial transcriptomics

    Anjali Rao, Dalia Barkley, Gustavo S Franc ¸a, and Itai Yanai. Exploring tissue architecture using spatial transcriptomics. Nature, 2021. 1

    2021

  53. [61]

    V-measure: A con- ditional entropy-based external cluster evaluation measure

    Andrew Rosenberg and Julia Hirschberg. V-measure: A con- ditional entropy-based external cluster evaluation measure. In EMNLP-CoNLL, 2007. 2

    2007

  54. [62]

    Single-cell rna-seq: ad- vances and future challenges

    Antoine-Emmanuel Saliba, Alexander J Westermann, Stanislaw A Gorski, and J¨org V ogel. Single-cell rna-seq: ad- vances and future challenges. Nucleic acids research, 2014. 1

    2014

  55. [63]

    Transmil: Transformer based correlated multiple instance learning for whole slide image classification

    Zhuchen Shao, Hao Bian, Yang Chen, Yifeng Wang, Jian Zhang, Xiangyang Ji, et al. Transmil: Transformer based correlated multiple instance learning for whole slide image classification. In NeurIPS, 2021. 3

    2021

  56. [64]

    Multimodal prototyping for cancer survival prediction

    Andrew H Song, Richard J Chen, Guillaume Jaume, Anurag J Vaidya, Alexander S Baras, and Faisal Mahmood. Multimodal prototyping for cancer survival prediction. In ICML, 2024. 3

    2024

  57. [65]

    Visualization and analysis of gene expression in tissue sections by spatial transcriptomics

    Patrik L St ˚ahl, Fredrik Salm´en, Sanja Vickovic, Anna Lund- mark, Jos ´e Fern ´andez Navarro, Jens Magnusson, Stefania Giacomello, Michaela Asp, Jakub O Westholm, Mikael Huss, et al. Visualization and analysis of gene expression in tissue sections by spatial transcriptomics....

    2016

  58. [66]

    Exponential scaling of single-cell rna-seq in the past decade

    Valentine Svensson, Roser Vento-Tormo, and Sarah A Teich- mann. Exponential scaling of single-cell rna-seq in the past decade. Nature protocols, 2018. 1

    2018

  59. [67]

    mrna-seq whole-transcriptome analysis of a single cell

    Fuchou Tang, Catalin Barbacioru, Yangzhou Wang, Ellen Nordman, Clarence Lee, Nanlan Xu, Xiaohui Wang, John Bodeau, Brian B Tuch, Asim Siddiqui, et al. mrna-seq whole-transcriptome analysis of a single cell. Nature meth- ods, 2009. 1

    2009

  60. [68]

    Multiple instance learning framework with masked hard instance mining for whole slide image classification

    Wenhao Tang, Sheng Huang, Xiaoxian Zhang, Fengtao Zhou, Yi Zhang, and Bo Liu. Multiple instance learning framework with masked hard instance mining for whole slide image classification. In CVPR, 2023. 3

    2023

  61. [69]

    Feature re-embedding: Towards foun- dation model-level performance in computational pathology

    Wenhao Tang, Fengtao Zhou, Sheng Huang, Xiang Zhu, Yi Zhang, and Bo Liu. Feature re-embedding: Towards foun- dation model-level performance in computational pathology. In CVPR, 2024. 3

    2024

  62. [70]

    Visualizing data using t-sne

    Laurens Van der Maaten and Geoffrey Hinton. Visualizing data using t-sne. JMLR, 2008. 2

    2008

  63. [71]

    Genome-wide spatial expression profiling in formalin-fixed tissues

    Eva Gracia Villacampa, Ludvig Larsson, Reza Mirzazadeh, Linda Kvastad, Alma Andersson, Annelie Mollbrink, Geor- gia Kokaraki, Vanessa Monteil, Niklas Schultz, Karin Sofia Appelberg, et al. Genome-wide spatial expression profiling in formalin-fixed tissues. Cell Genomics, 2021. 13

    2021

  64. [72]

    A foundation model for clinical-grade computational pathology and rare cancers detection

    Eugene V orontsov, Alican Bozkurt, Adam Casson, George Shaikovski, Michal Zelechowski, Kristen Severson, Eric Zimmermann, James Hall, Neil Tenenholtz, Nicolo Fusi, et al. A foundation model for clinical-grade computational pathology and rare cancers detection. Nature medicine ,

  65. [73]

    Uctransnet: rethinking the skip connections in u-net from a channel-wise perspective with transformer

    Haonan Wang, Peng Cao, Jiaqi Wang, and Osmar R Zaiane. Uctransnet: rethinking the skip connections in u-net from a channel-wise perspective with transformer. InAAAI, 2022. 1

    2022

  66. [74]

    Transpath: Transformer-based self-supervised learning for histopatho- logical image classification

    Xiyue Wang, Sen Yang, Jun Zhang, Minghui Wang, Jing Zhang, Junzhou Huang, Wei Yang, and Xiao Han. Transpath: Transformer-based self-supervised learning for histopatho- logical image classification. In MICCAI, 2021. 2, 3, 6, 7, 16

    2021

  67. [75]

    A pathology foundation model for cancer diagnosis and prognosis prediction

    Xiyue Wang, Junhan Zhao, Eliana Marostica, Wei Yuan, Ji- etian Jin, Jiayu Zhang, Ruijiang Li, Hongping Tang, Kanran Wang, Yu Li, et al. A pathology foundation model for cancer diagnosis and prognosis prediction. Nature, 2024. 2, 3

    2024

  68. [76]

    Rna-seq: a revolutionary tool for transcriptomics

    Zhong Wang, Mark Gerstein, and Michael Snyder. Rna-seq: a revolutionary tool for transcriptomics. Nature reviews ge- netics, 2009. 1

    2009

  69. [77]

    Spatially resolved gene expression prediction from histology images via bi- modal contrastive learning

    Ronald Xie, Kuan Pang, Sai Chung, Catia Perciani, Sonya MacParland, Bo Wang, and Gary Bader. Spatially resolved gene expression prediction from histology images via bi- modal contrastive learning. In NeurIPS, 2023. 1, 2, 3, 6, 7, 13, 16

    2023

  70. [78]

    Predicting axillary lymph node metastasis in early breast cancer using deep learning on primary tumor biopsy slides

    Feng Xu, Chuang Zhu, Wenqi Tang, Ying Wang, Yu Zhang, Jie Li, Hongchuan Jiang, Zhongyue Shi, Jun Liu, and Mulan Jin. Predicting axillary lymph node metastasis in early breast cancer using deep learning on primary tumor biopsy slides. Frontiers in oncology, 2021. 6, 13 11

    2021

  71. [79]

    A whole-slide foundation model for digital pathology from real-world data

    Hanwen Xu, Naoto Usuyama, Jaspreet Bagga, Sheng Zhang, Rajesh Rao, Tristan Naumann, Cliff Wong, Zelalem Gero, Javier Gonz ´alez, Yu Gu, et al. A whole-slide foundation model for digital pathology from real-world data. Nature,

  72. [80]

    Semi-supervised segmentation of histopathology images with noise-aware topological con- sistency

    Meilong Xu, Xiaoling Hu, Saumya Gupta, Shahira Abousamra, and Chao Chen. Semi-supervised segmentation of histopathology images with noise-aware topological con- sistency. In ECCV, 2025. 1

    2025

  73. [81]

    Multimodal optimal transport- based co-attention transformer with global structure consis- tency for survival prediction

    Yingxue Xu and Hao Chen. Multimodal optimal transport- based co-attention transformer with global structure consis- tency for survival prediction. In ICCV, 2023. 3, 6, 14

    2023

  74. [82]

    Dtfd- mil: Double-tier feature distillation multiple instance learn- ing for histopathology whole slide image classification

    Hongrun Zhang, Yanda Meng, Yitian Zhao, Yihong Qiao, Xiaoyun Yang, Sarah E Coupland, and Yalin Zheng. Dtfd- mil: Double-tier feature distillation multiple instance learn- ing for histopathology whole slide image classification. In CVPR, 2022. 3

    2022

  75. [83]

    Attention-challenging multi- ple instance learning for whole slide image classification

    Yunlong Zhang, Honglin Li, Yuxuan Sun, Sunyi Zheng, Chenglu Zhu, and Lin Yang. Attention-challenging multi- ple instance learning for whole slide image classification. In ECCV, 2024. 3

    2024

  76. [84]

    Prototypical information bottlenecking and dis- entangling for multimodal cancer survival prediction

    Yilan Zhang, Yingxue Xu, Jianqi Chen, Fengying Xie, and Hao Chen. Prototypical information bottlenecking and dis- entangling for multimodal cancer survival prediction. In ICLR, 2024. 3

    2024

  77. [85]

    Rankclip: Ranking- consistent language-image pretraining

    Yiming Zhang, Zhuokai Zhao, Zhaorun Chen, Zhili Feng, Zenghui Ding, and Yining Sun. Rankclip: Ranking- consistent language-image pretraining. arXiv, 2024. 3

    2024

  78. [86]

    Cross-modal translation and alignment for survival analysis

    Fengtao Zhou and Hao Chen. Cross-modal translation and alignment for survival analysis. In ICCV, 2023. 3, 6, 14

    2023

  79. [87]

    Dgr-mil: Exploring diverse global representation in multiple instance learning for whole slide image classification

    Wenhui Zhu, Xiwen Chen, Peijie Qiu, Aristeidis Sotiras, Abolfazl Razi, and Yalin Wang. Dgr-mil: Exploring diverse global representation in multiple instance learning for whole slide image classification. In ECCV, 2024. 3 12 RankByGene: Gene-Guided Histopathology Representation...

    2024

  80. [88]

    This resource provides gene lists corresponding to 31 different cancer types, each curated with validated genes most relevant to the specific cancer type

    Selection of Cancer-Specific Gene List Unlike existing methods that select highly expressed genes for gene-image alignment, we select prognosis-related genes from the Human Protein Atlas [4] for downstream tasks. This resource provides gene lists corresponding to 31 different ...

  81. [89]

    The Breast ST dataset used for train- ing [7] contains 36 ST samples, each with approximately 15,000 genes

    Details of Datasets Breast ST datasets. The Breast ST dataset used for train- ing [7] contains 36 ST samples, each with approximately 15,000 genes. Following the external evaluation approach in [17], we selected two Visium breast ST samples from 10x Genomics to assess our mode...

  82. [90]

    We predict ER, PR, and HER2 expression status on BCNB following [32] and genetic mutations of EGFR, KRAS, STK11, and TP53 on TCGA LUAD Mutation following [42]

    and TCGA LUAD mutation [18]. We predict ER, PR, and HER2 expression status on BCNB following [32] and genetic mutations of EGFR, KRAS, STK11, and TP53 on TCGA LUAD Mutation following [42]. We also perform survival prediction on TCGA-BRCA [1] and TCGA-LUAD [1]. For all WSIs, we...

  83. [91]

    In the training stage, we first filter the genes using the selected gene list, followed by multi-modal training with Breast ST [7] and Lung ST [49] dataset

    Implementation Details A typical pipeline for our method consists of two stages. In the training stage, we first filter the genes using the selected gene list, followed by multi-modal training with Breast ST [7] and Lung ST [49] dataset. In the testing stage, the trained image...

  84. [92]

    Gene Expression Prediction In this study, we assess the performance of gene expression prediction on a per-sample basis

    Details of Evaluation Metrics 9.1. Gene Expression Prediction In this study, we assess the performance of gene expression prediction on a per-sample basis. Specifically, we evaluate each model using three metrics: Pearson Correlation Coef- ficient (PCC), Mean Squared Error (MS...

  85. [93]

    We compare the effect of different values for the weight of the ranking consistency loss λ1 on the Breast-ST dataset

    Ablation Study Weight of Cross-Modal Ranking Consistency Loss. We compare the effect of different values for the weight of the ranking consistency loss λ1 on the Breast-ST dataset. The results in Table 3a show that the model is robust to the choice of the hyperparameter. The p...

  86. [94]

    Additional Results Gene Expression Prediction. As shown in Table 5, RankByGene outperforms all baseline methods across the Image Encoder C-Index TCGA-BRCA TCGA-LUAD RankByGene w Top Expressed Genes 0.6762 ± 0.0383 0.5826 ± 0.0352 RankByGene w Cancer-Specific Genes 0.6814 ± 0.0...

  87. [95]

    As shown in Figure 7, we select TUBA1C, ESRP1, MAL2, and RAB2A to visualize gene expression predictions

    Additional Visualizations Visualization for Genes in Breast ST Data. As shown in Figure 7, we select TUBA1C, ESRP1, MAL2, and RAB2A to visualize gene expression predictions. In the visualiza- tion, we especially observe the top left corner have high gene expression but there i...

  88. [96]

    Limitation Our method has been validated only on breast and lung ST datasets, and further experiments on other organs, such as the brain, skin, kidney, and heart, are necessary to demon- strate its generalizability. Additionally, due to resource lim- itations, we used UNI as t...

Pith tools

Reviewed August 12, 2026 · model on record in the stance chip above.