REVIEW 4 major objections 5 minor 16 references
Paired Uterine Whole-Slide Images and Pathology Reports for Multimodal Computational Pathology
T0 review · 4 major / 5 minor · reviewed 2026-08-02 · deepseek-v4-flash
Pith's one-line read The Uteria dataset pairs 455 uterine whole-slide images with diagnostic reports, giving multimodal pathology AI a clinically realistic training resource.
desk verdict A genuinely useful new multimodal pathology dataset, but the slide–report pairing validation is under-reported; I'd want revision before fully trusting the alignment. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the slide-level WSI–report pair. Since each case yields one report but up to three slides, the pipeline converts case-level reports into slide-level descriptions using an offline large language model, separates descriptions that carry explicit slide/block identifiers, flags reports without identifiers for manual review, and subjects all pairs to a multi-stage expert validation. The six diagnostic categories—normal, benign tumor, malignant tumor, precancerous lesion, inflammatory or reactive, and insufficient or uncertain—are assigned from the written findings and provide the supervised structure that makes the pairs usable for multimodal training and benchmarking.
What would settle it
Take a random sample of the 455 pairs, or all 71 manually resolved cases, and ask two independent pathologists to match each slide-level report to the correct WSI among the case's slides without knowing the released assignment. If their agreement with the released pairing is at or near chance, or if the two pathologists disagree substantially, the paper's central reliability claim is not supported.
Extended reading notes
Core claim
The paper presents Uteria, a publicly released dataset of 216 clinical cases comprising 455 H&E-stained whole-slide images, each paired at slide level with a diagnostic text extracted from the original German pathology report and translated into English. The core claim is that the slide–report pairing is clinically dependable: cases were collected from routine workflows rather than enriched for cancer, slide-level descriptions were produced by an LLM-assisted extraction pipeline with explicit flagging of ambiguous cases, 71 of 216 cases were manually resolved by experts, and the final pairs were reviewed by two pathologists and then by three pathology-AI researchers. Each pair also carries o
Load-bearing premise
The load-bearing premise is that each slide-level text genuinely corresponds to its paired whole-slide image; for 71 of the 216 cases that correspondence was assigned by manual judgment, and the paper reports no quantitative inter-rater agreement or independent check of those assignments.
Editorial extensions
If this is right
- If the pairing is trustworthy, models can be trained end-to-end to generate diagnostic narratives from whole-slide images and evaluated against these paired reports.
- Because the cohort mirrors routine clinical composition—56.7% normal or no significant abnormality and only 8.35% malignant—models trained here may generalize better to everyday pathology workloads than models trained on cancer-enriched datasets.
- Case-level identifiers allow patient-level data partitioning, so slides from the same patient can be kept together during training and evaluation, supporting multi-slide reasoning without leakage.
- The bilingual German–English reports enable cross-language report generation and a direct check of whether diagnostic meaning survives translation.
- The six diagnostic categories supply slide-level supervised labels for classification baselines, giving a common benchmark for future multimodal methods.
Reading between the lines
- A natural benchmark the paper does not build: hold out the 71 manually resolved cases as a hard pairing test, and check whether a vision–language model can distinguish true slide–report pairs from shuffled mismatches on those cases. If it cannot, the manual assignments may encode information not present in the images.
- The routine-clinical class imbalance—normal cases dominating—implies that the practical bottleneck for report generation on this dataset is producing accurate, conservative 'no abnormality' language, not recognizing malignancy.
- Future extensions could add immunohistochemistry slides and frozen sections, and report inter-pathologist agreement on the manual assignments; either would directly strengthen or bound the central reliability claim.
- The paired structure could support contrastive pretraining that links visual morphology to diagnostic wording, a recipe that might transfer to other gynecologic or organ-specific sites if the same report format is used.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces TUM-Uteria, a publicly released uterine pathology dataset containing 216 clinical cases and 455 H&E-stained whole-slide images (WSIs) paired with diagnostic pathology reports at both case and slide levels. The dataset was collected from routine diagnostic workflows at a tertiary medical center, with German pathology reports translated into English. The manuscript describes a multi-stage pipeline that includes specimen collection and WSI scanning, three-step report anonymization using an offline LLM (Qwen-30B), slide-level report extraction with LLM assistance, manual adjudication for ambiguous cases, expert review by pathologists, and final quality control. It also reports dataset statistics such as age distribution, WSI counts per case, and diagnostic category frequencies. The authors claim the dataset supports multimodal computational pathology tasks such as automated report generation and AI-assisted diagnosis.
Significance. If the claimed pairing reliability holds, TUM-Uteria fills a genuine gap: it provides slide-level WSI–text pairs drawn from routine clinical practice, including a realistic mix of benign, precancerous, and malignant uterine pathology, and includes both German and English report versions. The construction pipeline is described in sufficient detail to be reproduced, the dataset is made available through a gated Hugging Face repository, and the validation workflow involves domain experts, which strengthens the resource. However, the central claim that each WSI is paired with a faithful slide-level text description is not backed by quantitative evidence. Since the dataset's utility for multimodal learning depends directly on the correctness of these pairs, the absence of inter-rater agreement, exclusion counts, LLM extraction accuracy, and audit metrics is a load-bearing weakness rather than a cosmetic issue.
major comments (4)
- [§2.2.1 / §5 (third validation paragraph)] The paper states that 71 of 216 cases required manual judgment to determine WSI–text correspondences, but reports no exclusion count, no inter-rater agreement statistic (e.g., Cohen’s kappa), and no repeat-annotation results for these assignments. Because these pairs are the core deliverable of the dataset, the reader cannot verify the reliability of the alignment. Please report the number of cases/WSIs that were excluded after manual review, the number of assignments independently adjudicated by both pathologists, and an agreement metric, or at minimum a quantitative audit of a random sample.
- [§2.2.1 / §5 (expert review step)] The criterion for inclusion, 'sufficient confidence,' is never operationalized. In addition, the two pathology experts reviewed all automatically extracted pairs, but the manuscript reports no outcome of that review: no count of corrected assignments, no error rate for the automatic LLM-based slide-level extraction, and no characterization of the types or frequency of errors found. Without these numbers, the claim that the released pairs are 'high-quality' and 'reliable' is unsupported. Please define the confidence threshold or describe the adjudication protocol, and report how many pairs were corrected or rejected during expert review.
- [§3 / Fig. 2C] The text states there were 'no significant differences in age or diagnostic category distribution' between cases with 1–3 WSIs and those with 4 or more WSIs, but no statistical test, effect size, or p-value is reported. This comparison is used to justify the retention of cases with at most 3 WSIs, which directly shapes the released dataset. Please provide the test used, the test statistic, and the p-values (or confidence intervals) for the age and category comparisons.
- [§2.2 / §2.2.1 / §5 (LLM-based anonymization and extraction)] The Qwen-30B model is used for de-identification, residual-PHI screening, and slide-level text extraction, but no accuracy metrics are given for any of these steps. For a medical dataset, unanswered questions include: how many reports were flagged by the second LLM screen and what fraction required revision; and what the error rate of the slide-level extraction was relative to a gold standard. Even a small labeled evaluation set with precision/recall for extraction and a privacy audit on a held-out sample would substantiate the pipeline's reliability and mitigate the risk that subtle PHI leakage or text–slide misassignment is present.
minor comments (5)
- [§2.1 / Fig. 2D] The resolution is reported as 0.25 µm/pixel in the text and 0.26 µm/pixel in Figure 2D. Please reconcile this inconsistency.
- [§4] The Data Records section contains the placeholder '[DATA REPOSITORY LINK]' even though the abstract and Data Availability name the Hugging Face repository. Provide the actual URL or DOI for the dataset.
- [Fig. 2E] The WSI filename structure example appears garbled ('TUM_Uterus s001 T1-A-2 .svsc001 HE'). The intended pattern should be typeset clearly, e.g., 'TUM_Uterus_s001_T1-A-2_HE.svs'.
- [§2.2 and §2.2.1] The LLM is referred to only as 'Qwen-30B.' For reproducibility, please specify the exact model version, prompt template, decoding parameters, and the date/software environment used.
- [§3] The paper notes that 'no evidence of malignancy' reports were not automatically classified as normal, which is a useful and careful design choice. It might help to state explicitly how the six diagnostic categories were assigned in ambiguous cases, e.g., whether the final label came from the critical finding section alone or from the full report.
Circularity Check
No circularity: dataset construction paper with manual validation, no prediction/fit chain to reduce to inputs.
full rationale
This is a dataset description paper rather than a derivation or prediction paper. There is no fitted model, no parameter estimated from a subset and then used to predict a related quantity, and no uniqueness theorem imported from the authors' own prior work to force a conclusion. The slide-level textual descriptions are extracted from case-level diagnostic reports using an LLM and manually reviewed by pathologists; the slide-level diagnostic categories are explicitly stated to be derived from the corresponding pathology report. That labeling is part of dataset construction, not a claim that the image predicts the text or that the category is independently inferred from the WSI. The central claim of the paper is that the released WSI–report pairs exist and were validated; even if that validation is not quantitatively reported (e.g., no inter-rater agreement), lack of quantitative validation is a data-quality concern, not circularity. No self-citations are load-bearing, and the cited works are external. The paper is self-contained as a dataset contribution, and no step reduces to its own inputs by construction.
Assumptions & free parameters
assumptions (3)
- domain assumption German-to-English translation by LLM preserves clinical meaning of the pathology reports.
- domain assumption LLM-assisted slide-level extraction paired with manual expert review produces correct WSI–report correspondences.
- domain assumption The 216 cases retained in the released paired dataset represent the routine clinical spectrum of uterine pathology.
Cite this review
Pith. "Pith review of Paired Uterine Whole-Slide Images and Pathology Reports for Multimodal Computational Pathology." pith.science (2026). https://pith.science/paper/IG7W2LTW
@misc{pith2026260704020,
author = {Pith},
title = {Pith review of: Paired Uterine Whole-Slide Images and Pathology Reports for Multimodal Computational Pathology},
year = {2026},
howpublished = {\url{https://pith.science/paper/IG7W2LTW}},
note = {Machine review of arXiv:2607.04020}
}
read the original abstract
Uterine diseases represent an important category of gynecologic pathology and require accurate histopathological assessment for diagnosis and treatment planning. Whole-slide images (WSI) have enabled the digital transformation of pathology workflows and provided new opportunities for artificial intelligence (AI) in computational pathology. In particular, multimodal models that jointly analyze histopathology images and pathology reports have shown promising potential for automated pathology report generation and AI-assisted diagnosis. However, the development of such systems remains limited by the scarcity of datasets that pair whole-slide images with clinically meaningful pathology reports. Instead, existing pathology datasets focus on patch- or slide-level annotations of a single endpoint (e.g., disease class), which do not fully capture the rich information in full clinical diagnostic workflow reports. Here, we introduce TUM-Uteria, a uterine pathology dataset comprising WSIs paired with diagnostic pathology reports at both the case and slide levels, collected from a tertiary medical center. The dataset contains 216 clinical cases, comprising 455 slide-level WSI-report pairs. The dataset underwent a structured multi-stage validation procedure involving board-certified pathologists to ensure reliable annotations. TUM-Uteria supports research in computational pathology, including whole-slide image analysis, multimodal learning, and automated pathology report generation.
Figures
Reference graph
Works this paper leans on
-
[1]
Endometrial cancer
Frederic Amant et al. “Endometrial cancer”. In:The Lancet366.9484 (2005), pp. 491–505
2005
-
[2]
The importance of histopathological evaluation in cancer diagnosis and treatment
Mohammad Raja Aljehani et al. “The importance of histopathological evaluation in cancer diagnosis and treatment”. In:International journal of health sciences7.S1 (2023), pp. 3614–3623
2023
-
[3]
Semantic analysis of SNOMED CT for a post-coordinated database of histopathology findings
Walter S Campbell et al. “Semantic analysis of SNOMED CT for a post-coordinated database of histopathology findings”. In:Journal of the American Medical Informatics Association21.5 (2014), pp. 885–892
2014
-
[4]
Whole slide imaging equivalency and efficiency study: experience at a large academic center
Matthew G Hanna et al. “Whole slide imaging equivalency and efficiency study: experience at a large academic center”. In:Modern Pathology32.7 (2019), pp. 916–928
2019
-
[5]
Review of the current state of whole slide imaging in pathology
Liron Pantanowitz et al. “Review of the current state of whole slide imaging in pathology”. In:Journal of pathology informatics2.1 (2011), p. 36
2011
-
[6]
Introduction to digital image analysis in whole-slide imaging: a white paper from the digital pathology association
Famke Aeffner et al. “Introduction to digital image analysis in whole-slide imaging: a white paper from the digital pathology association”. In:Journal of pathology informatics10.1 (2019), p. 9
2019
-
[7]
Federated learning for computational pathology on gigapixel whole slide images
Ming Y Lu et al. “Federated learning for computational pathology on gigapixel whole slide images”. In:Medical image analysis76 (2022), p. 102298
2022
-
[8]
Clinical-grade computational pathology using weakly supervised deep learning on whole slide images
Gabriele Campanella et al. “Clinical-grade computational pathology using weakly supervised deep learning on whole slide images”. In:Nature medicine25.8 (2019), pp. 1301–1309
2019
Show all 16 references
-
[9]
Deep learning for multi-class semantic segmentation enables colorectal cancer detection and classification in digital pathology images
John-Melle Bokhorst et al. “Deep learning for multi-class semantic segmentation enables colorectal cancer detection and classification in digital pathology images”. In:Scientific Reports13.1 (2023), p. 8398
2023
-
[10]
Multi-modality artificial intelligence in digital pathology
Yixuan Qiao et al. “Multi-modality artificial intelligence in digital pathology”. In:Briefings in Bioinfor- matics23.6 (2022), bbac367
2022
-
[11]
Multi-modal foundation models for computational pathology: a survey
Dong Li et al. “Multi-modal foundation models for computational pathology: a survey”. In:Transactions on machine learning research2025 (2025), p. 5715
2025
-
[12]
Pathalign: A vision-language model for whole slide images in histopathology
Faruk Ahmed et al. “Pathalign: A vision-language model for whole slide images in histopathology”. In: arXiv preprint arXiv:2406.19578(2024). 8
2024 arXiv
-
[13]
Pathology report generation from whole slide images with knowledge retrieval and multi-level regional feature selection
Dingyi Hu et al. “Pathology report generation from whole slide images with knowledge retrieval and multi-level regional feature selection”. In:Computer Methods and Programs in Biomedicine263 (2025), p. 108677
2025
-
[14]
Data-efficient and weakly supervised computational pathology on whole-slide images
Ming Y Lu et al. “Data-efficient and weakly supervised computational pathology on whole-slide images”. In:Nature biomedical engineering5.6 (2021), pp. 555–570
2021
-
[15]
A multimodal whole-slide foundation model for pathology
Tong Ding et al. “A multimodal whole-slide foundation model for pathology”. In:Nature medicine (2025), pp. 1–13
2025
-
[16]
A multimodal knowledge-enhanced whole-slide pathology foundation model
Yingxue Xu et al. “A multimodal knowledge-enhanced whole-slide pathology foundation model”. In: Nature Communications(2025). 9
2025
Reviewed August 2, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.