REVIEW 2 major objections 1 minor 29 references
A cGAN synthesizes PIN-4 IHC staining directly from H&E prostate biopsy images
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · grok-4.3
2026-06-28 15:01 UTC pith:EGBULLGO
load-bearing objection The cGAN works on their paired prostate biopsy data but the adjacent-section registration is the part that needs more evidence. the 2 major comments →
Deep Learning for Generating Computational PIN-4 Immunohistochemistry Staining from Prostate Biopsy H&E Images
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
A conditional generative adversarial network trained on 27,298 registered 1024x1024 patch pairs from 172 WSIs synthesizes PIN-4 staining directly from native H&E patches. On a held-out test set of 1,814 patch pairs the model achieves mean PSNR 21.88 dB, SSIM 0.667, PCC 0.684 and LPIPS 0.417. Qualitative review by a board-certified pathologist confirms that the generated images capture diagnostically relevant patterns including AMACR/racemase expression and basal-cell staining while preserving spatial correspondence with the source H&E morphology, although accuracy varies across high-grade carcinoma and intraductal carcinoma regions.
What carries the argument
conditional generative adversarial network (cGAN) trained on registered H&E-to-PIN-4 patch pairs to learn the mapping from brightfield morphology to immunohistochemistry signal
Load-bearing premise
Adjacent tissue sections can be aligned with enough precision that the PIN-4 images provide reliable supervised training targets for the cGAN.
What would settle it
Independent pathologist marking of AMACR-positive regions on real PIN-4 slides versus the cGAN outputs for the identical H&E patches shows systematic spatial mismatches beyond what would be expected from normal staining variability.
If this is right
- Synthesized PIN-4 images preserve spatial correspondence with the source H&E, enabling direct side-by-side interpretation of morphology and marker signal.
- The outputs capture key diagnostic patterns such as AMACR expression in adenocarcinoma cases.
- The approach works across adenocarcinoma-positive and benign cases with representation across age, race, and ethnicity.
- Synthesis accuracy is lower in morphologically complex regions such as high-grade and intraductal carcinoma.
Where Pith is reading between the lines
- The same paired-dataset and cGAN approach could be applied to synthesize other IHC markers used in prostate or other solid-tumor diagnostics.
- Digital pathology viewers could overlay the predicted PIN-4 signal on the original H&E slide for immediate review without ordering physical stains.
- Improving the registration step when building paired training data would likely raise the quantitative metrics and reduce variation in complex tissue areas.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript constructs a paired dataset of 27,298 registered 1024x1024 H&E/PIN-4 patch pairs from 172 adjacent-section WSIs of 93 prostate biopsy patients and trains a conditional GAN to synthesize PIN-4 IHC staining directly from H&E images. On a held-out test set of 1,814 patches it reports mean PSNR 21.88 dB, SSIM 0.667, PCC 0.684 and LPIPS 0.417, with a single pathologist qualitatively confirming capture of AMACR expression and basal-cell patterns while preserving spatial correspondence to the source H&E morphology.
Significance. If the registration between adjacent sections is sufficiently accurate to supply reliable pixel-level supervision, the work would demonstrate a practical route to virtual IHC that removes the spatial-offset limitation of conventional adjacent-section staining. The scale of the clinical dataset (93 patients, balanced across adenocarcinoma and benign cases) and the use of a held-out test set constitute concrete strengths for an empirical supervised-learning study.
major comments (2)
- [Methods (dataset construction)] Methods (dataset construction paragraph): the claim that the 27,298 patch pairs supply reliable supervised targets rests on unquantified registration accuracy between physically distinct adjacent sections. No landmark-based error, Dice overlap on epithelial structures, or residual-deformation metric is reported; residual misalignment from sectioning, shrinkage, or biological heterogeneity would inject label noise that directly undermines the reported PSNR/SSIM/PCC values and the assertion of “preserving spatial correspondence.”
- [Abstract and Methods (evaluation)] Abstract and Methods (evaluation paragraph): the manuscript provides no description of the data-splitting strategy (patient-level vs. slide-level), cGAN architecture details, training hyperparameters, or loss weighting. Without these, it is impossible to assess whether the held-out metrics reflect genuine generalization or data leakage/overfitting, rendering the central empirical claim non-reproducible.
minor comments (1)
- [Abstract] The patient cohort description mentions representation across age, race, and ethnicity but does not tabulate the actual distributions or test for demographic balance in the train/test split.
Simulated Author's Rebuttal
We thank the referee for the constructive feedback on our manuscript. We address each major comment below and indicate where revisions will be made to improve clarity and reproducibility.
read point-by-point responses
-
Referee: [Methods (dataset construction)] Methods (dataset construction paragraph): the claim that the 27,298 patch pairs supply reliable supervised targets rests on unquantified registration accuracy between physically distinct adjacent sections. No landmark-based error, Dice overlap on epithelial structures, or residual-deformation metric is reported; residual misalignment from sectioning, shrinkage, or biological heterogeneity would inject label noise that directly undermines the reported PSNR/SSIM/PCC values and the assertion of “preserving spatial correspondence.”
Authors: We agree that the absence of quantitative registration metrics is a limitation. The manuscript described the paired dataset construction from adjacent sections but did not report landmark error, Dice scores, or deformation metrics. In revision we will expand the Methods to detail the registration procedure used and any internal validation performed, while explicitly discussing potential residual misalignment as a source of label noise and its implications for the reported metrics. The pathologist's qualitative assessment of spatial correspondence offers supporting evidence but does not substitute for quantitative measures. revision: partial
-
Referee: [Abstract and Methods (evaluation)] Abstract and Methods (evaluation paragraph): the manuscript provides no description of the data-splitting strategy (patient-level vs. slide-level), cGAN architecture details, training hyperparameters, or loss weighting. Without these, it is impossible to assess whether the held-out metrics reflect genuine generalization or data leakage/overfitting, rendering the central empirical claim non-reproducible.
Authors: We acknowledge that these implementation details are required for reproducibility. The held-out set is specified as 1,814 patches from 17 WSIs, yet the manuscript omitted the splitting protocol, architecture specification, hyperparameters, and loss weights. We will revise the Methods section to state that the split was performed at the patient level, provide the cGAN architecture (including generator/discriminator details), list all training hyperparameters, and report loss weighting. These additions will make the experimental setup fully reproducible. revision: yes
Circularity Check
Empirical supervised learning on held-out data with no derivation chain
full rationale
The paper constructs a paired H&E/PIN-4 dataset via registration of adjacent sections, trains a cGAN in the standard supervised manner, and reports image-similarity metrics on a held-out test set of 1,814 patch pairs. No equations, parameter-fitting steps, or self-citations are presented that reduce any claimed result to the training inputs by construction. The work is a conventional empirical ML study whose central claims rest on external test-set performance rather than tautological re-expression of fitted values or self-referential definitions.
Axiom & Free-Parameter Ledger
free parameters (1)
- cGAN training hyperparameters and architecture details
axioms (1)
- domain assumption Adjacent tissue sections can be registered with sufficient accuracy to create reliable pixel-level supervision for the cGAN
read the original abstract
Immunohistochemistry (IHC)is frequently used to resolve diagnostically ambiguous prostate cancer biopsy findings on hematoxylin and eosin (H&E)-stained tissue. However, PIN-4 IHC staining is typically performed on adjacent tissue sections, limiting direct spatial comparison between the H&E morphology and the corresponding immunophenotypic signal. A paired, registered H&E/PIN-4 dataset was constructed from routine clinical prostate biopsy whole-slide images (WSIs), and a conditional generative adversarial network (cGAN) was trained to synthesize PIN-4 staining patterns directly from native H&E image patches. The final dataset comprised 172 paired WSIs from 93 patients and 27,298 registered 1024x1024 patch pairs, spanning adenocarcinoma-positive and benign cases with representation across age, race, and ethnicity groups. The model was evaluated on a held-out test set of 1,814 patch pairs from 17 WSIs, achieving a mean peak signal-to-noise ratio (PSNR) of 21.88 dB, structural similarity index measure (SSIM) of 0.667, Pearson correlation coefficient (PCC) of 0.684, and learned perceptual image patch similarity (LPIPS) of 0.417. Qualitative review by a board-certified pathologist showed that generated images captured diagnostically relevant PIN-4 staining patterns, including AMACR/racemase expression and basal-cell-associated staining, while preserving spatial correspondence with the source H&E morphology. Accuracy of synthesis varied across morphologically complex regions, including high-grade carcinoma and intraductal carcinoma. These results support the feasibility of supervised PIN-4 synthesis from routinely acquired brightfield H&E prostate biopsy images. The approach enables direct interpretation of predicted PIN-4 marker patterns in the context of the source prostate H&E architecture, addressing a current spatial limitation of conventional adjacent-section IHC.
Figures
Reference graph
Works this paper leans on
-
[1]
Cancer statistics, 2026,
R. L. Siegel, T. B. Kratzer, N. S. Wagle, H. Sung, and A. Jemal, “Cancer statistics, 2026,”CA: A Cancer Journal for Clinicians, vol. 76, no. 1, p. e70043, 2026
2026
-
[2]
Histopathology of Prostate Cancer,
P. A. Humphrey, “Histopathology of Prostate Cancer,”Cold Spring Harbor Perspectives in Medicine, vol. 7, no. 10, p. a030411, 2017
2017
-
[3]
Gleason grading: past, present and future,
B. Delahunt, R. J. Miller, J. R. Srigley, A. J. Evans, and H. Samaratunga, “Gleason grading: past, present and future,”Histopathology, vol. 60, no. 1, pp. 75–86, 2012
2012
-
[4]
Automated Analysis of PIN-4 Stained Prostate Needle Biopsies,
B. Sabata, B. Babenko, R. Monroe, and C. Srinivas, “Automated Analysis of PIN-4 Stained Prostate Needle Biopsies,” inProstate Can- cer Imaging. Computer-Aided Diagnosis, Prognosis, and Intervention, A. Madabhushi, J. Dowling, P. Yan, A. Fenster, P. Abolmaesumiet al., Eds. Berlin, Heidelberg: Springer, 2010, pp. 89–100
2010
-
[5]
The 20-core prostate biopsy protocol–a new gold standard?
V . Raveryet al., “The 20-core prostate biopsy protocol–a new gold standard?”The Journal of Urology, vol. 179, no. 2, pp. 504–507, 2008
2008
-
[6]
Use of Deep Learning to Develop and Analyze Computational Hematoxylin and Eosin Staining of Prostate Core Biopsy Images for Tumor Diagnosis,
A. Rana, A. Lowe, M. Lithgow, K. Horback, T. Janovitzet al., “Use of Deep Learning to Develop and Analyze Computational Hematoxylin and Eosin Staining of Prostate Core Biopsy Images for Tumor Diagnosis,” JAMA network open, vol. 3, no. 5, p. e205111, 2020
2020
-
[7]
Deep learning-enabled realistic virtual histology with ultraviolet photoacoustic remote sensing microscopy,
M. T. Martell, N. J. M. Haven, B. D. Cikaluk, B. S. Restall, E. A. McAlisteret al., “Deep learning-enabled realistic virtual histology with ultraviolet photoacoustic remote sensing microscopy,”Nature Commu- nications, vol. 14, no. 1, p. 5967, 2023
2023
-
[8]
Biopsy-free in vivo virtual histology of skin using deep learning,
J. Li, J. Garfinkel, X. Zhang, D. Wu, Y . Zhanget al., “Biopsy-free in vivo virtual histology of skin using deep learning,”Light: Science & Applications, vol. 10, no. 1, p. 233, 2021
2021
-
[9]
Virtual histological staining of unlabeled autopsy tissue,
Y . Li, N. Pillar, J. Li, T. Liu, D. Wuet al., “Virtual histological staining of unlabeled autopsy tissue,”Nature Communications, vol. 15, no. 1, p. 1684, 2024
2024
-
[10]
Image Registration: Fundamentals and Recent Advances Based on Deep Learning,
M. Chen, N. J. Tustison, R. Jena, and J. C. Gee, “Image Registration: Fundamentals and Recent Advances Based on Deep Learning,” in Machine Learning for Brain Disorders, O. Colliot, Ed. New York, NY: Springer US, 2023, pp. 435–458
2023
-
[11]
Integrating morphologic and molecular histopathological features through whole slide image registration and deep learning,
K. Faust, M. K. Lee, A. Dent, C. Fiala, A. Portanteet al., “Integrating morphologic and molecular histopathological features through whole slide image registration and deep learning,”Neuro-Oncology Advances, vol. 4, no. 1, p. vdac001, 2022
2022
-
[12]
Automatic Multi-Stain Registration of Whole Slide Images in Histopathology,
A. Shafique, M. Babaie, M. Sajadi, A. Batten, S. Skdaret al., “Automatic Multi-Stain Registration of Whole Slide Images in Histopathology,” in 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), 2021, pp. 3622–3625
2021
-
[13]
Automatic registration of multi-modal microscopy images for integra- tive analysis of prostate tissue sections,
G. Lippolis, A. Edsj ¨o, L. Helczynski, A. Bjartell, and N. C. Overgaard, “Automatic registration of multi-modal microscopy images for integra- tive analysis of prostate tissue sections,”BMC Cancer, vol. 13, no. 1, p. 408, 2013
2013
-
[14]
A Toolbox for Intensity-Based Medical Image Registration,
S. Klein, M. Staring, K. Murphy, M. A. Viergever, and J. P. W. Pluim, “A Toolbox for Intensity-Based Medical Image Registration,”IEEE Transactions on Medical Imaging, vol. 29, no. 1, pp. 196–205, 2010
2010
-
[15]
Virtual Immuno- histochemistry Staining for Histological Images Assisted by Weakly- supervised Learning,
J. Li, J. Dong, S. Huang, X. Li, J. Jianget al., “Virtual Immuno- histochemistry Staining for Histological Images Assisted by Weakly- supervised Learning,” in2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, pp. 11 259–11 268
2024
-
[16]
Advancing H&E- to-IHC Virtual Staining with Task-Specific Domain Knowledge for HER2 Scoring,
Q. Peng, W. Lin, Y . Hu, A. Bao, C. Lianet al., “Advancing H&E- to-IHC Virtual Staining with Task-Specific Domain Knowledge for HER2 Scoring,” inMedical Image Computing and Computer Assisted Intervention – MICCAI 2024, M. G. Linguraru, Q. Dou, A. Feragen, S. Giannarou, B. Glockeret al., Eds. Springer Nature, 2024, pp. 3–13
2024
-
[17]
Clinical- Grade Validation of an Autofluorescence Virtual Staining System With Human Experts and a Deep Learning System for Prostate Cancer,
P. F. Wong, C. McNeil, Y . Wang, J. Paparian, C. Santoriet al., “Clinical- Grade Validation of an Autofluorescence Virtual Staining System With Human Experts and a Deep Learning System for Prostate Cancer,” Modern Pathology, vol. 37, no. 11, p. 100573, 2024
2024
-
[18]
TIAToolbox as an end-to-end library for advanced tissue image analyt- ics,
J. Pocock, S. Graham, Q. D. Vu, M. Jahanifar, S. Deshpandeet al., “TIAToolbox as an end-to-end library for advanced tissue image analyt- ics,”Communications Medicine, vol. 2, no. 1, p. 120, 2022
2022
-
[19]
mint-lab/roi picker,
N. C. Quy and S. Choi, “mint-lab/roi picker,” 2025. [Online]. Available: https://github.com/mint-lab/roi picker
2025
-
[20]
V ALIS: Virtual alignment of pathol- ogy image series for multi-gigapixel whole slide images,
C. Gatenbee and A. R. Anderson, “V ALIS: Virtual alignment of pathol- ogy image series for multi-gigapixel whole slide images,” 2025
2025
-
[21]
Sedeen Viewer|Pathcore,
“Sedeen Viewer|Pathcore,” accessed: 2026-01-03. [Online]. Available: https://www.pathcore.com/products/sedeen-viewer
2026
-
[22]
Statistical Validation of Image Segmentation Quality Based on a Spatial Overlap Index,
K. H. Zou, S. K. Warfield, A. Bharatha, C. M. Tempany, M. R. Kaus et al., “Statistical Validation of Image Segmentation Quality Based on a Spatial Overlap Index,”Academic radiology, vol. 11, no. 2, pp. 178–189, 2004
2004
-
[23]
Deconvolution and Checkerboard Artifacts,
A. Odena, V . Dumoulin, and C. Olah, “Deconvolution and Checkerboard Artifacts,”Distill, vol. 1, no. 10, p. e3, 2016
2016
-
[24]
Image quality assess- ment: from error visibility to structural similarity,
Z. Wang, A. Bovik, H. Sheikh, and E. Simoncelli, “Image quality assess- ment: from error visibility to structural similarity,”IEEE Transactions on Image Processing, vol. 13, no. 4, pp. 600–612, 2004
2004
-
[25]
Tune: A Research Platform for Distributed Model Selection and Training
R. Liaw, E. Liang, R. Nishihara, P. Moritz, J. E. Gonzalezet al., “Tune: A Research Platform for Distributed Model Selection and Training,” 2018, arXiv:1807.05118 [cs]
work page internal anchor Pith review Pith/arXiv arXiv 2018
-
[26]
Making a Science of Model Search: Hyperparameter Optimization in Hundreds of Dimensions for Vision Architectures,
J. Bergstra, D. Yamins, and D. Cox, “Making a Science of Model Search: Hyperparameter Optimization in Hundreds of Dimensions for Vision Architectures,” inProceedings of the 30th International Conference on Machine Learning. PMLR, 2013, pp. 115–123
2013
-
[27]
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
R. Zhang, P. Isola, A. A. Efros, E. Shechtman, and O. Wang, “The Unreasonable Effectiveness of Deep Features as a Perceptual Metric,” 2018, arXiv:1801.03924 [cs]
work page internal anchor Pith review Pith/arXiv arXiv 2018
-
[28]
Adam: A Method for Stochastic Optimization
D. P. Kingma and J. Ba, “Adam: A Method for Stochastic Optimization,” 2017, arXiv:1412.6980 [cs]
work page internal anchor Pith review Pith/arXiv arXiv 2017
-
[29]
On the Convergence of Adam and Beyond
S. J. Reddi, S. Kale, and S. Kumar, “On the Convergence of Adam and Beyond,” 2019, arXiv:1904.09237 [cs]. SUPPLEMENTARYMATERIAL TABLE II IMAGE GENERATION METRICS ACROSS34VALIDATION AND TESTWSIS WSI Patches LPIPS↓ SSIM↑ PCC↑ PSNR↑ 1 63 0.573 0.315 0.267 14.953 2 173 0.437 0.638 0.694 21.201 3 12 0.392 0.798 0.675 23.875 4 146 0.375 0.690 0.644 20.447 5 172...
work page internal anchor Pith review Pith/arXiv arXiv 2019
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.