Pith. sign in

REVIEW 3 major objections 5 minor 63 references

CXR-LT 2024: A MICCAI challenge on long-tailed, multi-label, and zero-shot disease classification from chest X-ray

T0 review · 3 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read The paper describes the second edition of a community benchmark challenge for classifying diseases from chest X-rays, now with 377,110 images, 45 disease labels, and a new zero-shot task on five unseen findings.

desk verdict A genuinely useful benchmark update with an honest write-up, but the zero-shot result rests on unvalidated text-mined labels, so treat the absolute mAP with caution. read the letter →

arxiv 2506.07984 v1 pith:NEAAQGUM submitted 2025-06-09 cs.CV cs.LG

Mingquan Lin , Gregory Holste , Song Wang , Yiliang Zhou , Yishu Wei , Imon Banerjee , Pengyi Chen , Tianjie Dai
show 25 more authors
Yuexi Du Nicha C. Dvornek Yuyan Ge Zuowei Guo Shouhei Hanaoka Dongkyun Kim Pablo Messina Yang Lu Denis Parra Donghyun Son Álvaro Soto Aisha Urooj René Vidal Yosuke Yamagishi Zefan Yang Ruichi Zhang Yang Zhou Leo Anthony Celi Ronald M. Summers Zhiyong Lu Hao Chen Adam Flanders George Shih Zhangyang Wang Yifan Peng
This is my paper
classification cs.CVcs.LG
keywords chestX-raylong-tailedclassificationmulti-labelzero-shotlearningdiseasedetectionbenchmarklabelnoisevision-languagemodels
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper describes the second edition of a community benchmark challenge for classifying diseases from chest X-rays, now with 377,110 images, 45 disease labels, and a new zero-shot task on five unseen findings. The reported results place the best models at 0.281 mean average precision on a 40-class noisy test set, 0.526 on a 26-class manually labeled gold standard, and 0.129 on the five unseen classes. The authors are trying to establish a shared testbed that quantifies how far long-tailed and zero-shot chest X-ray diagnosis has come, and to show that rare and unseen findings remain the biggest gap.

What carries the argument

The load-bearing machinery is the long-tailed label distribution generated by automatically parsing MIMIC-CXR radiology reports with RadText, together with a manually annotated gold standard subset and macro-averaged mAP as the primary metric. This setup separates the effect of label noise from the effect of class rarity, and the gold standard subset provides a human-verified check on the noisy test set.

What would settle it

Select a random sample of the new rare findings from the training set and have a panel of radiologists re-read the original reports; if agreement with the parsed labels is low for those classes, the benchmark's training signal and evaluation for rare diseases are not trustworthy.

Watch

Extended reading notes

Core claim

The central claim is that CXR-LT 2024 provides a valid benchmark for long-tailed, multi-label, and zero-shot chest X-ray disease classification, and that current state-of-the-art models, while making progress on common findings, perform poorly on rare and unseen ones. Evidence for this is the gap between the 0.28 mAP on the full 40-class test set and the 0.53 mAP on the 26-class gold standard, plus the 0.13 mAP on the five zero-shot classes. The paper also argues that ensemble methods, loss re-weighting, and synthetic data help tail classes, and that vision-language models are the emerging tool for zero-shot generalization.

Load-bearing premise

The benchmark's reliability depends on the automatically extracted labels from radiology reports; if those labels are substantially wrong, especially for the 19 new rare findings, then the reported per-class results are unreliable.

Editorial extensions

If this is right

  • The addition of 19 rare findings drops top mAP to 0.28, showing that rare diseases are the current bottleneck in chest X-ray classification.
  • Zero-shot classification of five unseen findings hovers near 0.13 mAP, implying that models cannot yet generalize to novel radiological abnormalities.
  • GPT-4-based labeling reached higher precision than the rule-based parser on the gold standard, suggesting LLM-based pipelines could reduce label noise at scale.
  • The benchmark offers a reusable public dataset of 377,110 images and 45 labels, enabling future comparisons on long-tailed and zero-shot chest X-ray classification.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A natural next step would be to have attending radiologists re-annotate the gold standard subset, since the current annotations were made by graduate students reading report text; if rankings shift, the noisy test set may be less predictive for rare classes.
  • The low zero-shot mAP suggests that text-only descriptions of unseen diseases may be insufficient; grounding vision-language models on anatomical knowledge or visual exemplars could be a testable improvement.
  • Because Task 1 and Task 2 mAP were highly correlated, the noisy test set may suffice for ranking on common findings, but this correlation should be checked specifically for the 19 new rare classes.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. This paper reports the organization and results of the CXR-LT 2024 MICCAI challenge, which comprises three tasks: long-tailed multi-label classification on a 40-class noisy test set, long-tailed classification on a 26-class manually annotated gold-standard set, and zero-shot classification of five unseen findings. The authors describe the construction of the dataset from MIMIC-CXR with RadText-extracted labels, summarize the top nine submitted solutions, report the leaderboard scores (mAP 0.281 for Task 1, 0.526 for Task 2, and 0.129 for Task 3), and discuss methodological themes such as ensembling, loss re-weighting, vision-language models, and synthetic data. The paper also includes a comparison of rule-based and GPT-4o labeling on the 26-class gold standard set.

Significance. If the results are taken at face value, the challenge is a valuable community resource: it extends the CXR-LT benchmark to 377,110 images and 45 classes, introduces a new zero-shot task, provides per-class performance breakdowns, and makes leaderboards and system descriptions publicly available. The observation that zero-shot performance is substantially lower than supervised performance is useful and plausible. The paper also has concrete strengths: a clear evaluation protocol, a public challenge infrastructure, and a direct comparison of rule-based versus LLM-based label extraction. However, the central zero-shot conclusion rests on labels for the five unseen classes that have no manual validation, so the significance is conditional on additional evidence about label quality.

major comments (3)
  1. [Sections 2.2.1, 2.2.2, Table 7] The five Task 3 test classes (Bulla, Cardiomyopathy, Hilum, Osteopenia, Scoliosis) were labeled by RadText from radiology reports, and the gold-standard set described in Section 2.2.2 covers only the 26 CXR-LT 2023 classes. Because no subset of Task 3 labels has manual validation, the reported mAP of 0.129 could substantially reflect agreement with noisy text-mined labels rather than radiographic detection, especially for Hilum, which is an anatomical region rather than a disease. The paper should either provide a manually validated subset for the five unseen classes or explicitly reframe the Task 3 result as performance against unvalidated RadText labels and soften the conclusion that zero-shot detection of unseen findings is far from solved.
  2. [Section 3.4 and Table 6] The text states that Team E placed second with mAP 0.511 and Team A placed third with 0.511, but Table 6 lists Team A second with 0.519 and Team E third with 0.511. Since the challenge rankings are central results, this inconsistency must be resolved and the correct ranking and scores reported consistently throughout the paper.
  3. [Section 4.2 and Table 8] The text claims that GPT-4 produces higher-quality labels "as evidenced by improved mAP," but Table 8 reports micro-precision (and Section 3.6 correctly describes precision), not mAP. As presented, the table supports an improvement in precision (0.711 vs. 0.786), not in mAP. The claim that LLM-based labels improve benchmark quality should be reworded to refer to precision, or the authors should report an mAP-based comparison.
minor comments (5)
  1. [Figure 1 caption] The caption says the dataset was formed by adding "12 new clinical findings (red)" but Section 2.2.1 states that 19 new findings were added; the legend also appears to say "Added in CXR-LT 2025," which should presumably be 2024.
  2. [Section 3.3] The text refers to "mAUC" when describing Team C's tie-break; elsewhere the paper uses mAUROC, so the terminology should be unified.
  3. [Section 3.6 and Table 8] The table title says "micro-precision" while the text says "precision"; use one term consistently and define how the per-class values are aggregated.
  4. [Table 1] For Task 3, the development set is listed with 5 labels, but Section 2.1 says participants were provided labels only for the training set; clarify whether these development labels were used solely for leaderboard scoring.
  5. [Section 2.1] The definition of mAP as "macro-averaged AP across classes" is clear, but the paper should state explicitly whether AP is averaged per class without weighting by class frequency.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: this is an empirical challenge report whose benchmark metrics are computed on held-out test sets from independently submitted models, with acknowledged label-noise limitations that are validity concerns rather than circular derivation.

full rationale

CXR-LT 2024 is a challenge overview, not a derivation. Its central claims are the dataset statistics (Table 1), the leaderboard mAP values (Tables 4, 6, 7), and the qualitative observation that zero-shot generalization to unseen findings remains difficult. These claims are grounded in held-out test evaluations of 17 independently submitted models; there is no fitted parameter that is later renamed as a prediction, and no equation that makes a reported quantity equal its input by construction. The potentially self-referential elements are (i) reuse of the CXR-LT 2023 gold-standard set [2] for Task 2, (ii) use of the authors' RadText tool [17] to extract labels for the 19 new findings, and (iii) team descriptions citing their own components such as CheXFusion, CLEFT, and CXRFE. None of these is load-bearing in a circular sense: the gold-standard set is a fixed external dataset described in prior work, the RadText-generated labels are the benchmark's accepted weak labels, and the paper explicitly acknowledges the resulting limitation in Section 4.2: 'the CXR-LT dataset is constrained by inherent label noise resulting from automatically extracted text-mined labels.' The skeptic concern that the five Task 3 classes have no manually validated labels is a measurement-validity limitation that affects interpretation of the 0.129 mAP; it is not a circular step because those classes are excluded from training, so the evaluation is not fitting its own input. Under the hard rule that circularity requires exhibiting a specific reduction, no such reduction exists in the manuscript.

Assumptions & free parameters 0 free parameters · 4 assumptions · 0 invented entities

The paper's conclusions depend mainly on the accuracy of the derived labels and the representativeness of the gold standard set. It introduces no free parameters or invented entities.

assumptions (4)
  • domain assumption Automatically extracted labels from radiology reports are accurate enough for training and evaluation.
    The benchmark uses RadText to parse reports into 45 disease labels; the paper acknowledges label noise in Section 4.2.
  • domain assumption The gold standard test set annotations are reliable enough to serve as ground truth.
    Section 2.2.2 describes six annotators reviewing 406 reports; Section 4.2 notes annotations were done by graduate students without attending radiologist consensus.
  • domain assumption The five unseen classes in Task 3 are truly absent from the training set.
    The paper states these were held out, but provides no verification procedure. The validity of the zero-shot evaluation depends on this.
  • domain assumption Mean average precision (mAP) is the appropriate primary metric for long-tailed multi-label evaluation.
    Section 2.1 argues mAP is more suitable than AUROC under class imbalance, citing prior literature; this is a reasonable but contestable choice.

how reviews work

0 comments
Cite this review

Pith. "Pith review of CXR-LT 2024: A MICCAI challenge on long-tailed, multi-label, and zero-shot disease classification from chest X-ray." pith.science (2026). https://pith.science/paper/NEAAQGUM

@misc{pith2026250607984,
  author       = {Pith},
  title        = {Pith review of: CXR-LT 2024: A MICCAI challenge on long-tailed, multi-label, and zero-shot disease classification from chest X-ray},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/NEAAQGUM}},
  note         = {Machine review of arXiv:2506.07984}
}
read the original abstract

The CXR-LT series is a community-driven initiative designed to enhance lung disease classification using chest X-rays (CXR). It tackles challenges in open long-tailed lung disease classification and enhances the measurability of state-of-the-art techniques. The first event, CXR-LT 2023, aimed to achieve these goals by providing high-quality benchmark CXR data for model development and conducting comprehensive evaluations to identify ongoing issues impacting lung disease classification performance. Building on the success of CXR-LT 2023, the CXR-LT 2024 expands the dataset to 377,110 chest X-rays (CXRs) and 45 disease labels, including 19 new rare disease findings. It also introduces a new focus on zero-shot learning to address limitations identified in the previous event. Specifically, CXR-LT 2024 features three tasks: (i) long-tailed classification on a large, noisy test set, (ii) long-tailed classification on a manually annotated "gold standard" subset, and (iii) zero-shot generalization to five previously unseen disease findings. This paper provides an overview of CXR-LT 2024, detailing the data curation process and consolidating state-of-the-art solutions, including the use of multimodal models for rare disease detection, advanced generative approaches to handle noisy labels, and zero-shot learning strategies for unseen diseases. Additionally, the expanded dataset enhances disease coverage to better represent real-world clinical settings, offering a valuable resource for future research. By synthesizing the insights and innovations of participating teams, we aim to advance the development of clinically realistic and generalizable diagnostic models for chest radiography.

Figures

Figures reproduced from arXiv: 2506.07984 by the authors.

Figure 1
Figure 1. Long-tailed distribution of the CXR-LT 2024 challenge dataset. The dataset was formed by ex￾tending the MIMIC-CXR benchmark to include 12 new clinical findings (red) by parsing radiology reports [PITH_FULL_IMAGE:figures/full_fig_p005_1.png] view at source ↗
Figure 2
Figure 2. Representative chest X-rays from the challenge dataset, each demonstrating multiple findings. (a) Includes the Hilum label (new in CXR-LT 2024); (b) shows Fracture (introduced in CXR-LT 2023); and (c) displays original MIMIC-CXR labels (Cardiomegaly, Edema, Lung Opacity). 5 [PITH_FULL_IMAGE:figures/full_fig_p005_2.png] view at source ↗
Figure 3
Figure 3. Comparison of performance on CXR-LT Task 1 data (Section 2.2.1) and gold standard Task 2 data (Section 2.2.2) [PITH_FULL_IMAGE:figures/full_fig_p011_3.png] view at source ↗

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

63 extracted references · 36 canonical work pages

  1. [1]

    Long-tailed classification of thorax diseases on chest x-ray: A new benchmark study

    Gregory Holste, Song Wang, Ziyu Jiang, Thomas C Shen, George Shih, Ronald M Summers, Yifan Peng, and Zhangyang Wang. Long-tailed classification of thorax diseases on chest x-ray: A new benchmark study. InMICCAI Workshop on Data Augmentation, Labelling, and Imperfections, pages 22–32. Springer, 2022

    2022

  2. [2]

    Towards long-tailed, multi-label disease classification from chest x-ray: Overview of the cxr-lt challenge.Medical Image Analysis, page 103224, 2024

    Gregory Holste, Yiliang Zhou, Song Wang, Ajay Jaiswal, Mingquan Lin, Sherry Zhuge, Yuzhe Yang, Dongkyun Kim, Trong-Hieu Nguyen-Mau, Minh-Triet Tran, et al. Towards long-tailed, multi-label disease classification from chest x-ray: Overview of the cxr-lt challenge.Medical Image Analysis, page 103224, 2024

    2024

  3. [3]

    Evolution-aware V Ariance (EV A) coreset selection for medical image classification

    Yuxin Hong, Xiao Zhang, Xin Zhang, and Joey Tianyi Zhou. Evolution-aware V Ariance (EV A) coreset selection for medical image classification. InProceedings of the 32nd ACM International Conference on Multimedia, pages 301–310, New York, NY , USA, 28 October 2024. ACM. doi: 10.1145/3664647. 3681592

    doi:10.1145/3664647 2024

  4. [4]

    Denoising diffusion proba- bilistic models for addressing data limitations in chest X-ray classification.Inform

    Evi M C Huijben, Josien P W Pluim, and Maureen A J M van Eijnatten. Denoising diffusion proba- bilistic models for addressing data limitations in chest X-ray classification.Inform. Med. Unlocked, 50 (101575):101575, 1 January 2024. ISSN 2352-9148. doi: 10.1016/j.imu.2024.101575

    work page arXiv 2024

  5. [5]

    Fine-grained self-supervised learning with jigsaw puzzles for medical image classification.Comput

    Wongi Park and Jongbin Ryu. Fine-grained self-supervised learning with jigsaw puzzles for medical image classification.Comput. Biol. Med., 174(108460):108460, May 2024. ISSN 1879-0534,0010-

    work page 2024

  6. [6]

    Improving generalization and personalization in long-tailed federated learning via classifier retraining

    Yuhang Li, Tong Liu, Wenfeng Shen, Yangguang Cui, and Weijia Lu. Improving generalization and personalization in long-tailed federated learning via classifier retraining. InEuropean Conference on Parallel Processing, pages 408–423. Springer, 2024

    work page 2024

  7. [7]

    Informatics in radiology: radiology gamuts ontology: differential diagnosis for the semantic web.Radiographics, 34(1):254–264, 2014

    Joseph J Budovec, Cesar A Lam, and Charles E Kahn Jr. Informatics in radiology: radiology gamuts ontology: differential diagnosis for the semantic web.Radiographics, 34(1):254–264, 2014

    work page 2014

  8. [8]

    Chestx-ray8: Hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases

    Xiaosong Wang, Yifan Peng, Le Lu, Zhiyong Lu, Mohammadhadi Bagheri, and Ronald M Summers. Chestx-ray8: Hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. InProceedings of the IEEE conference on computer vision and pattern recognition, pages 2097–2106, 2017

    2017

Show all 63 references
  1. [9]

    Chexclusion: Fairness gaps in deep chest x-ray classifiers

    Laleh Seyyed-Kalantari, Guanxiong Liu, Matthew McDermott, Irene Y Chen, and Marzyeh Ghassemi. Chexclusion: Fairness gaps in deep chest x-ray classifiers. InBIOCOMPUTING 2021: proceedings of the Pacific symposium, pages 232–243. World Scientific, 2020

    2021

  2. [10]

    Springer, 2018

    Alberto Fern ´andez, Salvador Garc´ıa, Mikel Galar, Ronaldo C Prati, Bartosz Krawczyk, and Francisco Herrera.Learning from imbalanced data sets, volume 10. Springer, 2018

    2018

  3. [11]

    The relationship between precision-recall and roc curves

    Jesse Davis and Mark Goadrich. The relationship between precision-recall and roc curves. InPro- ceedings of the 23rd international conference on Machine learning, pages 233–240, 2006. 16

    2006

  4. [12]

    Long-tail zero and few-shot learning via contrastive pretrain- ing on and for small data

    Nils Rethmeier and Isabelle Augenstein. Long-tail zero and few-shot learning via contrastive pretrain- ing on and for small data. InComputer Sciences & Mathematics Forum, volume 3, page 10. MDPI, 2022

    2022

  5. [13]

    Obtaining well calibrated prob- abilities using bayesian binning

    Mahdi Pakdaman Naeini, Gregory Cooper, and Milos Hauskrecht. Obtaining well calibrated prob- abilities using bayesian binning. InProceedings of the AAAI conference on artificial intelligence, volume 29, 2015

    2015

  6. [14]

    Mimic-cxr, a de-identified publicly available database of chest radiographs with free-text reports.Scientific data, 6(1):317, 2019

    Alistair EW Johnson, Tom J Pollard, Seth J Berkowitz, Nathaniel R Greenbaum, Matthew P Lungren, Chih-ying Deng, Roger G Mark, and Steven Horng. Mimic-cxr, a de-identified publicly available database of chest radiographs with free-text reports.Scientific data, 6(1):317, 2019

    2019

  7. [15]

    Padchest: A large chest x-ray image dataset with multi-label annotated reports.Medical image analysis, 66:101797, 2020

    Aurelia Bustos, Antonio Pertusa, Jose-Maria Salinas, and Maria De La Iglesia-Vaya. Padchest: A large chest x-ray image dataset with multi-label annotated reports.Medical image analysis, 66:101797, 2020

    2020

  8. [16]

    Fleischner society: glossary of terms for thoracic imaging.Radiology, 246(3): 697–722, 2008

    David M Hansell, Alexander A Bankier, Heber MacMahon, Theresa C McLoud, Nestor L Muller, and Jacques Remy. Fleischner society: glossary of terms for thoracic imaging.Radiology, 246(3): 697–722, 2008

    2008

  9. [17]

    Radiology text analysis system (radtext): Architecture and evaluation

    Song Wang, Mingquan Lin, Ying Ding, George Shih, Zhiyong Lu, and Yifan Peng. Radiology text analysis system (radtext): Architecture and evaluation. In2022 IEEE 10th International Conference on Healthcare Informatics (ICHI), pages 288–296, 2022. doi: 10.1109/ICHI54592.2022.00050

    2022

  10. [18]

    Mimic-cxr-jpg, a large publicly available database of labeled chest radiographs.arXiv preprint arXiv:1901.07042, 2019

    Alistair EW Johnson, Tom J Pollard, Nathaniel R Greenbaum, Matthew P Lungren, Chih-ying Deng, Yifan Peng, Zhiyong Lu, Roger G Mark, Seth J Berkowitz, and Steven Horng. Mimic-cxr-jpg, a large publicly available database of labeled chest radiographs.arXiv preprint arXiv:1901.07042, 2019

    1901 arXiv

  11. [19]

    Codalab competitions: An open source platform to organize scientific challenges.Journal of Machine Learning Research, 24(198):1–6, 2023

    Adrien Pavao, Isabelle Guyon, Anne-Catherine Letournel, Dinh-Tuan Tran, Xavier Baro, Hugo Jair Escalante, Sergio Escalera, Tyler Thomas, and Zhen Xu. Codalab competitions: An open source platform to organize scientific challenges.Journal of Machine Learning Research, 24(198):1...

    2023

  12. [20]

    A convnet for the 2020s

    Zhuang Liu, Hanzi Mao, Chao-Yuan Wu, Christoph Feichtenhofer, Trevor Darrell, and Saining Xie. A convnet for the 2020s. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 11976–11986, 2022

    2022

  13. [21]

    Efficientnetv2: Smaller models and faster training

    Mingxing Tan and Quoc Le. Efficientnetv2: Smaller models and faster training. InInternational conference on machine learning, pages 10096–10106. PMLR, 2021

    2021

  14. [22]

    Domain-specific language model pretraining for biomedical natural language processing, 2020

    Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, and Hoifung Poon. Domain-specific language model pretraining for biomedical natural language processing, 2020

    2020

  15. [23]

    Unichest: Conquer-and-divide pre-training for multi-source chest x-ray classification.IEEE Transactions on Medical Imaging, 2024

    Tianjie Dai, Ruipeng Zhang, Feng Hong, Jiangchao Yao, Ya Zhang, and Yanfeng Wang. Unichest: Conquer-and-divide pre-training for multi-source chest x-ray classification.IEEE Transactions on Medical Imaging, 2024

    2024

  16. [24]

    Chexfusion: Effective fusion of multi-view features using transformers for long-tailed chest x-ray classification

    Dongkyun Kim. Chexfusion: Effective fusion of multi-view features using transformers for long-tailed chest x-ray classification. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 2702–2710, 2023. 17

    2023

  17. [25]

    Chexpert: A large chest radiograph dataset with uncertainty labels and expert comparison

    Jeremy Irvin, Pranav Rajpurkar, Michael Ko, Yifan Yu, Silviana Ciurea-Ilcus, Chris Chute, Henrik Marklund, Behzad Haghgoo, Robyn Ball, Katie Shpanskaya, et al. Chexpert: A large chest radiograph dataset with uncertainty labels and expert comparison. InProceedings of the AAAI c...

    2019

  18. [26]

    Vindr-cxr: An open dataset of chest x-rays with radiologist’s annotations.Scientific Data, 9(1):429, 2022

    Ha Q Nguyen, Khanh Lam, Linh T Le, Hieu H Pham, Dat Q Tran, Dung B Nguyen, Dung D Le, Chi M Pham, Hang TT Tong, Diep H Dinh, et al. Vindr-cxr: An open dataset of chest x-rays with radiologist’s annotations.Scientific Data, 9(1):429, 2022

    2022

  19. [27]

    Brax, brazilian labeled chest x-ray dataset.Scientific Data, 9(1):487, 2022

    Eduardo P Reis, Joselisa PQ De Paiva, Maria CB Da Silva, Guilherme AS Ribeiro, Victor F Paiva, Lucas Bulgarelli, Henrique MH Lee, Paulo V Santos, Vanessa M Brito, Lucas TW Amaral, et al. Brax, brazilian labeled chest x-ray dataset.Scientific Data, 9(1):487, 2022

    2022

  20. [28]

    Cleft: Language-image contrastive learning with efficient large language model and prompt fine-tuning

    Yuexi Du, Brian Chang, and Nicha C Dvornek. Cleft: Language-image contrastive learning with efficient large language model and prompt fine-tuning. InInternational Conference on Medical Image Computing and Computer-Assisted Intervention, pages 465–475. Springer, 2024

    2024

  21. [29]

    Multi-view and multi-scale alignment for contrastive language-image pre-training in mammography.arXiv preprint arXiv:2409.18119, 2024

    Yuexi Du, John Onofrey, and Nicha C Dvornek. Multi-view and multi-scale alignment for contrastive language-image pre-training in mammography.arXiv preprint arXiv:2409.18119, 2024

    2024 arXiv

  22. [30]

    Asymmetric loss for multi-label classification

    Tal Ridnik, Emanuel Ben-Baruch, Nadav Zamir, Asaf Noy, Itamar Friedman, Matan Protter, and Lihi Zelnik-Manor. Asymmetric loss for multi-label classification. InProceedings of the IEEE/CVF Inter- national Conference on Computer Vision, pages 82–91, 2021

    2021

  23. [31]

    Biomedlm: A 2.7 b parameter language model trained on biomedical text.arXiv preprint arXiv:2403.18421, 2024

    Elliot Bolton, Abhinav Venigalla, Michihiro Yasunaga, David Hall, Betty Xiong, Tony Lee, Roxana Daneshjou, Jonathan Frankle, Percy Liang, Michael Carbin, et al. Biomedlm: A 2.7 b parameter language model trained on biomedical text.arXiv preprint arXiv:2403.18421, 2024

    2024 arXiv

  24. [32]

    Ml-decoder: Scalable and versatile classification head

    Tal Ridnik, Gilad Sharir, Avi Ben-Cohen, Emanuel Ben-Baruch, and Asaf Noy. Ml-decoder: Scalable and versatile classification head. InProceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 32–41, 2023

    2023

  25. [33]

    Self-training with noisy student im- proves imagenet classification

    Qizhe Xie, Minh-Thang Luong, Eduard Hovy, and Quoc V Le. Self-training with noisy student im- proves imagenet classification. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10687–10698, 2020

    2020

  26. [34]

    Dinov2: Learning robust visual features without supervision.arXiv preprint arXiv:2304.07193, 2023

    Maxime Oquab, Timoth ´ee Darcet, Th´eo Moutakanni, Huy V o, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, et al. Dinov2: Learning robust visual features without supervision.arXiv preprint arXiv:2304.07193, 2023

    2023 arXiv

  27. [35]

    Transformers for image recognition at scale.Online: https://ai

    Houlsby Neil and Weissenborn Dirk. Transformers for image recognition at scale.Online: https://ai. googleblog. com/2020/12/transformers-for-image-recognitionat. html, 2020

    2020

  28. [36]

    Maxvit: Multi-axis vision transformer

    Zhengzhong Tu, Hossein Talebi, Han Zhang, Feng Yang, Peyman Milanfar, Alan Bovik, and Yinxiao Li. Maxvit: Multi-axis vision transformer. InEuropean conference on computer vision, pages 459–

  29. [37]

    Making the most of text semantics to improve biomedical vision–language processing

    Benedikt Boecking, Naoto Usuyama, Shruthi Bannur, Daniel C Castro, Anton Schwaighofer, Stephanie Hyland, Maria Wetscherek, Tristan Naumann, Aditya Nori, Javier Alvarez-Valle, et al. Making the most of text semantics to improve biomedical vision–language processing. InEuropean ...

    2022

  30. [38]

    Gpt-4 technical report

    Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. Gpt-4 technical report. arXiv preprint arXiv:2303.08774, 2023

    2023 arXiv

  31. [39]

    Medklip: Medical knowledge enhanced language-image pre-training in radiology.arXiv preprint arXiv:2301.02228, 2023

    Chaoyi Wu, Xiaoman Zhang, Ya Zhang, Yanfeng Wang, and Weidi Xie. Medklip: Medical knowledge enhanced language-image pre-training in radiology.arXiv preprint arXiv:2301.02228, 2023

    2023 arXiv

  32. [40]

    Deep residual learning for image recog- nition

    Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recog- nition. InProceedings of the IEEE conference on computer vision and pattern recognition, pages 770–778, 2016

    2016

  33. [41]

    Publicly available clinical bert embeddings.arXiv preprint arXiv:1904.03323, 2019

    Emily Alsentzer, John R Murphy, Willie Boag, Wei-Hung Weng, Di Jin, Tristan Naumann, and Matthew McDermott. Publicly available clinical bert embeddings.arXiv preprint arXiv:1904.03323, 2019

    1904 arXiv

  34. [42]

    Extracting and encoding: Leveraging large language models and medical knowledge to enhance radiological text representation

    Pablo Messina, Ren ´e Vidal, Denis Parra, ´Alvaro Soto, and Vladimir Araujo. Extracting and encoding: Leveraging large language models and medical knowledge to enhance radiological text representation. arXiv preprint arXiv:2407.01948, 2024

    2024 arXiv

  35. [43]

    Densely connected convolutional networks

    Gao Huang, Zhuang Liu, Laurens Van Der Maaten, and Kilian Q Weinberger. Densely connected convolutional networks. InProceedings of the IEEE conference on computer vision and pattern recog- nition, pages 4700–4708, 2017

    2017

  36. [44]

    Sigmoid loss for language image pre-training

    Xiaohua Zhai, Basil Mustafa, Alexander Kolesnikov, and Lucas Beyer. Sigmoid loss for language image pre-training. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 11975–11986, 2023

    2023

  37. [45]

    Uni- former: Unified transformer for efficient spatiotemporal representation learning.arXiv preprint arXiv:2201.04676, 2022

    Kunchang Li, Yali Wang, Peng Gao, Guanglu Song, Yu Liu, Hongsheng Li, and Yu Qiao. Uni- former: Unified transformer for efficient spatiotemporal representation learning.arXiv preprint arXiv:2201.04676, 2022

    2022 arXiv

  38. [46]

    Film: Visual reasoning with a general conditioning layer

    Ethan Perez, Florian Strub, Harm De Vries, Vincent Dumoulin, and Aaron Courville. Film: Visual reasoning with a general conditioning layer. InProceedings of the AAAI conference on artificial intel- ligence, volume 32, 2018

    2018

  39. [47]

    Enhancing disease detection in radiology reports through fine-tuning lightweight llm on weak labels

    Yishu Wei, Xindi Wang, Hanley Ong, Yiliang Zhou, Adam Flanders, George Shih, and Yifan Peng. Enhancing disease detection in radiology reports through fine-tuning lightweight llm on weak labels. arXiv preprint arXiv:2409.16563, 2024

    2024 arXiv

  40. [48]

    Transformers in vision: A survey.ACM computing surveys (CSUR), 54(10s):1–41, 2022

    Salman Khan, Muzammal Naseer, Munawar Hayat, Syed Waqas Zamir, Fahad Shahbaz Khan, and Mubarak Shah. Transformers in vision: A survey.ACM computing surveys (CSUR), 54(10s):1–41, 2022

    2022

  41. [49]

    Hybrid cnn-vit models for medical image classification

    Dimitrios Pantelaios, Paraskevi-Antonia Theofilou, Paraskevi Tzouveli, and Stefanos Kollias. Hybrid cnn-vit models for medical image classification. In2024 IEEE International Symposium on Biomedical Imaging (ISBI), pages 1–4. IEEE, 2024

    2024

  42. [50]

    Ensemble deep learning: A review.Engineering Applications of Artificial Intelligence, 115:105151, 2022

    Mudasir A Ganaie, Minghui Hu, Ashwani Kumar Malik, Muhammad Tanveer, and Ponnuthurai N Suganthan. Ensemble deep learning: A review.Engineering Applications of Artificial Intelligence, 115:105151, 2022

    2022

  43. [51]

    Deep ensembles: A loss landscape perspec- tive.arXiv preprint arXiv:1912.02757, 2019

    Stanislav Fort, Huiyi Hu, and Balaji Lakshminarayanan. Deep ensembles: A loss landscape perspec- tive.arXiv preprint arXiv:1912.02757, 2019. 19

    1912 arXiv

  44. [52]

    A comprehensive survey of image augmentation techniques for deep learning.Pattern Recognition, 137:109347, 2023

    Mingle Xu, Sook Yoon, Alvaro Fuentes, and Dong Sun Park. A comprehensive survey of image augmentation techniques for deep learning.Pattern Recognition, 137:109347, 2023

    2023

  45. [53]

    Deep hierarchical multi-label classification of chest x-ray images

    Haomin Chen, Shun Miao, Daguang Xu, Gregory D Hager, and Adam P Harrison. Deep hierarchical multi-label classification of chest x-ray images. InInternational conference on medical imaging with deep learning, pages 109–120. PMLR, 2019

    2019

  46. [54]

    Clinical-bert: Vision-language pre-training for radiograph diagnosis and reports generation

    Bin Yan and Mingtao Pei. Clinical-bert: Vision-language pre-training for radiograph diagnosis and reports generation. InProceedings of the AAAI Conference on Artificial Intelligence, volume 36, pages 2982–2990, 2022

    2022

  47. [55]

    Vilmedic: a framework for research at the intersection of vision and language in medical ai

    Jean-benoit Delbrouck, Khaled Saab, Maya Varma, Sabri Eyuboglu, Pierre Chambon, Jared Dunnmon, Juan Zambrano, Akshay Chaudhari, and Curtis Langlotz. Vilmedic: a framework for research at the intersection of vision and language in medical ai. InProceedings of the 60th Annual Me...

    2022

  48. [56]

    Multi-modal understanding and generation for medical images and text via vision-language pre-training.IEEE Journal of Biomedical and Health Informatics, 26(12):6070–6080, 2022

    Jong Hak Moon, Hyungyung Lee, Woncheol Shin, Young-Hak Kim, and Edward Choi. Multi-modal understanding and generation for medical images and text via vision-language pre-training.IEEE Journal of Biomedical and Health Informatics, 26(12):6070–6080, 2022

    2022

  49. [57]

    Llava-med: Training a large language-and-vision assistant for biomedicine in one day.Advances in Neural Information Processing Systems, 36, 2024

    Chunyuan Li, Cliff Wong, Sheng Zhang, Naoto Usuyama, Haotian Liu, Jianwei Yang, Tristan Nau- mann, Hoifung Poon, and Jianfeng Gao. Llava-med: Training a large language-and-vision assistant for biomedicine in one day.Advances in Neural Information Processing Systems, 36, 2024

    2024

  50. [58]

    Med-flamingo: a multimodal medical few-shot learner

    Michael Moor, Qian Huang, Shirley Wu, Michihiro Yasunaga, Yash Dalmia, Jure Leskovec, Cyril Zakka, Eduardo Pontes Reis, and Pranav Rajpurkar. Med-flamingo: a multimodal medical few-shot learner. InMachine Learning for Health (ML4H), pages 353–367. PMLR, 2023

    2023

  51. [59]

    Improving model fairness in image-based computer-aided diagnosis.Nature Communications, 14(1):6261, 2023

    Mingquan Lin, Tianhao Li, Yifan Yang, Gregory Holste, Ying Ding, Sarah H Van Tassel, Kyle Ko- vacs, George Shih, Zhangyang Wang, Zhiyong Lu, et al. Improving model fairness in image-based computer-aided diagnosis.Nature Communications, 14(1):6261, 2023

    2023

  52. [60]

    Hurdles to artificial intelligence deployment: Noise in schemas and “gold” labels.Radiology: Artificial Intelligence, 5(2):e220056, 2023

    Mohamed Abdalla and Benjamin Fine. Hurdles to artificial intelligence deployment: Noise in schemas and “gold” labels.Radiology: Artificial Intelligence, 5(2):e220056, 2023

    2023

  53. [61]

    Large-scale long-tailed disease diagnosis on radiology images.Nature Communications, 15(1):10147, 2024

    Qiaoyu Zheng, Weike Zhao, Chaoyi Wu, Xiaoman Zhang, Lisong Dai, Hengyu Guan, Yuehua Li, Ya Zhang, Yanfeng Wang, and Weidi Xie. Large-scale long-tailed disease diagnosis on radiology images.Nature Communications, 15(1):10147, 2024

    2024

  54. [62]

    S Kevin Zhou, Hayit Greenspan, Christos Davatzikos, James S Duncan, Bram Van Ginneken, Anant Madabhushi, Jerry L Prince, Daniel Rueckert, and Ronald M Summers. A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlight...

    2021

  55. [4825]

    doi: 10.1016/j.compbiomed.2024.108460

    2024

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.