PiCME shows contrastive learning peaks at three modalities in MIMIC, and a Modality-Gated LSTM with contrastively learned weights improves five-modality mortality prediction over supervised baselines.
Weakly-Supervised Multimodal Learning on MIMIC-CXR
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Multimodal data integration and label scarcity pose significant challenges for machine learning in medical settings. To address these issues, we conduct an in-depth evaluation of the newly proposed Multimodal Variational Mixture-of-Experts (MMVM) VAE on the challenging MIMIC-CXR dataset. Our analysis demonstrates that the MMVM VAE consistently outperforms other multimodal VAEs and fully supervised approaches, highlighting its strong potential for real-world medical applications.
citation-role summary
citation-polarity summary
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
background 1representative citing papers
citing papers explorer
-
PiCME: Pipeline for Contrastive Modality Evaluation and Encoding in the MIMIC Dataset
PiCME shows contrastive learning peaks at three modalities in MIMIC, and a Modality-Gated LSTM with contrastively learned weights improves five-modality mortality prediction over supervised baselines.