Pith. sign in

REVIEW 2 major objections 2 minor 1 cited by

A robust PPG foundation model using multimodal physiological supervision

T0 review · 2 major / 2 minor · reviewed 2026-06-27 · grok-4.3

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read Using ECG and respiratory signals to pick contrastive PPG samples yields a foundation model that beats priors on 14 of 15 tasks after pretraining on one-third the subjects.

desk verdict The multimodal ECG/resp sample selection for PPG pretraining is a practical angle worth checking, but the abstract gives no numbers or controls so the robustness claim is still untested. read the letter →

arxiv 2606.07365 v1 pith:4JPGVCJY submitted 2026-06-05 cs.LG cs.AI

Eloy Geenjaar , Vince Calhoun , Scott Daly , Gouthaman KV , Lie Lu , Trisha Mittal , Daniel P. Darcy This is my paper
classification cs.LGcs.AI
keywords PPGfoundationmodelmultimodalsupervisioncontrastivelearningphotoplethysmographyECGgeneralizationwearables
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper proposes pretraining a PPG foundation model on ICU data by using accompanying ECG and respiratory signals to select contrastive samples. This lets the model keep and learn from noisy PPG segments instead of discarding them or requiring curated high-quality data. Pretrained on three times fewer subjects than prior state-of-the-art approaches, the resulting model improves performance on fourteen of fifteen downstream tasks that include field-like daily activity recognition and heart rate prediction. The results indicate that multimodal physiological supervision can integrate complementary signals to produce PPG representations that generalize more robustly to consumer-grade, noisy data.

What carries the argument

Multimodal physiological supervision that uses ECG and respiratory signals to select contrastive samples during pretraining on ICU PPG data.

What would settle it

Evaluation on a held-out set of noisy field PPG recordings in which the model shows no improvement over single-channel baselines or degrades on tasks that depend on subtle PPG features absent from the auxiliary signals.

Watch

Extended reading notes

Core claim

By supervising contrastive sample selection with ECG and respiratory channels from ICU recordings, a PPG model can retain noisy segments during pretraining and thereby learn representations that generalize to noisy field PPG while requiring fewer subjects than existing foundation models.

Load-bearing premise

Selecting contrastive samples with ECG and respiratory signals from ICU datasets will produce representations that generalize to noisy field-like PPG without selection bias or loss of information unique to the PPG channel.

Editorial extensions

If this is right

  • The model can be deployed on consumer wearables without access to large curated field PPG corpora for pretraining.
  • Robustness at inference improves because noisy PPG segments are retained rather than filtered during training.
  • Downstream performance gains appear on both clinical and daily-activity tasks that use real-world noisy signals.
  • Pretraining data requirements drop because three times fewer subjects suffice to reach or exceed prior results.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The same supervision strategy could be tested on other biosignals where auxiliary channels exist only during training but not at deployment.
  • If the auxiliary signals reduce selection bias, similar multimodal selection might improve single-channel foundation models in other sensing domains.
  • Lower subject counts could make large-scale pretraining feasible for groups with limited access to ICU datasets.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

2 major / 2 minor

Summary. The paper proposes a PPG foundation model pretrained on ICU datasets by using accompanying ECG and respiratory signals to select contrastive samples. This multimodal supervision is intended to allow the model to retain and learn from noisy PPG segments, yielding a representation robust to field-like artifacts. The model is pretrained on 3× fewer subjects than prior SOTA approaches and is reported to improve performance on 14 of 15 downstream tasks, including daily activity recognition and heart-rate estimation on consumer-grade data.

Significance. If the central empirical claim holds after addressing selection-bias concerns, the result would be significant: it would show that abundant, lower-quality ICU recordings can be leveraged for robust PPG pretraining without curated field data, lowering the barrier to foundation-model development for wearable PPG applications.

major comments (2)
  1. [§3] §3 (multimodal sample selection): the procedure that retains PPG segments whose ECG/resp agreement exceeds a threshold must be shown not to embed ICU-specific cross-channel correlations that are unavailable at inference on field PPG; without an explicit test (e.g., performance drop when the same selection rule is applied to ambulatory data or an ablation that removes ECG/resp guidance), the 14/15-task gains could be explained by retained ICU cues rather than improved robustness.
  2. [Results] Results section (downstream evaluation): the headline claim of improvement on 14/15 tasks is presented without reported statistical tests, confidence intervals, or per-task effect sizes; in addition, an ablation that trains the identical architecture with random (non-multimodal) contrastive sampling is required to isolate whether the reported gains are attributable to the proposed supervision rather than architecture or data volume.
minor comments (2)
  1. [Abstract] Abstract and §1: quantitative deltas, baseline names, and subject counts for the 3× reduction claim should be stated explicitly rather than left as qualitative assertions.
  2. [§3] Notation in §3: the precise definition of the contrastive loss and the ECG/resp agreement metric (e.g., cross-correlation threshold) should be given as an equation rather than prose description.

Simulated Author's Rebuttal

2 responses · 1 unresolved

We thank the referee for the constructive feedback. We address each major comment below and indicate revisions to the manuscript.

read point-by-point responses

  1. Referee: §3 (multimodal sample selection): the procedure that retains PPG segments whose ECG/resp agreement exceeds a threshold must be shown not to embed ICU-specific cross-channel correlations that are unavailable at inference on field PPG; without an explicit test (e.g., performance drop when the same selection rule is applied to ambulatory data or an ablation that removes ECG/resp guidance), the 14/15-task gains could be explained by retained ICU cues rather than improved robustness.

    Authors: We agree that it is important to confirm the gains arise from robustness rather than retained ICU correlations. The selection procedure is applied exclusively during pretraining; inference uses PPG alone. We will add an ablation that trains the identical architecture with random (non-multimodal) contrastive sampling on the same data to isolate the contribution of ECG/resp guidance. We note that directly applying the selection rule to ambulatory data is not possible, as those datasets lack the auxiliary ECG and respiratory channels required to compute agreement. revision: partial

  2. Referee: Results section (downstream evaluation): the headline claim of improvement on 14/15 tasks is presented without reported statistical tests, confidence intervals, or per-task effect sizes; in addition, an ablation that trains the identical architecture with random (non-multimodal) contrastive sampling is required to isolate whether the reported gains are attributable to the proposed supervision rather than architecture or data volume.

    Authors: We accept that statistical reporting and the requested ablation are needed for rigor. The revised manuscript will include per-task statistical tests, confidence intervals, and effect sizes for all 15 downstream tasks. We will also report the ablation using random contrastive sampling with the same architecture and data to attribute gains specifically to the multimodal supervision. revision: yes

standing simulated objections not resolved
  • Direct application of the multimodal selection rule to ambulatory data, as such datasets lack the ECG and respiratory signals required to compute the agreement threshold.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity; purely empirical pretraining with held-out evaluation

full rationale

The paper presents an empirical contrastive pretraining method that selects samples using accompanying ECG/respiratory channels from ICU data, then evaluates the resulting encoder on 15 downstream tasks (including field-like ones) using held-out data. No equations, derivations, uniqueness theorems, or fitted parameters are described that reduce a claimed prediction to the method's own inputs by construction. The central performance claims (14/15 improvements, 3x fewer subjects) are external benchmarks, not self-referential. This matches the default non-circular case for empirical ML work.

Assumptions & free parameters 0 free parameters · 0 assumptions · 0 invented entities

Abstract-only review provides no explicit free parameters, axioms, or invented entities. The method appears to rest on standard contrastive learning assumptions common in self-supervised ML without additional ad-hoc constructs described.

how reviews work

0 comments
Cite this review

Pith. "Pith review of A robust PPG foundation model using multimodal physiological supervision." pith.science (2026). https://pith.science/paper/4JPGVCJY

@misc{pith2026260607365,
  author       = {Pith},
  title        = {Pith review of: A robust PPG foundation model using multimodal physiological supervision},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/4JPGVCJY}},
  note         = {Machine review of arXiv:2606.07365}
}
read the original abstract

Photoplethysmography (PPG), a non-invasive measure of changes in blood volume, is widely used in both wearable devices and clinical settings. Recent PPG foundation models either use open-source ICU datasets with pretraining paradigms that require curated data and thus complicate generalization to field-like data, or use closed-source field-like PPG data. In contrast, we propose a PPG foundation model that does not require high-quality or field-like pretraining data, and instead leverages accompanying electrocardiogram and respiratory signals in ICU datasets to select contrastive samples during pretraining. Our approach allows the model to retain and learn from noisy PPG segments, improving robustness at inference. Our model, pretrained on 3x fewer subjects than existing state-of-the-art approaches, achieves performance improvements on 14 out of 15 diverse downstream tasks, including field-like daily activity and heart rate prediction. Our results demonstrate that multimodal supervision can integrate complementary physiological information to improve the robustness of PPG foundation models and enhance their generalization to consumer-grade data.

Figures

Figures reproduced from arXiv: 2606.07365 by the authors.

Figure 1
Figure 1. Multimodal contrastive supervision framework. (Left) The electrocardiogram (ECG) and respiratory (RESP) data co-recorded with PPG is segmented into 10s windows. Five metrics are extracted from the ECG and RESP segments that summarize those windows in a 5-dimensional vector. (Middle) The metrics are used to generate contrastive samples during pretraining. (Right) The unimodal PPG embeddings are evaluated using variou… view at source ↗
Figure 2
Figure 2. Comparison with state-of-the-art. (Left) Classification results in terms of their macro F-1 score (larger area is better). (Right) Regression results in terms of their mean average error (smaller area is better). We evaluate across subject linear probing, and within subject linear probing [PITH_FULL_IMAGE:figures/full_fig_p006_2.png] view at source ↗
Figure 4
Figure 4. WildPPG heart rate estimation comparison across PPG sensor location (x-axis) and type (y-axis). aged 47-61 is worst and performance is lower for female subjects. These findings underscore existing challenges in equitable biosignal modeling and highlight areas for future bias mitigation. Heart rate estimation ablation [PITH_FULL_IMAGE:figures/full_fig_p008_4.png] view at source ↗
Figures from the paper (3 more)
Figure 5
Figure 5. Figure 5: shows a visualization of the embedding space for a single subject from the PPG-DaLiA dataset, highlighting the difference between our method and our replication of PaPaGei-S (labeled as ’Unimodal’). In the figure, our model’s embedding space shows a clear gradient in t…
Figure 6
Figure 6. Figure 6: Average performance across varying percentages of within-subject data. Shaded areas represent standard deviation across folds. 20 [PITH_FULL_IMAGE:figures/full_fig_p020_6.png]
Figure 7
Figure 7. Figure 7: ), middle-to-high (0.575 − 0.75) is defined to capture the bulk of the IMU energy distribution, and ultra-high IMU energy values (> 0.75) are ones that fall into the long tail of the distribution. These thresholds roughly correspond to distinct operating conditions ran…

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. When Derived Measurements Mislead: Quantifying and Mitigating LLM Over-Trust with Privileged-Modality Reliability Evidence

    cs.AI 2026-07 conditional novelty 6.5 of 10

    DFOT is formalized with five frozen estimands and a matched–shuffled evidence test; on locked PPG–ECG data a privileged student modestly improves repair and specificity over a PPG-only baseline.

Reference graph

Works this paper leans on

25 extracted references · 16 canonical work pages · cited by 1 Pith paper

  1. [1]

    Large-scale Training of Foundation Models for Wearable Biosignals

    Abbaspourazad, S., Elachqar, O., Miller, A. C., Emrani, S., Nallasamy, U., and Shapiro, I. Large-scale training of foundation models for wearable biosignals.arXiv preprint arXiv:2312.05409,

    work page Pith review arXiv

  2. [2]

    C., and Shapiro, I

    Abbaspourazad, S., Mishra, A., Futoma, J., Miller, A. C., and Shapiro, I. Wearable accelerometer foundation mod- els for health via knowledge distillation.arXiv preprint arXiv:2412.11276,

    work page arXiv

  3. [3]

    On the Opportunities and Risks of Foundation Models

    Bommasani, R. On the opportunities and risks of foundation models.arXiv preprint arXiv:2108.07258,

    work page Pith review arXiv

  4. [4]

    ncbi.nlm.nih.gov/books/NBK482414/

    URL https://www. ncbi.nlm.nih.gov/books/NBK482414/. [Up- dated 2023 Jun 5]. Capulli, E., Druda, Y ., Palmese, F., Butt, A. H., Domenicali, M., Macchiarelli, A. G., Silvani, A., Bedogni, G., and Ingravallo, F. Ethical and legal implications of health monitoring wearable devices: A scoping review.Social Science & Medicine, pp. 117685,

    2023

  5. [5]

    S., Goh, H., Sandino, C

    Chien, H.-Y . S., Goh, H., Sandino, C. M., and Cheng, J. Y . Maeeg: Masked auto-encoder for eeg representation learning.arXiv preprint arXiv:2211.02625,

    work page arXiv

  6. [6]

    Bert: Pre-training of deep bidirectional transformers for lan- guage understanding

    Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. Bert: Pre-training of deep bidirectional transformers for lan- guage understanding. InProceedings of the 2019 confer- ence of the North American chapter of the association for computational linguistics: human language technologies, volume 1 (long and short papers), pp. 4171–4186,

    2019

  7. [7]

    Pro- moting cross-modal representations to improve multi- modal foundation models for physiological signals.arXiv preprint arXiv:2410.16424,

    Fang, C., Sandino, C., Mahasseni, B., Minxha, J., Pouransari, H., Azemi, E., Moin, A., and Zippi, E. Pro- moting cross-modal representations to improve multi- modal foundation models for physiological signals.arXiv preprint arXiv:2410.16424,

    work page arXiv

  8. [8]

    L., Pouransari, H., Sandino, C., Nie, J., Goh, H., Azemi, E., and Moin, A

    Liu, R., Zippi, E. L., Pouransari, H., Sandino, C., Nie, J., Goh, H., Azemi, E., and Moin, A. Frequency- aware masked autoencoders for multimodal pretraining on biosignals.arXiv preprint arXiv:2309.05927,

    work page arXiv

Show all 25 references
  1. [9]

    URL https://doi.org/10

    doi: 10.3758/ s13428-020-01516-y. URL https://doi.org/10. 3758%2Fs13428-020-01516-y. McInnes, L., Healy, J., and Melville, J. Umap: Uniform manifold approximation and projection for dimension reduction.arXiv preprint arXiv:1802.03426,

    arXiv

  2. [10]

    H., Sinthong, P., and Kalagnanam, J

    Nie, Y ., Nguyen, N. H., Sinthong, P., and Kalagnanam, J. A time series is worth 64 words: Long-term forecasting with transformers.arXiv preprint arXiv:2211.14730,

    arXiv

  3. [11]

    Pa- pagei: Open foundation models for optical physiological signals.arXiv preprint arXiv:2410.20542,

    Pillai, A., Spathis, D., Kawsar, F., and Malekzadeh, M. Pa- pagei: Open foundation models for optical physiological signals.arXiv preprint arXiv:2410.20542,

  4. [12]

    A., Mao, W., Neupane, S., Rehg, J

    Saha, M., Xu, M. A., Mao, W., Neupane, S., Rehg, J. M., and Kumar, S. Pulse-ppg: An open-source field-trained ppg foundation model for wearable applications across lab and field settings.arXiv preprint arXiv:2502.01108,

  5. [13]

    Thapa, R., He, B., Kjaer, M

    URL https://arxiv.org/ abs/2211.10831. Thapa, R., He, B., Kjaer, M. R., Moore IV , H., Ganjoo, G., Mignot, E., and Zou, J. Y . Sleepfm: Multi-modal representation learning for sleep across ecg, eeg and res- piratory signals. InAAAI 2024 Spring Symposium on Clinical Foundation Models,

    2024

  6. [14]

    Unsuper- vised representation learning for time series with temporal neighborhood coding.arXiv preprint arXiv:2106.00750,

    Tonekaboni, S., Eytan, D., and Goldenberg, A. Unsuper- vised representation learning for time series with temporal neighborhood coding.arXiv preprint arXiv:2106.00750,

  7. [15]

    Vital videos: A dataset of face videos with ppg and blood pressure ground truths.arXiv preprint arXiv:2306.11891,

    Toye, P.-J. Vital videos: A dataset of face videos with ppg and blood pressure ground truths.arXiv preprint arXiv:2306.11891,

  8. [16]

    Cardiorespiratory dynamic response to mental stress: A multivariate time-frequency analysis.Computational and mathematical methods in medicine, 2013(1):451857,

    Widjaja, D., Orini, M., Vlemincx, E., and Van Huffel, S. Cardiorespiratory dynamic response to mental stress: A multivariate time-frequency analysis.Computational and mathematical methods in medicine, 2013(1):451857,

    2013

  9. [17]

    A., Moreno, A., Wei, H., Marlin, B

    Xu, M. A., Moreno, A., Wei, H., Marlin, B. M., and Rehg, J. M. Rebar: Retrieval-based reconstruction for time-series contrastive learning.arXiv preprint arXiv:2311.00519,

  10. [18]

    A., Narain, J., Darnell, G., Hallgrimsson, H., Jeong, H., Forde, D., Fineman, R., Raghuram, K

    Xu, M. A., Narain, J., Darnell, G., Hallgrimsson, H., Jeong, H., Forde, D., Fineman, R., Raghuram, K. J., Rehg, J. M., and Ren, S. Relcon: Relative contrastive learning for a motion foundation model for wearable data.arXiv preprint arXiv:2411.18822,

  11. [19]

    A., Narayan- swamy, G., Xu, M

    Zhang, Y ., Ayush, K., Qiao, S., Heydari, A. A., Narayan- swamy, G., Xu, M. A., Metwally, A. A., Xu, S., Garrison, J., Xu, X., et al. Sensorlm: Learning the language of wear- able sensors.arXiv preprint arXiv:2506.09108,

  12. [20]

    ECG and RESP pre-processing We identify sessions containing more than one hour of continuous data across all three modalities: ECG, RESP, and PPG

    13 A Robust PPG Foundation Model using multimodal physiological supervision A. ECG and RESP pre-processing We identify sessions containing more than one hour of continuous data across all three modalities: ECG, RESP, and PPG. The ECG and RESP signals are filtered using NeuroKi...

    2021

  13. [21]

    Although the dataset records data from a variety of physiological sensors, we only select the PPG data, which is recorded with a 64Hz sensor

    contains 15 subjects recorded in a lab setting. Although the dataset records data from a variety of physiological sensors, we only select the PPG data, which is recorded with a 64Hz sensor. In terms of PPG preprocessing we follow (Xu et al., 2023), whose preprocessing code is ...

    2023

  14. [22]

    The study consists of baseline dataset collection, a VR familiarity task, and then a set of VR stimuli with post-exposure questionnaires

    measures PPG data at 125Hz while 37 subjects are wearing a virtual reality (VR) headset. The study consists of baseline dataset collection, a VR familiarity task, and then a set of VR stimuli with post-exposure questionnaires. To evoke specific levels of arousal and valence, t...

    2017

  15. [23]

    There are three PPG recordings for each subject that last around 2 second each, and 219 subjects in total

    released the PPG blood pressure dataset ( PPG-BP), with PPG sampled at 1000Hz. There are three PPG recordings for each subject that last around 2 second each, and 219 subjects in total. We noticed some issues with resampling the data, so we decided to linearly interpolate the ...

    2020

  16. [24]

    The dataset records data from 16 subjects, and each PPG sensor records at 128 Hz

    released the WildPPG database. The dataset records data from 16 subjects, and each PPG sensor records at 128 Hz. The ground truth estimate of the heart rate is estimated with an ECG trace recorded from each subject’s sternum. The dataset contains data for three types of PPG se...

    2019

  17. [25]

    Checkpoint selection.During pretraining we save checkpoints for the backbone every 5000 steps

    The output embedding for our model is thus a (2×batch size,512)tensor. Checkpoint selection.During pretraining we save checkpoints for the backbone every 5000 steps. To select the final checkpoint that we use for comparisons, we evaluate each checkpoint on every single downstr...

    2011

Pith tools

Reviewed June 27, 2026 · model on record in the stance chip above.