Controlled large-scale pretraining on 18.2M hours of wearables shows self-supervised motion models beat scratch training, with triaxial fidelity, data diversity, and task-matched windows mattering more than model size alone.
Pene- trative ai: Making llms comprehend the physical world
4 Pith papers cite this work. Polarity classification is still indexing.
4
Pith papers citing it
abstract
We present RelCon, a novel self-supervised Relative Contrastive learning approach for training a motion foundation model from wearable accelerometry sensors. First, a learnable distance measure is trained to capture motif similarity and domain-specific semantic information such as rotation invariance. Then, the learned distance provides a measurement of semantic similarity between a pair of accelerometry time-series, which we use to train our foundation model to model relative relationships across time and across subjects. The foundation model is trained on 1 billion segments from 87,376 participants, and achieves state-of-the-art performance across multiple downstream tasks, including human activity recognition and gait metric regression. To our knowledge, we are the first to show the generalizability of a foundation model with motion data from wearables across distinct evaluation tasks.
citation-role summary
background 1
citation-polarity summary
years
2026 4roles
background 1polarities
background 1representative citing papers
A PPG foundation model pretrained via multimodal ECG/respiratory contrastive sample selection on ICU data improves performance on 14 of 15 downstream tasks including field-like data while using 3x fewer subjects.
Large Sensor Models trained on large-scale multimodal wearable data can provide a scalable, general framework for wearable AI by learning transferable representations across modalities and tasks.
The survey organizes foundation models for sensor-based HAR into a lifecycle taxonomy and identifies three trajectories: HAR-specific models from scratch, adaptation of general time-series models, and integration with large language models.
citing papers explorer
-
Inertia-1: An Open Exploration of Wearable Motion Foundation Models
Controlled large-scale pretraining on 18.2M hours of wearables shows self-supervised motion models beat scratch training, with triaxial fidelity, data diversity, and task-matched windows mattering more than model size alone.
-
A robust PPG foundation model using multimodal physiological supervision
A PPG foundation model pretrained via multimodal ECG/respiratory contrastive sample selection on ICU data improves performance on 14 of 15 downstream tasks including field-like data while using 3x fewer subjects.
-
Wearable AI in the Era of Large Sensor Models
Large Sensor Models trained on large-scale multimodal wearable data can provide a scalable, general framework for wearable AI by learning transferable representations across modalities and tasks.
-
Foundation Models Defining A New Era In Sensor-based Human Activity Recognition: A Survey And Outlook
The survey organizes foundation models for sensor-based HAR into a lifecycle taxonomy and identifies three trajectories: HAR-specific models from scratch, adaptation of general time-series models, and integration with large language models.