Illustration of five physiological signal sources — EEG, wrist accelerometer, chest ECG, respiratory belt, and pulse oximeter — each with a masked-and-reconstructed signal pair, converging into a shared latent-representation sphere that fans out into sleep staging, patient-similarity clustering, and future-risk trajectory outputs.

A model pretrained on one physiological signal should not have to be rebuilt for the next cohort, the next device, or the next clinical question. Two lines of work test how far that holds — one starting from polysomnography, one from wrist accelerometry.

Foundation models for polysomnography. A multimodal sleep foundation model for disease prediction is the model itself; Stanford Sleep Bench is the benchmark comparing the pretraining methods behind it; and mechanistic interpretability via sparse autoencoders asks what such a model has actually learned. Representations pretrained on sleep also transfer to non-sleep biosignal tasks.

Foundation models for wrist accelerometry. The same question applied to a far cheaper sensor: frequency-aware masked autoencoders for activity recognition, physiology-aware pretraining that recovers pulse- and respiration-related motion for sleep staging and apnea evaluation, and paired models predicting future disease risk from one week of wrist movement in 97,696 UK Biobank participants — see also Wearables for scalable health assessment.

Foundation models for polysomnography

Large-scale representation learning from multimodal sleep recordings for transferable health and disease prediction — spanning the model itself, the pretraining methodology behind it, and work interpreting what it learns.

Foundation models for wrist accelerometry

Self-supervised and physiology-aware representation learning from wrist accelerometry, spanning human activity recognition, sleep staging, apnea evaluation, and future health prediction.

Related work in this theme

9 publications in this theme — View all 9 publications