Self-supervised ECG embedding model inspired by BERT/RoBERTa from natural language processing, designed for efficient medical signal analysis. HeartBERT translates ECG signals into an intermediate synthetic 'language' via signal quantization and discretization (Lloyd-Max quantization), then trains a RoBERTa-style encoder from scratch on this text-like representation using the MIT-BIH Arrhythmia Database, PTB-XL, and European ST-T Database. The resulting embeddings are evaluated on two downstream tasks -- sleep-stage classification and heartbeat classification -- using bidirectional LSTM heads, showing particular strength when only small labeled training datasets are available.

Self-supervised representation-learning method for 12-lead ECG signals, designed to reduce reliance on large labeled datasets for downstream ECG classification. TSSL exploits two structural properties of ECG data: temporally, it encourages stable representations for the same individual across time while keeping different leads distinguishable; spatially, it enforces consistency in the relationships between signals and their representations across the different leads of a single recording. Evaluated on three public ECG datasets (CPSC2018, Chapman, PTB-XL), TSSL-pretrained models approached the performance of fully supervised training while using only about 10% of the labeled data.

ECG-guided photoplethysmography (PPG) foundation model pretrained on over 100,000 hours of synchronized PPG-ECG recordings from 58,796 subjects across five clinical and wearable sources, using a CLIP-style contrastive alignment framework so the PPG encoder inherits physiologically grounded structure from paired ECG. Achieves state-of-the-art performance on 13 of 15 conventional physiological-analysis tasks across eight datasets, and shows meaningful discriminative capability (AUC >= 0.70) for 307 ICD-10-coded phenotypes across 16 phecode chapters, including many non-cardiovascular conditions.

LoRA-adapted domain-specialized cardiology text embedding model built on BioLinkBERT (340M parameters), identified as the top performer among 10 encoder- and decoder-style transformer architectures benchmarked head-to-head for cardiology semantic retrieval. LoRA fine-tuning on ~150,000 cardiology-textbook-derived sentence pairs raised its cardiology semantic-separation score from 0.033 (zero-shot) to 0.510, the highest of any evaluated architecture (including decoder models up to 10x larger), while remaining Pareto-optimal for the separation/throughput trade-off at 143.5 embeddings/sec and a 1.51GB memory footprint.

Foundation vision-language model for cardiac MRI that learns pathophysiological visual representations directly from the natural-language radiology reports accompanying each scan, rather than from hand-labeled targets. A Multi-scale Vision Transformer (MViT, Kinetics-400-initialized) video encoder for cine CMR sequences is contrastively pretrained (InfoNCE) against a PubMed-pretrained BERT text encoder over 19,041 multi-institutional CMR studies. The frozen vision encoder transfers with strong performance to left-ventricular ejection-fraction regression (MAE 3.34% on a UK Biobank hold-out of ~4,259-45,623 participants) and detecting HFrEF (LVEF<40%, AUC 0.880), and the paper reports emergent zero-/few-shot performance across 39 cardiac and non-cardiac conditions including cardiac amyloidosis and hypertrophic cardiomyopathy. Code and pretrained MViT encoder weights are both released (Hugging Face, CC BY-NC 4.0).

Multimodal cardiac-sensing foundation model pretrained with generative masked pretraining on ECG, PPG, and paired clinical/machine-generated text reports from roughly 1.7 million individuals across three large-scale critical-care and outpatient ECG datasets. A channel-embedding scheme lets the same model accept any combination of 12-lead ECG, single-lead/wearable ECG, and PPG. The resulting embeddings transfer to diagnostic classification, demographic recognition, vital-sign measurement, clinical-outcome prediction, and ECG question answering. Pretrained weights require a signed academic-access agreement rather than an open download.

Multi-scale ECG-language pretraining model that aligns 12-lead ECG signals with clinical text reports at three granularities -- token, beat, and rhythm level -- rather than a single global embedding. First fine-tunes a cardiology-specialized text encoder to improve understanding of ECG report language, then trains an ECG-FM-initialized ECG encoder against it with hierarchical contrastive supervision. Outperforms prior ECG-language and self-supervised baselines including MERL, ST-MEM, and HeartLang on zero-shot classification, linear probing, and ECG report generation, with especially large gains at low label fractions. Developed at the University of Hong Kong (HKU-MedAI).

LoRA-adapted domain-specialized cardiology text embedding model built on MPNet-base (109M parameters), identified as Pareto-optimal for balanced accuracy/throughput deployment among 10 encoder- and decoder-style architectures benchmarked for cardiology semantic retrieval. LoRA fine-tuning on ~150,000 cardiology-textbook-derived sentence pairs raised its cardiology semantic-separation score from 0.175 (zero-shot) to 0.386, while delivering 228.8 embeddings/sec at a sub-1GB (0.73GB) memory footprint, making it suitable for consumer-GPU and general-purpose medical NLP deployment where full BioLinkBERT-level accuracy is not required.

ECG foundation model designed to remain accurate when leads are missing or signals are noisy. A 1D ConvNeXt V2 encoder is trained with a dual-mode self-distillation objective (separate lead-missing and noise "teachers") alongside contrastive alignment to detailed diagnostic-criteria text reports retrieved via a lightweight, LLM-free "Cardiac Feature Retrieval" module. Consistently ranks best or second-best across PTB-XL diagnostic tasks and MIT-BIH arrhythmia classification under original, noisy, lead-missing, and combined-corruption conditions. Developed by FPT Software AI Center and the University of Arkansas.

ECG foundation model built on the xLSTM (extended LSTM) architecture: a bidirectional stack of nine alternating scalar- and matrix-memory LSTM blocks that scales linearly with sequence length, unlike the quadratic cost of transformer-based ECG models. Pretrained with SimDINOv2, a coding-rate-regularized self-distillation (DINO) objective adapted from computer vision to ECG time series, on roughly 8 million recordings from CODE, INCART, and Chapman-Shaoxing-Ningbo. Introduced alongside BenchECG, a standardized 8-dataset/10-task benchmark, on which xECG achieves the best average rank of any publicly available ECG foundation model, with particular strength on long-context tasks (30-minute ambulatory arrhythmia classification, multi-hour sleep-apnea segmentation) where transformer-based models are computationally limited.

Single-lead ECG foundation model pretrained with clinically-guided contrastive learning: rather than relying on hand-labeled tasks, it uses routinely collected clinical metadata and risk scores from 161,000 MIMIC-IV-ECG patients as the training signal. Released in three sizes - Small (~448K parameters), Medium (30.7M), and Large (~296M) - and benchmarked against other ECG foundation models like ECGFounder across 18 tasks and 7 held-out datasets. Developed by Nokia Bell Labs.

Vision-language model that jointly embeds a cardiac MRI study, treated as video, with the impression section of its clinical report. Combines a video encoder over cine/LGE frame sequences with a Bio+ClinicalBERT text encoder using CLIP-style contrastive training. Supports zero-shot and few-shot classification of cardiomyopathies, amyloidosis, and LV dysfunction, plus image/report retrieval and structured report drafting. Trained on a private, single-institution corpus of roughly 11,000-14,000 CMR study-report pairs from Cleveland Clinic and Case Western.

Domain-specialized text embedding model for clinical cardiology, built by fine-tuning the Qwen3-Embedding-8B language model with LoRA adapters via contrastive learning on cardiology textbook sentences. Reaches 99.60% top-1 accuracy on cardiology-specific semantic retrieval, nearly 16 points above the prior MedTE baseline. The training corpus draws on roughly 150,000 sentences from seven copyrighted textbooks and is not public, though the resulting model weights are freely downloadable.

Multimodal ECG model that pairs a 1D ConvNeXtV2 signal encoder with a BioLinkBERT text encoder, trained with a joint contrastive-and-captioning objective using LLM-generated descriptions of ECG demographics and waveform patterns in place of raw clinical reports. Validated on arrhythmia diagnosis and ECG-based subject identification, reaching an AUROC of 0.938 fine-tuned and 0.812 zero-shot on PTB-XL diagnostic classification. Developed at Rice University.

Vision-language foundation model fine-tuned from CLIP on more than one million private echocardiogram video-report pairs, enabling zero-shot cardiac function assessment, device identification, and image/text retrieval without task-specific training. Combines a ConvNeXt-Base video encoder with a GPT-2-style text encoder under contrastive pretraining. Training data is private, but model weights and code are public. Developed by Cedars-Sinai's Ouyang lab.

General-purpose vision foundation model for echocardiography, pretrained with a masked autoencoder combined with a periodic contrastive loss designed around the cyclical nature of cardiac motion. Validated on chamber segmentation, view classification, and disease detection, with its largest advantage over non-pretrained baselines and natural-image models like SAM appearing in low-label settings. Pretrained on roughly 290,000 echo clips from a mix of internal and public sources. Developed by Massachusetts General Hospital and Harvard Medical School.

Echocardiography foundation model trained with a latent-predictive (V-JEPA2-style) self-supervised objective rather than pixel reconstruction, pretrained on 18 million echocardiograms from 300,000 patients drawn from the public MIMIC-IV-ECHO dataset plus a private multi-site archive - reportedly the largest echo pretraining corpus assembled to date. With a frozen backbone and only lightweight added layers, it outperforms prior echo foundation models by roughly 20% on ejection-fraction estimation and 17% on right-ventricular pressure estimation, reaches strong view-classification accuracy using just 1% of labels, and transfers zero-shot to pediatric echo better than fully fine-tuned baselines. Developed by the University of Toronto's Bo Wang Lab.

Vision-language foundation model that interprets an entire transthoracic echocardiogram study rather than a single view or video: it classifies the view type of every clip, applies view-informed attention across the full study, and generates or retrieves comprehensive study-level interpretations in English or Italian. Pretrained on a private Cedars-Sinai corpus of 12 million echo video-report pairs. Developed by the Smidt Heart Institute and Stanford's Ouyang lab.

Distills knowledge from EchoCLIP, a vision-language echocardiography model, into ECG embeddings, aiming to improve how well ECG signals alone can predict echo-derived measures of cardiac function. Combines a 1D ECG encoder with a BioBERT text encoder under a probabilistic cross-modal embedding objective that captures uncertainty. Published at MICCAI 2025 by the University of Toronto's McIntosh Lab.

Self-supervised ECG representation learned purely from patient identity: the model is trained so that ECGs from the same patient, recorded at different times, map to nearby points in latent space, with no other labels required. Linear models trained on these representations showed a 51% average performance gain over training from scratch across sex classification, age regression, LVH detection, and AF detection. Developed by the Broad Institute's ML4H group and trained on 3.2 million private ECGs from Massachusetts General Hospital; 12-lead, lead-I-only, and lead-II-only checkpoints are all released.

One of the first open foundation models for PPG signals, pretrained on over 57,000 hours (20 million segments) of publicly available data using a morphology-aware self-supervised objective. Evaluated across 20 tasks from 10 datasets spanning cardiovascular health, sleep disorders, pregnancy monitoring, and general wellbeing. Developed by Nokia Bell Labs and published at ICLR 2025.

Open-source PPG foundation model pretrained directly on real-world, field-collected wearable data rather than clean clinical signals alone, aiming for better generalization to the noise of free-living conditions. Uses a ResNet-based encoder trained with a relative contrastive (RelCon) self-supervised objective, and is directly benchmarked against PaPaGei. Developed at the University of Illinois Urbana-Champaign and published at UbiComp 2025.

Self-supervised ECG foundation model that adapts to varying lead combinations by patchifying 12-lead recordings across both space (leads) and time, then pretraining a ViT-B/75 encoder-decoder with a masked-autoencoder objective. Published at ICLR 2024 by VUNO Inc., and pretrained on the Chapman-Shaoxing-Ningbo dataset along with several other public 12-lead sources.