Self-supervised ECG embedding model inspired by BERT/RoBERTa from natural language processing, designed for efficient medical signal analysis. HeartBERT translates ECG signals into an intermediate synthetic 'language' via signal quantization and discretization (Lloyd-Max quantization), then trains a RoBERTa-style encoder from scratch on this text-like representation using the MIT-BIH Arrhythmia Database, PTB-XL, and European ST-T Database. The resulting embeddings are evaluated on two downstream tasks -- sleep-stage classification and heartbeat classification -- using bidirectional LSTM heads, showing particular strength when only small labeled training datasets are available.

Self-supervised representation-learning method for 12-lead ECG signals, designed to reduce reliance on large labeled datasets for downstream ECG classification. TSSL exploits two structural properties of ECG data: temporally, it encourages stable representations for the same individual across time while keeping different leads distinguishable; spatially, it enforces consistency in the relationships between signals and their representations across the different leads of a single recording. Evaluated on three public ECG datasets (CPSC2018, Chapman, PTB-XL), TSSL-pretrained models approached the performance of fully supervised training while using only about 10% of the labeled data.

Foundation vision-language model for cardiac MRI that learns pathophysiological visual representations directly from the natural-language radiology reports accompanying each scan, rather than from hand-labeled targets. A Multi-scale Vision Transformer (MViT, Kinetics-400-initialized) video encoder for cine CMR sequences is contrastively pretrained (InfoNCE) against a PubMed-pretrained BERT text encoder over 19,041 multi-institutional CMR studies. The frozen vision encoder transfers with strong performance to left-ventricular ejection-fraction regression (MAE 3.34% on a UK Biobank hold-out of ~4,259-45,623 participants) and detecting HFrEF (LVEF<40%, AUC 0.880), and the paper reports emergent zero-/few-shot performance across 39 cardiac and non-cardiac conditions including cardiac amyloidosis and hypertrophic cardiomyopathy. Code and pretrained MViT encoder weights are both released (Hugging Face, CC BY-NC 4.0).

Multi-scale ECG-language pretraining model that aligns 12-lead ECG signals with clinical text reports at three granularities -- token, beat, and rhythm level -- rather than a single global embedding. First fine-tunes a cardiology-specialized text encoder to improve understanding of ECG report language, then trains an ECG-FM-initialized ECG encoder against it with hierarchical contrastive supervision. Outperforms prior ECG-language and self-supervised baselines including MERL, ST-MEM, and HeartLang on zero-shot classification, linear probing, and ECG report generation, with especially large gains at low label fractions. Developed at the University of Hong Kong (HKU-MedAI).

Vision-language model that jointly embeds a cardiac MRI study, treated as video, with the impression section of its clinical report. Combines a video encoder over cine/LGE frame sequences with a Bio+ClinicalBERT text encoder using CLIP-style contrastive training. Supports zero-shot and few-shot classification of cardiomyopathies, amyloidosis, and LV dysfunction, plus image/report retrieval and structured report drafting. Trained on a private, single-institution corpus of roughly 11,000-14,000 CMR study-report pairs from Cleveland Clinic and Case Western.

Multimodal ECG model that pairs a 1D ConvNeXtV2 signal encoder with a BioLinkBERT text encoder, trained with a joint contrastive-and-captioning objective using LLM-generated descriptions of ECG demographics and waveform patterns in place of raw clinical reports. Validated on arrhythmia diagnosis and ECG-based subject identification, reaching an AUROC of 0.938 fine-tuned and 0.812 zero-shot on PTB-XL diagnostic classification. Developed at Rice University.

Vision-language foundation model fine-tuned from CLIP on more than one million private echocardiogram video-report pairs, enabling zero-shot cardiac function assessment, device identification, and image/text retrieval without task-specific training. Combines a ConvNeXt-Base video encoder with a GPT-2-style text encoder under contrastive pretraining. Training data is private, but model weights and code are public. Developed by Cedars-Sinai's Ouyang lab.

Vision-language foundation model that interprets an entire transthoracic echocardiogram study rather than a single view or video: it classifies the view type of every clip, applies view-informed attention across the full study, and generates or retrieves comprehensive study-level interpretations in English or Italian. Pretrained on a private Cedars-Sinai corpus of 12 million echo video-report pairs. Developed by the Smidt Heart Institute and Stanford's Ouyang lab.

Distills knowledge from EchoCLIP, a vision-language echocardiography model, into ECG embeddings, aiming to improve how well ECG signals alone can predict echo-derived measures of cardiac function. Combines a 1D ECG encoder with a BioBERT text encoder under a probabilistic cross-modal embedding objective that captures uncertainty. Published at MICCAI 2025 by the University of Toronto's McIntosh Lab.