Multimodal ECG model that pairs a 1D ConvNeXtV2 signal encoder with a BioLinkBERT text encoder, trained with a joint contrastive-and-captioning objective using LLM-generated descriptions of ECG demographics and waveform patterns in place of raw clinical reports. Validated on arrhythmia diagnosis and ECG-based subject identification, reaching an AUROC of 0.938 fine-tuned and 0.812 zero-shot on PTB-XL diagnostic classification. Developed at Rice University.

Self-supervised ECG representation learned purely from patient identity: the model is trained so that ECGs from the same patient, recorded at different times, map to nearby points in latent space, with no other labels required. Linear models trained on these representations showed a 51% average performance gain over training from scratch across sex classification, age regression, LVH detection, and AF detection. Developed by the Broad Institute's ML4H group and trained on 3.2 million private ECGs from Massachusetts General Hospital; 12-lead, lead-I-only, and lead-II-only checkpoints are all released.