Foundation vision-language model for cardiac MRI that learns pathophysiological visual representations directly from the natural-language radiology reports accompanying each scan, rather than from hand-labeled targets. A Multi-scale Vision Transformer (MViT, Kinetics-400-initialized) video encoder for cine CMR sequences is contrastively pretrained (InfoNCE) against a PubMed-pretrained BERT text encoder over 19,041 multi-institutional CMR studies. The frozen vision encoder transfers with strong performance to left-ventricular ejection-fraction regression (MAE 3.34% on a UK Biobank hold-out of ~4,259-45,623 participants) and detecting HFrEF (LVEF<40%, AUC 0.880), and the paper reports emergent zero-/few-shot performance across 39 cardiac and non-cardiac conditions including cardiac amyloidosis and hypertrophic cardiomyopathy. Code and pretrained MViT encoder weights are both released (Hugging Face, CC BY-NC 4.0).

Vision-language foundation model fine-tuned from CLIP on more than one million private echocardiogram video-report pairs, enabling zero-shot cardiac function assessment, device identification, and image/text retrieval without task-specific training. Combines a ConvNeXt-Base video encoder with a GPT-2-style text encoder under contrastive pretraining. Training data is private, but model weights and code are public. Developed by Cedars-Sinai's Ouyang lab.