CVAI Catalog

·

View Catalog

tune

1 model found

·

1 public code

·

1 public weights

CMR-Transformer

Stanford University / University of Pennsylvania / UCSF / Georgetown (Shad, Zakka, Hiesinger et al.) · 2026

graph_1

Code & model weights public

Foundation vision-language model for cardiac MRI that learns pathophysiological visual representations directly from the natural-language radiology reports accompanying each scan, rather than from hand-labeled targets. A Multi-scale Vision Transformer (MViT, Kinetics-400-initialized) video encoder for cine CMR sequences is contrastively pretrained (InfoNCE) against a PubMed-pretrained BERT text encoder over 19,041 multi-institutional CMR studies. The frozen vision encoder transfers with strong performance to left-ventricular ejection-fraction regression (MAE 3.34% on a UK Biobank hold-out of ~4,259-45,623 participants) and detecting HFrEF (LVEF<40%, AUC 0.880), and the paper reports emergent zero-/few-shot performance across 39 cardiac and non-cardiac conditions including cardiac amyloidosis and hypertrophic cardiomyopathy. Code and pretrained MViT encoder weights are both released (Hugging Face, CC BY-NC 4.0).

Cardiac MRI

Filter by Modality:
Cardiac MRI

Clinical text

Filter by Modality:
Text & EHR

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

LVEF estimation

Filter by Disease / Trait:
Cardiac Function & Hemodynamics

Heart failure

Filter by Disease / Trait:
Cardiac Function & Hemodynamics

Embedding

Filter by Task Type:
Representation Learning

Regression

Filter by Task Type:
Regression

Binary classification

Filter by Task Type:
Classification

Hybrid

Filter by Architecture:
Hybrid / Multi-branch

PyTorch

Filter by Framework:
PyTorch

CC BY-NC 4.0

Filter by License:
Non-commercial / Research-only


Model ID: 0093