CVAI Catalog

·

View Catalog

tune

4 models found

·

4 public code

·

4 public weights

CMR-Transformer

Stanford University / University of Pennsylvania / UCSF / Georgetown (Shad, Zakka, Hiesinger et al.) · 2026

graph_1

Code & model weights public

Foundation vision-language model for cardiac MRI that learns pathophysiological visual representations directly from the natural-language radiology reports accompanying each scan, rather than from hand-labeled targets. A Multi-scale Vision Transformer (MViT, Kinetics-400-initialized) video encoder for cine CMR sequences is contrastively pretrained (InfoNCE) against a PubMed-pretrained BERT text encoder over 19,041 multi-institutional CMR studies. The frozen vision encoder transfers with strong performance to left-ventricular ejection-fraction regression (MAE 3.34% on a UK Biobank hold-out of ~4,259-45,623 participants) and detecting HFrEF (LVEF<40%, AUC 0.880), and the paper reports emergent zero-/few-shot performance across 39 cardiac and non-cardiac conditions including cardiac amyloidosis and hypertrophic cardiomyopathy. Code and pretrained MViT encoder weights are both released (Hugging Face, CC BY-NC 4.0).

Cardiac MRI

Filter by Modality:
Cardiac MRI

Clinical text

Filter by Modality:
Text & EHR

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

LVEF estimation

Filter by Disease / Trait:
Cardiac Function & Hemodynamics

Heart failure

Filter by Disease / Trait:
Cardiac Function & Hemodynamics

Embedding

Filter by Task Type:
Representation Learning

Regression

Filter by Task Type:
Regression

Binary classification

Filter by Task Type:
Classification

Hybrid

Filter by Architecture:
Hybrid / Multi-branch

PyTorch

Filter by Framework:
PyTorch

CC BY-NC 4.0

Filter by License:
Non-commercial / Research-only


Model ID: 0093

ViTa

Technical University of Munich (Zhang, Hager, Pan et al.) · 2025

graph_1

Code & model weights public

Multimodal cardiac MRI foundation model that fuses 3D+T cine CMR (short-axis and long-axis views) with tabular patient health records (demographics, metabolic, and lifestyle factors) from 42,000 UK Biobank participants. Two-stage self-supervised pretraining -- masked-image reconstruction, then imaging-tabular contrastive alignment -- produces representations that transfer to whole-heart segmentation, cardiac phenotype/physiological-feature regression, and cardiac/metabolic disease classification within one unified framework.

Cardiac MRI

Filter by Modality:
Cardiac MRI

Structured EHR

Filter by Modality:
Text & EHR

Multimodal

Filter by Modality:
Multimodal

Cardiac chamber segmentation

Filter by Disease / Trait:
Structural Heart & Cardiomyopathy

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

Coronary artery disease / stenosis

Filter by Disease / Trait:
Coronary & Ischemic Disease

Segmentation

Filter by Task Type:
Segmentation & Detection

Regression

Filter by Task Type:
Regression

Binary classification

Filter by Task Type:
Classification

Hybrid

Filter by Architecture:
Hybrid / Multi-branch

PyTorch

Filter by Framework:
PyTorch

MIT

Filter by License:
Permissive


Model ID: 0062

·

Subject Count: 74,916

CMR-CLIP

Cleveland Clinic / Case Western (Nakashima et al.) · 2026

graph_1

Code & model weights public

Vision-language model that jointly embeds a cardiac MRI study, treated as video, with the impression section of its clinical report. Combines a video encoder over cine/LGE frame sequences with a Bio+ClinicalBERT text encoder using CLIP-style contrastive training. Supports zero-shot and few-shot classification of cardiomyopathies, amyloidosis, and LV dysfunction, plus image/report retrieval and structured report drafting. Trained on a private, single-institution corpus of roughly 11,000-14,000 CMR study-report pairs from Cleveland Clinic and Case Western.

Cardiac MRI

Filter by Modality:
Cardiac MRI

Clinical text

Filter by Modality:
Text & EHR

Multimodal

Filter by Modality:
Multimodal

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

Non-ischemic cardiomyopathy

Filter by Disease / Trait:
Structural Heart & Cardiomyopathy

Ischemic cardiomyopathy

Filter by Disease / Trait:
Coronary & Ischemic Disease

Cardiac amyloidosis

Filter by Disease / Trait:
Structural Heart & Cardiomyopathy

LV systolic dysfunction (LVSD)

Filter by Disease / Trait:
Cardiac Function & Hemodynamics

LV dilation

Filter by Disease / Trait:
Structural Heart & Cardiomyopathy

Left ventricular hypertrophy (LVH)

Filter by Disease / Trait:
Structural Heart & Cardiomyopathy

Multi-label classification

Filter by Task Type:
Classification

Binary classification

Filter by Task Type:
Classification

Embedding

Filter by Task Type:
Representation Learning

Hybrid

Filter by Architecture:
Hybrid / Multi-branch

PyTorch

Filter by Framework:
PyTorch

MIT

Filter by License:
Permissive


Model ID: 0007

·

Subject Count: 12,500

CineMA

UCL / Mycardium (Fu et al.) · 2025

graph_1

Code & model weights public

Foundation model for cine cardiac MRI, self-supervised via masked autoencoding on nearly 75,000 UK Biobank scans. Uses a Vision Transformer with a convolutional stem, unified across long-axis and short-axis views. Fine-tuned checkpoints are released for ventricle and myocardium segmentation, ejection-fraction regression, cardiovascular disease classification, and landmark localization across several public benchmark datasets (ACDC, M&Ms, M&Ms2, EMIDEC, and others).

Cardiac MRI

Filter by Modality:
Cardiac MRI

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

Cardiac chamber segmentation

Filter by Disease / Trait:
Structural Heart & Cardiomyopathy

LVEF estimation

Filter by Disease / Trait:
Cardiac Function & Hemodynamics

Binary classification

Filter by Task Type:
Classification

Segmentation

Filter by Task Type:
Segmentation & Detection

Regression

Filter by Task Type:
Regression

Detection / localization

Filter by Task Type:
Segmentation & Detection

Vision Transformer

Filter by Architecture:
Transformer

PyTorch

Filter by Framework:
PyTorch

MIT

Filter by License:
Permissive


Model ID: 0003

·

Subject Count: 74,916