CVAI Catalog

·

View Catalog

tune

4 models found

·

4 public code

·

3 public weights

CMR-Transformer

Stanford University / University of Pennsylvania / UCSF / Georgetown (Shad, Zakka, Hiesinger et al.) · 2026

graph_1

Code & model weights public

Foundation vision-language model for cardiac MRI that learns pathophysiological visual representations directly from the natural-language radiology reports accompanying each scan, rather than from hand-labeled targets. A Multi-scale Vision Transformer (MViT, Kinetics-400-initialized) video encoder for cine CMR sequences is contrastively pretrained (InfoNCE) against a PubMed-pretrained BERT text encoder over 19,041 multi-institutional CMR studies. The frozen vision encoder transfers with strong performance to left-ventricular ejection-fraction regression (MAE 3.34% on a UK Biobank hold-out of ~4,259-45,623 participants) and detecting HFrEF (LVEF<40%, AUC 0.880), and the paper reports emergent zero-/few-shot performance across 39 cardiac and non-cardiac conditions including cardiac amyloidosis and hypertrophic cardiomyopathy. Code and pretrained MViT encoder weights are both released (Hugging Face, CC BY-NC 4.0).

Cardiac MRI

Filter by Modality:
Cardiac MRI

Clinical text

Filter by Modality:
Text & EHR

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

LVEF estimation

Filter by Disease / Trait:
Cardiac Function & Hemodynamics

Heart failure

Filter by Disease / Trait:
Cardiac Function & Hemodynamics

Embedding

Filter by Task Type:
Representation Learning

Regression

Filter by Task Type:
Regression

Binary classification

Filter by Task Type:
Classification

Hybrid

Filter by Architecture:
Hybrid / Multi-branch

PyTorch

Filter by Framework:
PyTorch

CC BY-NC 4.0

Filter by License:
Non-commercial / Research-only


Model ID: 0093

CSFM (Cardiac Sensing Foundation Model)

University of Oxford (Gu et al.) · 2026

code

Training code public

Multimodal cardiac-sensing foundation model pretrained with generative masked pretraining on ECG, PPG, and paired clinical/machine-generated text reports from roughly 1.7 million individuals across three large-scale critical-care and outpatient ECG datasets. A channel-embedding scheme lets the same model accept any combination of 12-lead ECG, single-lead/wearable ECG, and PPG. The resulting embeddings transfer to diagnostic classification, demographic recognition, vital-sign measurement, clinical-outcome prediction, and ECG question answering. Pretrained weights require a signed academic-access agreement rather than an open download.

12-lead ECG

Filter by Modality:
ECG

Single-lead ECG

Filter by Modality:
ECG

PPG / wearable

Filter by Modality:
PPG / Wearable

Clinical text

Filter by Modality:
Text & EHR

Multimodal

Filter by Modality:
Multimodal

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

Cardiac aging / biological age

Filter by Disease / Trait:
Prognosis & Aging

Embedding

Filter by Task Type:
Representation Learning

Regression

Filter by Task Type:
Regression

Transformer

Filter by Architecture:
Transformer

PyTorch

Filter by Framework:
PyTorch


Model ID: 0058

·

Subject Count: 161,352

ViTa

Technical University of Munich (Zhang, Hager, Pan et al.) · 2025

graph_1

Code & model weights public

Multimodal cardiac MRI foundation model that fuses 3D+T cine CMR (short-axis and long-axis views) with tabular patient health records (demographics, metabolic, and lifestyle factors) from 42,000 UK Biobank participants. Two-stage self-supervised pretraining -- masked-image reconstruction, then imaging-tabular contrastive alignment -- produces representations that transfer to whole-heart segmentation, cardiac phenotype/physiological-feature regression, and cardiac/metabolic disease classification within one unified framework.

Cardiac MRI

Filter by Modality:
Cardiac MRI

Structured EHR

Filter by Modality:
Text & EHR

Multimodal

Filter by Modality:
Multimodal

Cardiac chamber segmentation

Filter by Disease / Trait:
Structural Heart & Cardiomyopathy

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

Coronary artery disease / stenosis

Filter by Disease / Trait:
Coronary & Ischemic Disease

Segmentation

Filter by Task Type:
Segmentation & Detection

Regression

Filter by Task Type:
Regression

Binary classification

Filter by Task Type:
Classification

Hybrid

Filter by Architecture:
Hybrid / Multi-branch

PyTorch

Filter by Framework:
PyTorch

MIT

Filter by License:
Permissive


Model ID: 0062

·

Subject Count: 74,916

EchoCLIP

Cedars-Sinai Medical Center (Smidt Heart Institute) / Ouyang Lab · 2024

graph_1

Code & model weights public

Vision-language foundation model fine-tuned from CLIP on more than one million private echocardiogram video-report pairs, enabling zero-shot cardiac function assessment, device identification, and image/text retrieval without task-specific training. Combines a ConvNeXt-Base video encoder with a GPT-2-style text encoder under contrastive pretraining. Training data is private, but model weights and code are public. Developed by Cedars-Sinai's Ouyang lab.

Echocardiography video

Filter by Modality:
Echocardiography

Clinical text

Filter by Modality:
Text & EHR

Multimodal

Filter by Modality:
Multimodal

LVEF estimation

Filter by Disease / Trait:
Cardiac Function & Hemodynamics

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

Regression

Filter by Task Type:
Regression

Embedding

Filter by Task Type:
Representation Learning

Hybrid

Filter by Architecture:
Hybrid / Multi-branch

PyTorch

Filter by Framework:
PyTorch

Research use only

Filter by License:
Non-commercial / Research-only


Model ID: 0035