CVAI Catalog

·

View Catalog

tune

8 models found

·

8 public code

·

8 public weights

CMR-Transformer

Stanford University / University of Pennsylvania / UCSF / Georgetown (Shad, Zakka, Hiesinger et al.) · 2026

graph_1

Code & model weights public

Foundation vision-language model for cardiac MRI that learns pathophysiological visual representations directly from the natural-language radiology reports accompanying each scan, rather than from hand-labeled targets. A Multi-scale Vision Transformer (MViT, Kinetics-400-initialized) video encoder for cine CMR sequences is contrastively pretrained (InfoNCE) against a PubMed-pretrained BERT text encoder over 19,041 multi-institutional CMR studies. The frozen vision encoder transfers with strong performance to left-ventricular ejection-fraction regression (MAE 3.34% on a UK Biobank hold-out of ~4,259-45,623 participants) and detecting HFrEF (LVEF<40%, AUC 0.880), and the paper reports emergent zero-/few-shot performance across 39 cardiac and non-cardiac conditions including cardiac amyloidosis and hypertrophic cardiomyopathy. Code and pretrained MViT encoder weights are both released (Hugging Face, CC BY-NC 4.0).

Cardiac MRI

Filter by Modality:
Cardiac MRI

Clinical text

Filter by Modality:
Text & EHR

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

LVEF estimation

Filter by Disease / Trait:
Cardiac Function & Hemodynamics

Heart failure

Filter by Disease / Trait:
Cardiac Function & Hemodynamics

Embedding

Filter by Task Type:
Representation Learning

Regression

Filter by Task Type:
Regression

Binary classification

Filter by Task Type:
Classification

Hybrid

Filter by Architecture:
Hybrid / Multi-branch

PyTorch

Filter by Framework:
PyTorch

CC BY-NC 4.0

Filter by License:
Non-commercial / Research-only


Model ID: 0093

TolerantECG

FPT Software AI Center / University of Arkansas (Nguyen et al.) · 2025

graph_1

Code & model weights public

ECG foundation model designed to remain accurate when leads are missing or signals are noisy. A 1D ConvNeXt V2 encoder is trained with a dual-mode self-distillation objective (separate lead-missing and noise "teachers") alongside contrastive alignment to detailed diagnostic-criteria text reports retrieved via a lightweight, LLM-free "Cardiac Feature Retrieval" module. Consistently ranks best or second-best across PTB-XL diagnostic tasks and MIT-BIH arrhythmia classification under original, noisy, lead-missing, and combined-corruption conditions. Developed by FPT Software AI Center and the University of Arkansas.

12-lead ECG

Filter by Modality:
ECG

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

Multi-label classification

Filter by Task Type:
Classification

Embedding

Filter by Task Type:
Representation Learning

CNN (1D)

Filter by Architecture:
Convolutional (CNN)

PyTorch

Filter by Framework:
PyTorch

CC BY-NC-SA 4.0

Filter by License:
Non-commercial / Research-only


Model ID: 0057

·

Subject Count: 180,237

EchoCLIP

Cedars-Sinai Medical Center (Smidt Heart Institute) / Ouyang Lab · 2024

graph_1

Code & model weights public

Vision-language foundation model fine-tuned from CLIP on more than one million private echocardiogram video-report pairs, enabling zero-shot cardiac function assessment, device identification, and image/text retrieval without task-specific training. Combines a ConvNeXt-Base video encoder with a GPT-2-style text encoder under contrastive pretraining. Training data is private, but model weights and code are public. Developed by Cedars-Sinai's Ouyang lab.

Echocardiography video

Filter by Modality:
Echocardiography

Clinical text

Filter by Modality:
Text & EHR

Multimodal

Filter by Modality:
Multimodal

LVEF estimation

Filter by Disease / Trait:
Cardiac Function & Hemodynamics

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

Regression

Filter by Task Type:
Regression

Embedding

Filter by Task Type:
Representation Learning

Hybrid

Filter by Architecture:
Hybrid / Multi-branch

PyTorch

Filter by Framework:
PyTorch

Research use only

Filter by License:
Non-commercial / Research-only


Model ID: 0035

EchoFM

Massachusetts General Hospital / Harvard Medical School (Kim et al.) · 2025

graph_1

Code & model weights public

General-purpose vision foundation model for echocardiography, pretrained with a masked autoencoder combined with a periodic contrastive loss designed around the cyclical nature of cardiac motion. Validated on chamber segmentation, view classification, and disease detection, with its largest advantage over non-pretrained baselines and natural-image models like SAM appearing in low-label settings. Pretrained on roughly 290,000 echo clips from a mix of internal and public sources. Developed by Massachusetts General Hospital and Harvard Medical School.

Echocardiography video

Filter by Modality:
Echocardiography

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

Embedding

Filter by Task Type:
Representation Learning

Vision Transformer

Filter by Architecture:
Transformer

PyTorch

Filter by Framework:
PyTorch

CC BY-NC-ND 4.0

Filter by License:
Non-commercial / Research-only


Model ID: 0037

·

Subject Count: 6,500

EchoPrime

Cedars-Sinai Medical Center (Smidt Heart Institute) / Ouyang Lab · 2024

graph_1

Code & model weights public

Vision-language foundation model that interprets an entire transthoracic echocardiogram study rather than a single view or video: it classifies the view type of every clip, applies view-informed attention across the full study, and generates or retrieves comprehensive study-level interpretations in English or Italian. Pretrained on a private Cedars-Sinai corpus of 12 million echo video-report pairs. Developed by the Smidt Heart Institute and Stanford's Ouyang lab.

Echocardiography video

Filter by Modality:
Echocardiography

Clinical text

Filter by Modality:
Text & EHR

Multimodal

Filter by Modality:
Multimodal

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

Retrieval

Filter by Task Type:
Representation Learning

Hybrid

Filter by Architecture:
Hybrid / Multi-branch

PyTorch

Filter by Framework:
PyTorch

Research use only

Filter by License:
Non-commercial / Research-only


Model ID: 0039

EchoingECG

University of Toronto (McIntosh Lab) · 2025

graph_1

Code & model weights public

Distills knowledge from EchoCLIP, a vision-language echocardiography model, into ECG embeddings, aiming to improve how well ECG signals alone can predict echo-derived measures of cardiac function. Combines a 1D ECG encoder with a BioBERT text encoder under a probabilistic cross-modal embedding objective that captures uncertainty. Published at MICCAI 2025 by the University of Toronto's McIntosh Lab.

12-lead ECG

Filter by Modality:
ECG

Clinical text

Filter by Modality:
Text & EHR

Multimodal

Filter by Modality:
Multimodal

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

Embedding

Filter by Task Type:
Representation Learning

Hybrid

Filter by Architecture:
Hybrid / Multi-branch

PyTorch

Filter by Framework:
PyTorch

CC BY-NC-ND 4.0

Filter by License:
Non-commercial / Research-only


Model ID: 0044

ST-MEM

VUNO Inc. · ViT-B/75 · 2024

graph_1

Code & model weights public

Self-supervised ECG foundation model that adapts to varying lead combinations by patchifying 12-lead recordings across both space (leads) and time, then pretraining a ViT-B/75 encoder-decoder with a masked-autoencoder objective. Published at ICLR 2024 by VUNO Inc., and pretrained on the Chapman-Shaoxing-Ningbo dataset along with several other public 12-lead sources.

12-lead ECG

Filter by Modality:
ECG

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

Embedding

Filter by Task Type:
Representation Learning

Vision Transformer

Filter by Architecture:
Transformer

PyTorch

Filter by Framework:
PyTorch

CC BY-NC 4.0

Filter by License:
Non-commercial / Research-only


Model ID: 0032

·

Subject Count: 45,152

TARGET-AI ECG-image ViT

Yale School of Medicine (CarDS Lab) · ecg-clip-beit-base-384 · 2025

graph_1

Code & model weights public

BEiT-base Vision Transformer that embeds images of standard 12-lead ECG printouts into a representation space, enabling zero-shot screening for structural heart disease by comparing a new ECG against reference case/control embedding centroids rather than requiring task-specific training. Trained on private Yale New Haven Health System ECG images and validated against the public EchoNext dataset. Aimed at scanned or legacy ECG images still common in EHR systems. Developed by Yale's CarDS Lab.

12-lead ECG image

Filter by Modality:
ECG

Structural heart disease (composite)

Filter by Disease / Trait:
Structural Heart & Cardiomyopathy

Embedding

Filter by Task Type:
Representation Learning

Vision Transformer

Filter by Architecture:
Transformer

PyTorch

Filter by Framework:
PyTorch

CC BY-NC 4.0

Filter by License:
Non-commercial / Research-only


Model ID: 0027

·

Subject Count: 159,322