CVAI Catalog

·

View Catalog

tune

9 models found

·

9 public code

·

7 public weights

MMCL-ECG-CMR

Technical University of Munich / Imperial College London · 2025

graph_1

Code & model weights public

Deep learning strategy for cost-effective, comprehensive cardiac screening from ECG alone, by transferring domain-specific structural information from cardiac magnetic resonance (CMR) imaging into ECG representations. Combines multimodal contrastive learning with masked data modelling during pretraining on paired ECG-CMR data, then uses only ECG at inference. On 40,044 UK Biobank subjects, the multimodal pretraining improved subject-specific CVD risk prediction by up to 12.19% and cardiac phenotype prediction by up to 27.59% versus ECG-only baselines, with learned ECG representations shown to incorporate information from CMR regions of interest.

12-lead ECG

Filter by Modality:
ECG

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

Regression

Filter by Task Type:
Regression

Hybrid

Filter by Architecture:
Hybrid / Multi-branch

PyTorch

Filter by Framework:
PyTorch

MIT

Filter by License:
Permissive


Model ID: 0140

·

Subject Count: 40,044

code

Training code public

Self-supervised deep learning model that extracts cardiovascular-risk-relevant patterns from multimodal polysomnography (PSG) signals -- EEG, ECG, and respiratory signals -- without relying on manual sleep-stage annotations. Trained on 4,398 participants, the model derives 'projection scores' by contrasting embeddings from individuals with and without cardiovascular disease (CVD) outcomes. Externally validated in an independent cohort of 1,093 participants, ECG-derived projection scores were predictive of prevalent and incident cardiac conditions (particularly CVD mortality), and combining projection scores with the Framingham Risk Score consistently improved prediction (AUC 0.607-0.965 internally, 0.710-0.807 externally across most outcomes).

Single-lead ECG

Filter by Modality:
ECG

Multimodal

Filter by Modality:
Multimodal

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

Regression

Filter by Task Type:
Regression

Hybrid

Filter by Architecture:
Hybrid / Multi-branch

PyTorch

Filter by Framework:
PyTorch


Model ID: 0147

·

Subject Count: 4,398

AnyPPG

Peking University (PKUDigitalHealth) · 2025

graph_1

Code & model weights public

ECG-guided photoplethysmography (PPG) foundation model pretrained on over 100,000 hours of synchronized PPG-ECG recordings from 58,796 subjects across five clinical and wearable sources, using a CLIP-style contrastive alignment framework so the PPG encoder inherits physiologically grounded structure from paired ECG. Achieves state-of-the-art performance on 13 of 15 conventional physiological-analysis tasks across eight datasets, and shows meaningful discriminative capability (AUC >= 0.70) for 307 ICD-10-coded phenotypes across 16 phecode chapters, including many non-cardiovascular conditions.

PPG / wearable

Filter by Modality:
PPG / Wearable

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

Atrial fibrillation

Filter by Disease / Trait:
Arrhythmia

Blood pressure estimation

Filter by Disease / Trait:
Cardiac Function & Hemodynamics

Embedding

Filter by Task Type:
Representation Learning

Binary classification

Filter by Task Type:
Classification

Regression

Filter by Task Type:
Regression

CNN (1D)

Filter by Architecture:
Convolutional (CNN)

PyTorch

Filter by Framework:
PyTorch


Model ID: 0067

·

Subject Count: 58,796

CMR-Transformer

Stanford University / University of Pennsylvania / UCSF / Georgetown (Shad, Zakka, Hiesinger et al.) · 2026

graph_1

Code & model weights public

Foundation vision-language model for cardiac MRI that learns pathophysiological visual representations directly from the natural-language radiology reports accompanying each scan, rather than from hand-labeled targets. A Multi-scale Vision Transformer (MViT, Kinetics-400-initialized) video encoder for cine CMR sequences is contrastively pretrained (InfoNCE) against a PubMed-pretrained BERT text encoder over 19,041 multi-institutional CMR studies. The frozen vision encoder transfers with strong performance to left-ventricular ejection-fraction regression (MAE 3.34% on a UK Biobank hold-out of ~4,259-45,623 participants) and detecting HFrEF (LVEF<40%, AUC 0.880), and the paper reports emergent zero-/few-shot performance across 39 cardiac and non-cardiac conditions including cardiac amyloidosis and hypertrophic cardiomyopathy. Code and pretrained MViT encoder weights are both released (Hugging Face, CC BY-NC 4.0).

Cardiac MRI

Filter by Modality:
Cardiac MRI

Clinical text

Filter by Modality:
Text & EHR

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

LVEF estimation

Filter by Disease / Trait:
Cardiac Function & Hemodynamics

Heart failure

Filter by Disease / Trait:
Cardiac Function & Hemodynamics

Embedding

Filter by Task Type:
Representation Learning

Regression

Filter by Task Type:
Regression

Binary classification

Filter by Task Type:
Classification

Hybrid

Filter by Architecture:
Hybrid / Multi-branch

PyTorch

Filter by Framework:
PyTorch

CC BY-NC 4.0

Filter by License:
Non-commercial / Research-only


Model ID: 0093

CSFM (Cardiac Sensing Foundation Model)

University of Oxford (Gu et al.) · 2026

code

Training code public

Multimodal cardiac-sensing foundation model pretrained with generative masked pretraining on ECG, PPG, and paired clinical/machine-generated text reports from roughly 1.7 million individuals across three large-scale critical-care and outpatient ECG datasets. A channel-embedding scheme lets the same model accept any combination of 12-lead ECG, single-lead/wearable ECG, and PPG. The resulting embeddings transfer to diagnostic classification, demographic recognition, vital-sign measurement, clinical-outcome prediction, and ECG question answering. Pretrained weights require a signed academic-access agreement rather than an open download.

12-lead ECG

Filter by Modality:
ECG

Single-lead ECG

Filter by Modality:
ECG

PPG / wearable

Filter by Modality:
PPG / Wearable

Clinical text

Filter by Modality:
Text & EHR

Multimodal

Filter by Modality:
Multimodal

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

Cardiac aging / biological age

Filter by Disease / Trait:
Prognosis & Aging

Embedding

Filter by Task Type:
Representation Learning

Regression

Filter by Task Type:
Regression

Transformer

Filter by Architecture:
Transformer

PyTorch

Filter by Framework:
PyTorch


Model ID: 0058

·

Subject Count: 161,352

ViTa

Technical University of Munich (Zhang, Hager, Pan et al.) · 2025

graph_1

Code & model weights public

Multimodal cardiac MRI foundation model that fuses 3D+T cine CMR (short-axis and long-axis views) with tabular patient health records (demographics, metabolic, and lifestyle factors) from 42,000 UK Biobank participants. Two-stage self-supervised pretraining -- masked-image reconstruction, then imaging-tabular contrastive alignment -- produces representations that transfer to whole-heart segmentation, cardiac phenotype/physiological-feature regression, and cardiac/metabolic disease classification within one unified framework.

Cardiac MRI

Filter by Modality:
Cardiac MRI

Structured EHR

Filter by Modality:
Text & EHR

Multimodal

Filter by Modality:
Multimodal

Cardiac chamber segmentation

Filter by Disease / Trait:
Structural Heart & Cardiomyopathy

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

Coronary artery disease / stenosis

Filter by Disease / Trait:
Coronary & Ischemic Disease

Segmentation

Filter by Task Type:
Segmentation & Detection

Regression

Filter by Task Type:
Regression

Binary classification

Filter by Task Type:
Classification

Hybrid

Filter by Architecture:
Hybrid / Multi-branch

PyTorch

Filter by Framework:
PyTorch

MIT

Filter by License:
Permissive


Model ID: 0062

·

Subject Count: 74,916

CineMA

UCL / Mycardium (Fu et al.) · 2025

graph_1

Code & model weights public

Foundation model for cine cardiac MRI, self-supervised via masked autoencoding on nearly 75,000 UK Biobank scans. Uses a Vision Transformer with a convolutional stem, unified across long-axis and short-axis views. Fine-tuned checkpoints are released for ventricle and myocardium segmentation, ejection-fraction regression, cardiovascular disease classification, and landmark localization across several public benchmark datasets (ACDC, M&Ms, M&Ms2, EMIDEC, and others).

Cardiac MRI

Filter by Modality:
Cardiac MRI

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

Cardiac chamber segmentation

Filter by Disease / Trait:
Structural Heart & Cardiomyopathy

LVEF estimation

Filter by Disease / Trait:
Cardiac Function & Hemodynamics

Binary classification

Filter by Task Type:
Classification

Segmentation

Filter by Task Type:
Segmentation & Detection

Regression

Filter by Task Type:
Regression

Detection / localization

Filter by Task Type:
Segmentation & Detection

Vision Transformer

Filter by Architecture:
Transformer

PyTorch

Filter by Framework:
PyTorch

MIT

Filter by License:
Permissive


Model ID: 0003

·

Subject Count: 74,916

EchoCLIP

Cedars-Sinai Medical Center (Smidt Heart Institute) / Ouyang Lab · 2024

graph_1

Code & model weights public

Vision-language foundation model fine-tuned from CLIP on more than one million private echocardiogram video-report pairs, enabling zero-shot cardiac function assessment, device identification, and image/text retrieval without task-specific training. Combines a ConvNeXt-Base video encoder with a GPT-2-style text encoder under contrastive pretraining. Training data is private, but model weights and code are public. Developed by Cedars-Sinai's Ouyang lab.

Echocardiography video

Filter by Modality:
Echocardiography

Clinical text

Filter by Modality:
Text & EHR

Multimodal

Filter by Modality:
Multimodal

LVEF estimation

Filter by Disease / Trait:
Cardiac Function & Hemodynamics

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

Regression

Filter by Task Type:
Regression

Embedding

Filter by Task Type:
Representation Learning

Hybrid

Filter by Architecture:
Hybrid / Multi-branch

PyTorch

Filter by Framework:
PyTorch

Research use only

Filter by License:
Non-commercial / Research-only


Model ID: 0035

EchoJEPA

University of Toronto / Vector Institute (Bo Wang Lab) · ViT-L · 2026

graph_1

Code & model weights public

Echocardiography foundation model trained with a latent-predictive (V-JEPA2-style) self-supervised objective rather than pixel reconstruction, pretrained on 18 million echocardiograms from 300,000 patients drawn from the public MIMIC-IV-ECHO dataset plus a private multi-site archive - reportedly the largest echo pretraining corpus assembled to date. With a frozen backbone and only lightweight added layers, it outperforms prior echo foundation models by roughly 20% on ejection-fraction estimation and 17% on right-ventricular pressure estimation, reaches strong view-classification accuracy using just 1% of labels, and transfers zero-shot to pediatric echo better than fully fine-tuned baselines. Developed by the University of Toronto's Bo Wang Lab.

Echocardiography video

Filter by Modality:
Echocardiography

Echocardiographic view classification

Filter by Disease / Trait:
General / Foundation

LVEF estimation

Filter by Disease / Trait:
Cardiac Function & Hemodynamics

General Purpose / Multi-task

Filter by Disease / Trait:
General / Foundation

Multi-class classification

Filter by Task Type:
Classification

Regression

Filter by Task Type:
Regression

Embedding

Filter by Task Type:
Representation Learning

Vision Transformer

Filter by Architecture:
Transformer

PyTorch

Filter by Framework:
PyTorch

Apache 2.0

Filter by License:
Permissive


Model ID: 0038