CVAI Catalog

·

View Catalog

MERL

Imperial College London (Liu et al.)

12-lead ECG

Filter catalog by Modality:
ECG

Clinical text

Filter catalog by Modality:
Text & EHR

Multimodal

Filter catalog by Modality:
Multimodal

General Purpose / Multi-task

Filter catalog by Disease / Trait:
General / Foundation

Multi-label classification

Filter catalog by Task Type:
Classification

Hybrid

Filter catalog by Architecture:
Hybrid / Multi-branch

PyTorch

Filter catalog by Framework:
PyTorch

MIT

Filter catalog by License:
Permissive

Multimodal model that learns a shared representation space for ECG signals and their clinical text reports, pretrained on paired MIMIC-IV-ECG recordings and reports. Supports zero-shot ECG classification via text prompts, tested across six public benchmark datasets including PTB-XL and CPSC2018 without any downstream training data. Developed at Imperial College London and published at ICML 2024.

memory Specifications

category

Architecture

Hybrid

ViT-tiny ECG signal encoder + Med-CPT text encoder, CLIP-style contrastive multimodal pretraining, with Clinical Knowledge Enhanced Prompt Engineering (CKEPE) for zero-shot inference

code

Framework

PyTorch

calendar_month

Added to catalog

2026-07-10

gavel License

MIT

check_small Open source check_small Commercial use OK check_small Modifications allowed Attribution required No share-alike requirement

License for model weights only. Associated code may be licensed seperately, check code source for specific terms.

description Publication

database Training & evaluation data

public 161,352 subjects · USA

800,035 12-lead ECG-report pairs from 161,352 subjects at Beth Israel Deaconess Medical Center.

science Capabilities & performance

Zero-shot classification (avg. across 6 datasets)

Multi-label classification General Purpose / Multi-task
0.752 AUROC 6 public ECG test sets (zero-shot) · external