Cedars-Sinai Medical Center (Smidt Heart Institute) / Ouyang Lab
Vision-language foundation model that interprets an entire transthoracic echocardiogram study rather than a single view or video: it classifies the view type of every clip, applies view-informed attention across the full study, and generates or retrieves comprehensive study-level interpretations in English or Italian. Pretrained on a private Cedars-Sinai corpus of 12 million echo video-report pairs. Developed by the Smidt Heart Institute and Stanford's Ouyang lab.
Architecture
Hybrid
Multi-video, view-informed vision-language model: per-view video encoders with contrastive text alignment, plus view-classification and anatomic-attention pooling across a full echocardiographic study
Framework
PyTorch
Added to catalog
2026-07-10
Research use only
License for model weights only. Associated code may be licensed seperately, check code source for specific terms.
Cedars-Sinai Echo Video-Report Corpus (EchoPrime)
12 million video-report pairs; unique patient count not stated in source paper
Study-level echocardiogram interpretation retrieved/generated from a view-informed embedding of the full study