Prototype-based neural network for interpretable, uncertainty-aware classification of aortic stenosis (AS) severity from B-mode echocardiography videos. Rather than a black-box prediction, ProtoASNet bases its output on similarity scores between the input video and a set of learned spatio-temporal prototypes (typically highlighting valve calcification and restricted leaflet motion), and uses an abstention loss to flag ambiguous/uncertain cases for expert review. Evaluated on a private clinical dataset and the public TMED-2 dataset, it achieved balanced accuracy of 80.0% (private) and 79.7% (TMED-2), improving to 82.4% when uncertain cases are excluded.

Pediatric-specific extension of EchoNet-Dynamic: a video-based deep learning model that segments the left ventricle and estimates ejection fraction (EF) from apical-4-chamber (A4C) and parasternal short-axis (PSAX) pediatric echocardiogram clips. Because adult-trained echo models generalize poorly to children (who vary widely in heart size, rate, and image quality), EchoNet-Peds was trained from scratch on a dedicated pediatric video dataset. It segments the LV with a Dice similarity coefficient of 0.89 in both views, estimates EF with a mean absolute error of 3.66%, and identifies pediatric systolic dysfunction with an AUC of 0.95, significantly outperforming an adult-trained model applied to the same pediatric data.

Automated deep learning workflow that detects and grades tricuspid regurgitation (TR) severity from full transthoracic echocardiography studies. The pipeline first identifies apical-4-chamber (A4C) video clips with color Doppler across the tricuspid valve from a full echo study, then applies a dedicated R(2+1)D video classifier to grade TR severity. Trained on over 2 million echo videos from 47,312 studies at Cedars-Sinai Medical Center and externally validated at Stanford Healthcare, the model identified color-Doppler A4C views with AUC ≥0.999 and detected clinically significant (moderate-or-severe) TR with AUC 0.951 and severe TR with AUC 0.980. Code and trained model weights are released to support prospective evaluation of AI-assisted TR screening.

Explainable machine learning model that detects and localizes left ventricular (LV) scar in hypertrophic cardiomyopathy (HCM) patients directly from 12-lead ECG, as a faster and cheaper alternative to late-gadolinium-enhancement (LGE) cardiac MRI, the clinical gold standard. XplainScar first uses an HCM-specific ECG segmentation algorithm to extract morphological features (duration, amplitude, slope, energy) from the QRS complex, ST segment and T wave of each lead, then combines unsupervised and self-supervised representation learning to predict scar presence and reveal which ECG features are associated with scar location (basal, mid, or apical LV). Trained on 500 HCM patients from the Johns Hopkins HCM Registry and validated on a held-out cohort of 248 HCM patients from UCSF, it reached 88% precision, 90% sensitivity, 78% specificity and an F1-score of 89% for scar detection on the external test set, analyzing a 10-patient batch of ECGs in under one minute.

Dual Bayesian ResNet model for heart murmur detection from multi-location phonocardiogram (PCG) recordings, developed for the George B. Moody PhysioNet Challenge 2022. Each patient's PCG recordings are segmented into overlapping log-mel spectrograms, which are passed through two Bayesian ResNet binary classifiers running simultaneously (present vs. unknown-or-absent, and unknown vs. present-or-absent); the two outputs are aggregated into a patient-level present/unknown/absent murmur classification. An optional second-stage XGBoost model integrates the DBRes output with demographic data and hand-crafted signal features. On the Challenge's official hidden test set, DBRes achieved a weighted accuracy of 0.771 for the murmur-detection task, placing 4th among all teams.

Video-based deep learning system for automated screening of rheumatic heart disease (RHD) from echocardiography, aimed at low-resource settings where RHD -- the most common acquired heart disease in children and young adults worldwide -- is endemic but echocardiography expertise is scarce. A 3D convolutional neural network (C3D) classifies each echo video clip, explicitly modeling temporal information across frames; a supervised meta-classifier then aggregates the per-video predictions from an exam (which may contain many video clips from different views) into a single exam-level RHD diagnosis. Evaluated on 11,646 echocardiography videos from 912 screening exams collected in underserved areas of Brazil and Uganda, the 3D C3D network significantly outperformed a comparison 2D CNN (VGG16) that ignores temporal information, and the learned aggregation model reached 72.77% exam-level diagnostic accuracy, exceeding simple majority voting across a patient's videos.

Heart murmur detection model combining spectrogram-derived deep features with hand-crafted peak-interval (PI) features extracted from phonocardiogram recordings, submitted to the George B. Moody PhysioNet Challenge 2022 (team CAU_UMN) and later extended into the 'SpectroHeart' method. Peak-to-peak interval sequences and their summary statistics are combined with spectrogram representations of the PCG signal, optionally alongside patient demographic data, to classify murmur presence across multiple auscultation locations. The team's Challenge submission placed 5th of all teams on the murmur-detection task.

Multimodal machine learning model that flags patients at risk of transthyretin amyloid cardiomyopathy (ATTR-CM) -- a progressive, underdiagnosed disease with expanding disease-modifying treatment options -- from routinely available ECG waveforms, echocardiographic measurements, demographics, and diagnosis codes for orthopedic manifestations of amyloidosis (e.g. carpal tunnel syndrome, spinal stenosis). Developed on 799 patients with 5-fold cross-validation (AUROC 0.85) and externally validated on 422 patients at a separate site (AUROC 0.82), with consistent accuracy across Hispanic, non-Hispanic Black, and non-Hispanic White patients. In a subsequent nonrandomized, single-system, multisite clinical trial (the Cardiac Amyloidosis Discovery Trial), patients flagged by ATTRACTnet and referred for confirmatory amyloid scintigraphy were positive for ATTR-CM 48% of the time, more than 2.8x the positivity rate of historical (15.3%) and contemporary (17.0%) controls referred by usual clinical judgment (P < .001 for both). This is a proprietary clinical AI program; no public code or model weights have been released.

Multi-instance contrastive self-supervised learning framework for echocardiography video representation learning: two distinct videos from the same patient exam are treated as positive pairs (rather than augmentations of a single clip), and a frame-reordering pretext task on temporally shuffled frames encourages the 3D-CNN backbone to learn temporally coherent representations. After self-supervised pretraining on unlabeled echocardiograms, the backbone is efficiently fine-tuned for cardiac disease classification (severe aortic stenosis, left ventricular hypertrophy) using very few labeled examples, outperforming SimCLR, standard multi-instance SimCLR, and Kinetics-400-initialized baselines across a range of training-data ratios.

Predicts cardiac MRI (CMR) tissue-characterization findings -- wall-motion abnormalities and myocardial scar -- directly from standard transthoracic echocardiography videos (A4C/A2C/PLAX views), using a factorized 3D R2+1D convolutional network. Trained and validated on a single-institution cohort of more than 1,400 patients with paired echo and CMR studies within 30 days of each other. Released weights and inference code cover the two binarized outcomes (wall motion, scar); the continuous CMR tissue markers (native T1, T2, ECV) evaluated in the paper are not part of the public release.

Ensemble of 3D convolutional neural networks that detects severe aortic stenosis directly from single-view 2D parasternal long-axis (PLAX) transthoracic echocardiogram videos, without requiring Doppler imaging. Representations are first pretrained with patient-level contrastive self-supervised learning on PLAX clips, then fine-tuned for binary AS classification; the ensemble is externally validated across a temporally-distinct cohort and geographically-distinct cohorts in California and New England. No pretrained weights are released; only the training/evaluation pipeline is public.

Multimodal cardiac MRI foundation model that fuses 3D+T cine CMR (short-axis and long-axis views) with tabular patient health records (demographics, metabolic, and lifestyle factors) from 42,000 UK Biobank participants. Two-stage self-supervised pretraining -- masked-image reconstruction, then imaging-tabular contrastive alignment -- produces representations that transfer to whole-heart segmentation, cardiac phenotype/physiological-feature regression, and cardiac/metabolic disease classification within one unified framework.

Foundation model that encodes single-lead (lead I) ECGs with information from paired transthoracic echocardiography reports, aimed at label-efficient screening for structural heart disease (SHD) on wearable and portable single-lead ECG devices. A 7-layer 1D-CNN ECG encoder and a RoBERTa-based text encoder are contrastively pretrained (CLIP-style) on 194,551 ECG-echo report pairs from 77,378 adults in the Yale New Haven Health System, then the ECG encoder is fine-tuned on a temporally-distinct cohort to detect reduced LVEF, diastolic dysfunction, and a composite SHD label. Matches a randomly-initialized CNN at full training-data volume but substantially outperforms it in label-scarce regimes (e.g. with only 0.5% of labeled data).

Video-based deep learning model that grades aortic regurgitation (AR) severity—none/trace, mild, moderate, or severe—from color Doppler echocardiography. View-specific R(2+1)D 3D-CNNs analyze five standard transthoracic views (PLAX, PLAX-AV, A3C, A3C-AV, A5C) and their outputs are combined by a maximum-severity rule at the study level. Trained on ~47,600 color Doppler videos from Cedars-Sinai and externally validated at Stanford Healthcare, reaching AUCs of 0.95 for at-least-moderate AR and 0.97 for severe AR internally. Developed by the Ouyang lab at Cedars-Sinai Medical Center.

Open-source pipeline that classifies aortic stenosis (AS) severity from transthoracic echocardiography by combining structural and functional information. Video-based R(2+1)D convolutional networks read six B-mode and color Doppler views while a segmentation model measures peak aortic-jet velocity, and an ensemble integrates these into a final severity prediction. Trained on 210,193 images from Kaiser Permanente Northern California and validated across held-out, temporally distinct, and external Stanford and Cedars-Sinai cohorts, reaching AUCs up to 0.96–0.99 for severe AS. Developed by the Ouyang lab.

Deep learning model for automated phenotyping of mitral stenosis (MS) from echocardiography. Uses video-based R(2+1)D convolutional networks on color Doppler and B-mode views to identify and grade mitral stenosis severity, following the multi-view valvular-assessment approach of the EchoNet family. Trained and validated on large clinical echocardiography cohorts from Kaiser Permanente Northern California with external testing at Stanford Healthcare and Cedars-Sinai. Developed by the Ouyang lab.

CNN-based image classifier that screens 12-lead ECG images for a signature of transthyretin amyloid cardiomyopathy (ATTR-CM), producing a study-level probability score. Trained on a private Yale New Haven Health System cohort of nuclear-imaging-confirmed ATTR-CM cases and matched controls. Used alongside a companion echocardiography model to track pre-clinical ATTR-CM progression years before it would otherwise be confirmed by nuclear amyloid imaging. Developed by Yale's CarDS Lab and distributed as a packaged research-use executable rather than downloadable weights.

EfficientNet-B3 CNN that detects hypertrophic cardiomyopathy directly from images of printed or scanned 12-lead ECGs, rather than from raw digital waveforms, enabling screening from a photo of a paper tracing. Initialized via self-supervised contrastive pretraining on patient identity, then fine-tuned at Yale New Haven Hospital on over 124,000 ECGs from about 67,000 patients, with HCM status confirmed by cardiac MRI or echocardiography. Externally validated on ECG images from MIMIC-IV, Amsterdam UMC, and UK Biobank. Developed by Yale's CarDS Lab.

Vision-language model that jointly embeds a cardiac MRI study, treated as video, with the impression section of its clinical report. Combines a video encoder over cine/LGE frame sequences with a Bio+ClinicalBERT text encoder using CLIP-style contrastive training. Supports zero-shot and few-shot classification of cardiomyopathies, amyloidosis, and LV dysfunction, plus image/report retrieval and structured report drafting. Trained on a private, single-institution corpus of roughly 11,000-14,000 CMR study-report pairs from Cleveland Clinic and Case Western.

Foundation model for cine cardiac MRI, self-supervised via masked autoencoding on nearly 75,000 UK Biobank scans. Uses a Vision Transformer with a convolutional stem, unified across long-axis and short-axis views. Fine-tuned checkpoints are released for ventricle and myocardium segmentation, ejection-fraction regression, cardiovascular disease classification, and landmark localization across several public benchmark datasets (ACDC, M&Ms, M&Ms2, EMIDEC, and others).

End-to-end pipeline for apical-4-chamber echocardiogram videos that segments the left ventricle, estimates ejection fraction on a beat-to-beat basis, and classifies cardiomyopathy with reduced ejection fraction. Combines a DeepLabV3-ResNet50 segmentation model with a 3D CNN (R2+1D/R3D/MC3) initialized on the Kinetics-400 video dataset. Trained on the public EchoNet-Dynamic dataset released alongside it, and one of the most widely reused open echocardiography models since its 2020 Nature publication. Developed by Stanford University.

Measures interventricular septum thickness, LV internal diameter, and posterior wall thickness from PLAX echocardiogram videos, then classifies the underlying cause of left ventricular hypertrophy as either cardiac amyloidosis or hypertrophic cardiomyopathy. Combines an atrous-convolution 2D CNN for wall-thickness segmentation with a 3D residual CNN for etiology classification. Trained on 28,201 videos across Stanford, Cedars-Sinai, and the Unity Imaging Collaborative. Developed by Stanford University.

Fully automated pipeline that scans a complete transthoracic echocardiogram study, identifies the apical-4-chamber color-Doppler clips showing the mitral valve, and grades mitral regurgitation severity at the study level. Combines a view/valve-presence classifier with a spatiotemporal CNN for severity classification. Trained on a private Cedars-Sinai cohort of 58,614 studies and externally validated on 915 studies from Stanford Healthcare.

Detects 12 categories of echocardiogram-confirmed structural heart disease from 12-lead ECG waveforms combined with demographic and clinical covariates. Uses the same architecture as the original, larger EchoNext model but is trained entirely on the public EchoNext-Mini dataset - 100,000 de-identified ECGs from Columbia University Irving Medical Center released on PhysioNet - making it one of the more fully reproducible models of its kind, with public weights, a Docker image, and inference code.

CLIP-style model that aligns 12-lead ECG signals with free-text echocardiography reports for zero-shot detection of structural heart disease directly from an ECG. Extends the MERL framework, and was trained on 45,016 paired ECG-echo reports from two Hong Kong hospitals, with external validation on the public EchoNext dataset from Columbia University. Developed by researchers at the University of Hong Kong and Imperial College London; described in a 2025 medRxiv preprint.

View-agnostic, multi-task model that performs 39 different echocardiographic reporting tasks - covering chamber size and function, valve disease, and more - from any combination of views, aggregating clip-level predictions up to the study level. Combines a ConvNeXt-Tiny frame encoder with a temporal Transformer and separate output heads per task. Trained on private Yale-New Haven Health System echo videos and published in JAMA in 2025 by Yale's CarDS Lab.