Cross-modality cardiac image segmentation model that addresses spatial-temporal confounding -- where the anatomy and imaging-modality elements of cardiac images are intertwined across space and time. DCL performs multi-dimensional causal intervention, modeling causal relationships between images and labels as well as causality along the time and space dimensions, integrating historical optimal interventions to transfer knowledge across temporal contexts. A diffusion mechanism further keeps extracted anatomical elements causally invariant across modalities. On cross-modality cardiac images (MR, CT, and ultrasound), DCL achieved a mean Dice of 0.951, outperforming other advanced segmentation methods.

Reinforcement-learning-based unsupervised domain adaptation framework for spatio-temporal (2D+time) echocardiography segmentation, extending the authors' earlier RL4Seg work to full-length video sequences. RL4Seg3D uses a sliding-window approach supporting high-resolution, full-sized inputs, and fuses multiple reward mechanisms to improve segmentation reliability without requiring additional expert annotations in the target domain. Trained and evaluated on a large dataset of over 30,000 echocardiography videos, it outperforms baselines and foundation models on overall segmentation accuracy as well as echocardiography-specific metrics including anatomical/temporal validity and mitral-valve-commissure landmark precision, and supports test-time optimization via calibrated uncertainty estimates.

Pediatric-specific extension of EchoNet-Dynamic: a video-based deep learning model that segments the left ventricle and estimates ejection fraction (EF) from apical-4-chamber (A4C) and parasternal short-axis (PSAX) pediatric echocardiogram clips. Because adult-trained echo models generalize poorly to children (who vary widely in heart size, rate, and image quality), EchoNet-Peds was trained from scratch on a dedicated pediatric video dataset. It segments the LV with a Dice similarity coefficient of 0.89 in both views, estimates EF with a mean absolute error of 3.66%, and identifies pediatric systolic dysfunction with an AUC of 0.95, significantly outperforming an adult-trained model applied to the same pediatric data.

Automated deep learning workflow that detects and grades tricuspid regurgitation (TR) severity from full transthoracic echocardiography studies. The pipeline first identifies apical-4-chamber (A4C) video clips with color Doppler across the tricuspid valve from a full echo study, then applies a dedicated R(2+1)D video classifier to grade TR severity. Trained on over 2 million echo videos from 47,312 studies at Cedars-Sinai Medical Center and externally validated at Stanford Healthcare, the model identified color-Doppler A4C views with AUC ≥0.999 and detected clinically significant (moderate-or-severe) TR with AUC 0.951 and severe TR with AUC 0.980. Code and trained model weights are released to support prospective evaluation of AI-assisted TR screening.

The original U-Net baseline segmentation network introduced alongside the CAMUS (Cardiac Acquisitions for Multi-structure Ultrasound Segmentation) dataset, one of the largest fully open-access, expert-annotated 2D echocardiography benchmarks. The network segments the left ventricle endocardium (LVEndo), left ventricle epicardium/myocardium (LVEpi), and left atrium (LA) from apical 2-chamber and 4-chamber echo views at end-diastole (ED) and end-systole (ES). In the original ten-fold cross-validation benchmark comparing U-Net, U-Net++, Stacked Hourglass, Anatomically Constrained Neural Networks, and classical methods, the U-Net variant (18M parameters) achieved the best overall accuracy, reaching Dice scores of 0.939 (ED) / 0.916 (ES) for LVEndo and 0.954 (ED) / 0.945 (ES) for LVEpi, approaching inter-observer variability. A pretrained checkpoint of this baseline U-Net is distributed via the University of Sherbrooke's vitalab CASTOR project as part of a broader library for building anatomically-constrained cardiac segmentation pipelines.

Dual Bayesian ResNet model for heart murmur detection from multi-location phonocardiogram (PCG) recordings, developed for the George B. Moody PhysioNet Challenge 2022. Each patient's PCG recordings are segmented into overlapping log-mel spectrograms, which are passed through two Bayesian ResNet binary classifiers running simultaneously (present vs. unknown-or-absent, and unknown vs. present-or-absent); the two outputs are aggregated into a patient-level present/unknown/absent murmur classification. An optional second-stage XGBoost model integrates the DBRes output with demographic data and hand-crafted signal features. On the Challenge's official hidden test set, DBRes achieved a weighted accuracy of 0.771 for the murmur-detection task, placing 4th among all teams.

Deep learning framework, developed in collaboration with the MONAI community, for automatic segmentation of tricuspid valve leaflets from transthoracic 3D echocardiograms in children with hypoplastic left heart syndrome (HLHS) and other forms of single-ventricle congenital heart disease, integrated into 3D Slicer via MONAILabel for interactive clinical/research use. Addresses a modality (pediatric 3D echocardiography) and population (single-ventricle congenital heart disease) largely absent from adult-focused cardiac AI models.

Framework for training an echocardiography left-ventricle segmentation model purely by data-free knowledge distillation: a ConvLSTM-based student network learns to reproduce the masks produced by an EchoNet-Dynamic (DeepLabV3-ResNet50) teacher on entirely synthetic echo videos, with no real labeled data or even real videos required. Achieves state-of-the-art results identifying end-diastolic/end-systolic frames, reaching segmentation quality close to real-data training with substantially fewer weights; also introduces a human-annotation-free evaluation method using a large auxiliary model.

Predicts cardiac MRI (CMR) tissue-characterization findings -- wall-motion abnormalities and myocardial scar -- directly from standard transthoracic echocardiography videos (A4C/A2C/PLAX views), using a factorized 3D R2+1D convolutional network. Trained and validated on a single-institution cohort of more than 1,400 patients with paired echo and CMR studies within 30 days of each other. Released weights and inference code cover the two binarized outcomes (wall motion, scar); the continuous CMR tissue markers (native T1, T2, ECV) evaluated in the paper are not part of the public release.

Adapts the Segment Anything Model (SAM) to echocardiography video segmentation by giving it a space-time memory that carries both spatial and temporal cues, so that only the first frame of a video needs an external point prompt and every subsequent frame is segmented from a propagated memory prompt instead. A memory reinforcement mechanism uses each frame's predicted mask to suppress speckle-noise features before they are written back into memory, addressing a key failure mode of naively adapting video object segmentation (e.g. XMem) to noisy ultrasound. Built on SAMUS (an ultrasound-adapted SAM) with a frozen SAM backbone and only the image-encoder adapter layers trained. On the semi-supervised CAMUS and EchoNet-Dynamic benchmarks (only end-diastole/end-systole frames labeled), MemSAM reaches 93.3% and 92.8% mean Dice respectively, outperforming UNet, SwinUNet, H2Former, and prior medical-SAM adaptations (MedSAM, MSA, SAMed, SonoSAM, SAMUS) with far fewer prompts, and derives LVEF (via Simpson's biplane method of disks) with a Pearson correlation of 78.9% against ground truth on CAMUS. Training/inference code is public (MIT license); only the starting SAM ViT-B checkpoint is linked for download, not a separately released fine-tuned MemSAM checkpoint.

Self- and weakly-supervised pipeline for left-ventricle segmentation across the full cardiac cycle in apical-4-chamber echocardiography videos. A video segmentation network (2D super-image or 3D U-Net encoder) is first pretrained with a self-supervised temporal-masking objective on largely unannotated echo frames, then fine-tuned with weak supervision from the sparse end-diastole/end-systole frame labels that most echo datasets provide. Achieves 93.3% Dice on EchoNet-Dynamic, outperforming nnU-Net and non-SSL baselines, and generalizes to the external CAMUS dataset. Developed by the BioMedIA group at MBZUAI.

Multimodal cardiac MRI foundation model that fuses 3D+T cine CMR (short-axis and long-axis views) with tabular patient health records (demographics, metabolic, and lifestyle factors) from 42,000 UK Biobank participants. Two-stage self-supervised pretraining -- masked-image reconstruction, then imaging-tabular contrastive alignment -- produces representations that transfer to whole-heart segmentation, cardiac phenotype/physiological-feature regression, and cardiac/metabolic disease classification within one unified framework.

Foundation model that encodes single-lead (lead I) ECGs with information from paired transthoracic echocardiography reports, aimed at label-efficient screening for structural heart disease (SHD) on wearable and portable single-lead ECG devices. A 7-layer 1D-CNN ECG encoder and a RoBERTa-based text encoder are contrastively pretrained (CLIP-style) on 194,551 ECG-echo report pairs from 77,378 adults in the Yale New Haven Health System, then the ECG encoder is fine-tuned on a temporally-distinct cohort to detect reduced LVEF, diastolic dysfunction, and a composite SHD label. Matches a randomly-initialized CNN at full training-data volume but substantially outperforms it in label-scarce regimes (e.g. with only 0.5% of labeled data).

Video-based deep learning model that grades aortic regurgitation (AR) severity—none/trace, mild, moderate, or severe—from color Doppler echocardiography. View-specific R(2+1)D 3D-CNNs analyze five standard transthoracic views (PLAX, PLAX-AV, A3C, A3C-AV, A5C) and their outputs are combined by a maximum-severity rule at the study level. Trained on ~47,600 color Doppler videos from Cedars-Sinai and externally validated at Stanford Healthcare, reaching AUCs of 0.95 for at-least-moderate AR and 0.97 for severe AR internally. Developed by the Ouyang lab at Cedars-Sinai Medical Center.

Open-source pipeline that classifies aortic stenosis (AS) severity from transthoracic echocardiography by combining structural and functional information. Video-based R(2+1)D convolutional networks read six B-mode and color Doppler views while a segmentation model measures peak aortic-jet velocity, and an ensemble integrates these into a final severity prediction. Trained on 210,193 images from Kaiser Permanente Northern California and validated across held-out, temporally distinct, and external Stanford and Cedars-Sinai cohorts, reaching AUCs up to 0.96–0.99 for severe AS. Developed by the Ouyang lab.

Deep learning model for automated phenotyping of mitral stenosis (MS) from echocardiography. Uses video-based R(2+1)D convolutional networks on color Doppler and B-mode views to identify and grade mitral stenosis severity, following the multi-view valvular-assessment approach of the EchoNet family. Trained and validated on large clinical echocardiography cohorts from Kaiser Permanente Northern California with external testing at Stanford Healthcare and Cedars-Sinai. Developed by the Ouyang lab.

CNN-based image classifier that screens 12-lead ECG images for a signature of transthyretin amyloid cardiomyopathy (ATTR-CM), producing a study-level probability score. Trained on a private Yale New Haven Health System cohort of nuclear-imaging-confirmed ATTR-CM cases and matched controls. Used alongside a companion echocardiography model to track pre-clinical ATTR-CM progression years before it would otherwise be confirmed by nuclear amyloid imaging. Developed by Yale's CarDS Lab and distributed as a packaged research-use executable rather than downloadable weights.

EfficientNet-B3 CNN that detects hypertrophic cardiomyopathy directly from images of printed or scanned 12-lead ECGs, rather than from raw digital waveforms, enabling screening from a photo of a paper tracing. Initialized via self-supervised contrastive pretraining on patient identity, then fine-tuned at Yale New Haven Hospital on over 124,000 ECGs from about 67,000 patients, with HCM status confirmed by cardiac MRI or echocardiography. Externally validated on ECG images from MIMIC-IV, Amsterdam UMC, and UK Biobank. Developed by Yale's CarDS Lab.

Vision-language model that jointly embeds a cardiac MRI study, treated as video, with the impression section of its clinical report. Combines a video encoder over cine/LGE frame sequences with a Bio+ClinicalBERT text encoder using CLIP-style contrastive training. Supports zero-shot and few-shot classification of cardiomyopathies, amyloidosis, and LV dysfunction, plus image/report retrieval and structured report drafting. Trained on a private, single-institution corpus of roughly 11,000-14,000 CMR study-report pairs from Cleveland Clinic and Case Western.

Foundation model for cine cardiac MRI, self-supervised via masked autoencoding on nearly 75,000 UK Biobank scans. Uses a Vision Transformer with a convolutional stem, unified across long-axis and short-axis views. Fine-tuned checkpoints are released for ventricle and myocardium segmentation, ejection-fraction regression, cardiovascular disease classification, and landmark localization across several public benchmark datasets (ACDC, M&Ms, M&Ms2, EMIDEC, and others).

End-to-end pipeline for apical-4-chamber echocardiogram videos that segments the left ventricle, estimates ejection fraction on a beat-to-beat basis, and classifies cardiomyopathy with reduced ejection fraction. Combines a DeepLabV3-ResNet50 segmentation model with a 3D CNN (R2+1D/R3D/MC3) initialized on the Kinetics-400 video dataset. Trained on the public EchoNet-Dynamic dataset released alongside it, and one of the most widely reused open echocardiography models since its 2020 Nature publication. Developed by Stanford University.

Measures interventricular septum thickness, LV internal diameter, and posterior wall thickness from PLAX echocardiogram videos, then classifies the underlying cause of left ventricular hypertrophy as either cardiac amyloidosis or hypertrophic cardiomyopathy. Combines an atrous-convolution 2D CNN for wall-thickness segmentation with a 3D residual CNN for etiology classification. Trained on 28,201 videos across Stanford, Cedars-Sinai, and the Unity Imaging Collaborative. Developed by Stanford University.

Fully automated pipeline that scans a complete transthoracic echocardiogram study, identifies the apical-4-chamber color-Doppler clips showing the mitral valve, and grades mitral regurgitation severity at the study level. Combines a view/valve-presence classifier with a spatiotemporal CNN for severity classification. Trained on a private Cedars-Sinai cohort of 58,614 studies and externally validated on 915 studies from Stanford Healthcare.

Automates standard echocardiographic measurements from video, pairing a measurement model with a companion segmentation component. Developed by Stanford and Cedars-Sinai's Ouyang lab; public documentation on the exact measurements covered, training data, and validation performance is limited compared to other EchoNet-family models.

Detects 12 categories of echocardiogram-confirmed structural heart disease from 12-lead ECG waveforms combined with demographic and clinical covariates. Uses the same architecture as the original, larger EchoNext model but is trained entirely on the public EchoNext-Mini dataset - 100,000 de-identified ECGs from Columbia University Irving Medical Center released on PhysioNet - making it one of the more fully reproducible models of its kind, with public weights, a Docker image, and inference code.

Ensemble of ten self-configuring nnU-Net models (five 2D, five 3D) that segments the left ventricle, right ventricle, and myocardium from short-axis cardiac cine MRI. Won the 2020 M&Ms challenge, a multi-centre, multi-vendor, multi-disease benchmark spanning scanners from four vendors and three countries, demonstrating strong generalization across acquisition protocols. Developed by DKFZ, the group behind the widely used nnU-Net framework.

CLIP-style model that aligns 12-lead ECG signals with free-text echocardiography reports for zero-shot detection of structural heart disease directly from an ECG. Extends the MERL framework, and was trained on 45,016 paired ECG-echo reports from two Hong Kong hospitals, with external validation on the public EchoNext dataset from Columbia University. Developed by researchers at the University of Hong Kong and Imperial College London; described in a 2025 medRxiv preprint.

Two-stage pipeline that segments the left atrium and quantifies atrial scar tissue from 3D late-gadolinium-enhancement cardiac MRI, supporting atrial-fibrillation ablation planning. A Multi-Scale Weight Sharing network first delineates the atrial cavity, then a boundary-patch method segments scar tissue around the detected wall. Developed at Queen Mary University of London for the LAScarQS 2022 MICCAI/STACOM segmentation challenge.

View-agnostic, multi-task model that performs 39 different echocardiographic reporting tasks - covering chamber size and function, valve disease, and more - from any combination of views, aggregating clip-level predictions up to the study level. Combines a ConvNeXt-Tiny frame encoder with a temporal Transformer and separate output heads per task. Trained on private Yale-New Haven Health System echo videos and published in JAMA in 2025 by Yale's CarDS Lab.

BEiT-base Vision Transformer that embeds images of standard 12-lead ECG printouts into a representation space, enabling zero-shot screening for structural heart disease by comparing a new ECG against reference case/control embedding centroids rather than requiring task-specific training. Trained on private Yale New Haven Health System ECG images and validated against the public EchoNext dataset. Aimed at scanned or legacy ECG images still common in EHR systems. Developed by Yale's CarDS Lab.