Cross-modality cardiac image segmentation model that addresses spatial-temporal confounding -- where the anatomy and imaging-modality elements of cardiac images are intertwined across space and time. DCL performs multi-dimensional causal intervention, modeling causal relationships between images and labels as well as causality along the time and space dimensions, integrating historical optimal interventions to transfer knowledge across temporal contexts. A diffusion mechanism further keeps extracted anatomical elements causally invariant across modalities. On cross-modality cardiac images (MR, CT, and ultrasound), DCL achieved a mean Dice of 0.951, outperforming other advanced segmentation methods.

3D convolutional autoencoder that filters reverberation clutter artifacts from transthoracic echocardiography (TTE) video sequences, improving downstream measurements such as speckle-tracking strain. Built on a 3D U-Net-style encoder-decoder with an input-output skip connection to preserve fine structures and attention-gate modules to focus on cluttered regions, the network was trained on synthetic clutter simulated across six ultrasound vendors and generalized well to real in vivo artifactual sequences, substantially reducing the discrepancy between cluttered and clutter-free strain profiles while running in a fraction of a second per sequence.

Supervised contrastive learning framework for robust, fine-grained echocardiographic view classification across 47 clinically meaningful view types (rather than collapsing views into a few broad categories, as most prior work does). Introduces TTE47, the first publicly available benchmark with 47 fine-grained views independently annotated by three experts, enabling rigorous quantification of inter-observer agreement. A tailored contrastive loss produces a feature space that aligns more strongly with underlying anatomy than with any single annotator's labeling style, and the model outperforms cross-entropy and standard supervised-contrastive baselines on both TTE47 and the public TMED-2 benchmark (the latter without dataset-specific pretraining).

Prototype-based neural network for interpretable, uncertainty-aware classification of aortic stenosis (AS) severity from B-mode echocardiography videos. Rather than a black-box prediction, ProtoASNet bases its output on similarity scores between the input video and a set of learned spatio-temporal prototypes (typically highlighting valve calcification and restricted leaflet motion), and uses an abstention loss to flag ambiguous/uncertain cases for expert review. Evaluated on a private clinical dataset and the public TMED-2 dataset, it achieved balanced accuracy of 80.0% (private) and 79.7% (TMED-2), improving to 82.4% when uncertain cases are excluded.

Reinforcement-learning-based unsupervised domain adaptation framework for spatio-temporal (2D+time) echocardiography segmentation, extending the authors' earlier RL4Seg work to full-length video sequences. RL4Seg3D uses a sliding-window approach supporting high-resolution, full-sized inputs, and fuses multiple reward mechanisms to improve segmentation reliability without requiring additional expert annotations in the target domain. Trained and evaluated on a large dataset of over 30,000 echocardiography videos, it outperforms baselines and foundation models on overall segmentation accuracy as well as echocardiography-specific metrics including anatomical/temporal validity and mitral-valve-commissure landmark precision, and supports test-time optimization via calibrated uncertainty estimates.

Open-source, vendor-agnostic deep learning pipeline that retrospectively measures left ventricular global longitudinal strain (GLS) from routine apical-4-chamber echocardiography B-mode video, without requiring speckle-tracking software or manual tracing. The pipeline reuses EchoNet-Dynamic's LV semantic-segmentation network to trace the LV endocardial border frame-by-frame, then measures the frame-to-frame change in traced myocardial length across the cardiac cycle to derive GLS. In external validation against a large 3D-echocardiography-derived GLS dataset and a prospective two-sonographer, two-vendor repeated-measures study, the automated strain measurement showed lower inter- and intra-measurement variability than human readers and moderate agreement with reference speckle-tracking strain (ICC 0.58), while being robust to image-quality differences and vendor.

Pediatric-specific extension of EchoNet-Dynamic: a video-based deep learning model that segments the left ventricle and estimates ejection fraction (EF) from apical-4-chamber (A4C) and parasternal short-axis (PSAX) pediatric echocardiogram clips. Because adult-trained echo models generalize poorly to children (who vary widely in heart size, rate, and image quality), EchoNet-Peds was trained from scratch on a dedicated pediatric video dataset. It segments the LV with a Dice similarity coefficient of 0.89 in both views, estimates EF with a mean absolute error of 3.66%, and identifies pediatric systolic dysfunction with an AUC of 0.95, significantly outperforming an adult-trained model applied to the same pediatric data.

Automated deep learning workflow that detects and grades tricuspid regurgitation (TR) severity from full transthoracic echocardiography studies. The pipeline first identifies apical-4-chamber (A4C) video clips with color Doppler across the tricuspid valve from a full echo study, then applies a dedicated R(2+1)D video classifier to grade TR severity. Trained on over 2 million echo videos from 47,312 studies at Cedars-Sinai Medical Center and externally validated at Stanford Healthcare, the model identified color-Doppler A4C views with AUC ≥0.999 and detected clinically significant (moderate-or-severe) TR with AUC 0.951 and severe TR with AUC 0.980. Code and trained model weights are released to support prospective evaluation of AI-assisted TR screening.

Open, transparent deep-learning method for measuring left ventricular global longitudinal strain (GLS) from routine 2D echocardiography, built as an alternative to proprietary vendor strain software. Unity-GLS is a multi-image neural network (based on the HigherHRNet-W32 pose-estimation architecture) that identifies the mitral annulus, LV apex, and endocardial curve from a target frame plus six neighbouring frames, across apical 4-, 3-, and 2-chamber views. Validated against multi-expert (11-reader) consensus tracings from 100 echocardiograms in a UK-wide collaborative, Unity-GLS agreed with expert consensus as strongly as individual human experts and two proprietary vendor packages (correlation with consensus: 0.91 vs. 0.73-0.85 for other methods).

The original U-Net baseline segmentation network introduced alongside the CAMUS (Cardiac Acquisitions for Multi-structure Ultrasound Segmentation) dataset, one of the largest fully open-access, expert-annotated 2D echocardiography benchmarks. The network segments the left ventricle endocardium (LVEndo), left ventricle epicardium/myocardium (LVEpi), and left atrium (LA) from apical 2-chamber and 4-chamber echo views at end-diastole (ED) and end-systole (ES). In the original ten-fold cross-validation benchmark comparing U-Net, U-Net++, Stacked Hourglass, Anatomically Constrained Neural Networks, and classical methods, the U-Net variant (18M parameters) achieved the best overall accuracy, reaching Dice scores of 0.939 (ED) / 0.916 (ES) for LVEndo and 0.954 (ED) / 0.945 (ES) for LVEpi, approaching inter-observer variability. A pretrained checkpoint of this baseline U-Net is distributed via the University of Sherbrooke's vitalab CASTOR project as part of a broader library for building anatomically-constrained cardiac segmentation pipelines.

Video-based deep learning system for automated screening of rheumatic heart disease (RHD) from echocardiography, aimed at low-resource settings where RHD -- the most common acquired heart disease in children and young adults worldwide -- is endemic but echocardiography expertise is scarce. A 3D convolutional neural network (C3D) classifies each echo video clip, explicitly modeling temporal information across frames; a supervised meta-classifier then aggregates the per-video predictions from an exam (which may contain many video clips from different views) into a single exam-level RHD diagnosis. Evaluated on 11,646 echocardiography videos from 912 screening exams collected in underserved areas of Brazil and Uganda, the 3D C3D network significantly outperformed a comparison 2D CNN (VGG16) that ignores temporal information, and the learned aggregation model reached 72.77% exam-level diagnostic accuracy, exceeding simple majority voting across a patient's videos.

Multimodal machine learning model that flags patients at risk of transthyretin amyloid cardiomyopathy (ATTR-CM) -- a progressive, underdiagnosed disease with expanding disease-modifying treatment options -- from routinely available ECG waveforms, echocardiographic measurements, demographics, and diagnosis codes for orthopedic manifestations of amyloidosis (e.g. carpal tunnel syndrome, spinal stenosis). Developed on 799 patients with 5-fold cross-validation (AUROC 0.85) and externally validated on 422 patients at a separate site (AUROC 0.82), with consistent accuracy across Hispanic, non-Hispanic Black, and non-Hispanic White patients. In a subsequent nonrandomized, single-system, multisite clinical trial (the Cardiac Amyloidosis Discovery Trial), patients flagged by ATTRACTnet and referred for confirmatory amyloid scintigraphy were positive for ATTR-CM 48% of the time, more than 2.8x the positivity rate of historical (15.3%) and contemporary (17.0%) controls referred by usual clinical judgment (P < .001 for both). This is a proprietary clinical AI program; no public code or model weights have been released.

Deep learning framework, developed in collaboration with the MONAI community, for automatic segmentation of tricuspid valve leaflets from transthoracic 3D echocardiograms in children with hypoplastic left heart syndrome (HLHS) and other forms of single-ventricle congenital heart disease, integrated into 3D Slicer via MONAILabel for interactive clinical/research use. Addresses a modality (pediatric 3D echocardiography) and population (single-ventricle congenital heart disease) largely absent from adult-focused cardiac AI models.

Multi-instance contrastive self-supervised learning framework for echocardiography video representation learning: two distinct videos from the same patient exam are treated as positive pairs (rather than augmentations of a single clip), and a frame-reordering pretext task on temporally shuffled frames encourages the 3D-CNN backbone to learn temporally coherent representations. After self-supervised pretraining on unlabeled echocardiograms, the backbone is efficiently fine-tuned for cardiac disease classification (severe aortic stenosis, left ventricular hypertrophy) using very few labeled examples, outperforming SimCLR, standard multi-instance SimCLR, and Kinetics-400-initialized baselines across a range of training-data ratios.

Framework for training an echocardiography left-ventricle segmentation model purely by data-free knowledge distillation: a ConvLSTM-based student network learns to reproduce the masks produced by an EchoNet-Dynamic (DeepLabV3-ResNet50) teacher on entirely synthetic echo videos, with no real labeled data or even real videos required. Achieves state-of-the-art results identifying end-diastolic/end-systolic frames, reaching segmentation quality close to real-data training with substantially fewer weights; also introduces a human-annotation-free evaluation method using a large auxiliary model.

Predicts cardiac MRI (CMR) tissue-characterization findings -- wall-motion abnormalities and myocardial scar -- directly from standard transthoracic echocardiography videos (A4C/A2C/PLAX views), using a factorized 3D R2+1D convolutional network. Trained and validated on a single-institution cohort of more than 1,400 patients with paired echo and CMR studies within 30 days of each other. Released weights and inference code cover the two binarized outcomes (wall motion, scar); the continuous CMR tissue markers (native T1, T2, ECV) evaluated in the paper are not part of the public release.

Adapts the Segment Anything Model (SAM) to echocardiography video segmentation by giving it a space-time memory that carries both spatial and temporal cues, so that only the first frame of a video needs an external point prompt and every subsequent frame is segmented from a propagated memory prompt instead. A memory reinforcement mechanism uses each frame's predicted mask to suppress speckle-noise features before they are written back into memory, addressing a key failure mode of naively adapting video object segmentation (e.g. XMem) to noisy ultrasound. Built on SAMUS (an ultrasound-adapted SAM) with a frozen SAM backbone and only the image-encoder adapter layers trained. On the semi-supervised CAMUS and EchoNet-Dynamic benchmarks (only end-diastole/end-systole frames labeled), MemSAM reaches 93.3% and 92.8% mean Dice respectively, outperforming UNet, SwinUNet, H2Former, and prior medical-SAM adaptations (MedSAM, MSA, SAMed, SonoSAM, SAMUS) with far fewer prompts, and derives LVEF (via Simpson's biplane method of disks) with a Pearson correlation of 78.9% against ground truth on CAMUS. Training/inference code is public (MIT license); only the starting SAM ViT-B checkpoint is linked for download, not a separately released fine-tuned MemSAM checkpoint.

Ensemble of 3D convolutional neural networks that detects severe aortic stenosis directly from single-view 2D parasternal long-axis (PLAX) transthoracic echocardiogram videos, without requiring Doppler imaging. Representations are first pretrained with patient-level contrastive self-supervised learning on PLAX clips, then fine-tuned for binary AS classification; the ensemble is externally validated across a temporally-distinct cohort and geographically-distinct cohorts in California and New England. No pretrained weights are released; only the training/evaluation pipeline is public.

Self- and weakly-supervised pipeline for left-ventricle segmentation across the full cardiac cycle in apical-4-chamber echocardiography videos. A video segmentation network (2D super-image or 3D U-Net encoder) is first pretrained with a self-supervised temporal-masking objective on largely unannotated echo frames, then fine-tuned with weak supervision from the sparse end-diastole/end-systole frame labels that most echo datasets provide. Achieves 93.3% Dice on EchoNet-Dynamic, outperforming nnU-Net and non-SSL baselines, and generalizes to the external CAMUS dataset. Developed by the BioMedIA group at MBZUAI.

Video-based deep learning model that grades aortic regurgitation (AR) severity—none/trace, mild, moderate, or severe—from color Doppler echocardiography. View-specific R(2+1)D 3D-CNNs analyze five standard transthoracic views (PLAX, PLAX-AV, A3C, A3C-AV, A5C) and their outputs are combined by a maximum-severity rule at the study level. Trained on ~47,600 color Doppler videos from Cedars-Sinai and externally validated at Stanford Healthcare, reaching AUCs of 0.95 for at-least-moderate AR and 0.97 for severe AR internally. Developed by the Ouyang lab at Cedars-Sinai Medical Center.

Open-source pipeline that classifies aortic stenosis (AS) severity from transthoracic echocardiography by combining structural and functional information. Video-based R(2+1)D convolutional networks read six B-mode and color Doppler views while a segmentation model measures peak aortic-jet velocity, and an ensemble integrates these into a final severity prediction. Trained on 210,193 images from Kaiser Permanente Northern California and validated across held-out, temporally distinct, and external Stanford and Cedars-Sinai cohorts, reaching AUCs up to 0.96–0.99 for severe AS. Developed by the Ouyang lab.

Video-based deep learning model that estimates 14 common blood biomarkers and laboratory values—including hemoglobin (anemia), B-type natriuretic peptide (BNP), troponin I, and blood urea nitrogen (BUN)—directly from apical-4-chamber echocardiogram videos. Built on a spatiotemporal convolutional network (R(2+1)D-style) with residual connections that produces beat-by-beat estimates for both regression and abnormality classification. Trained on over 70,000 echocardiograms from Stanford Healthcare and externally validated at Cedars-Sinai, reaching AUCs around 0.80–0.86 for detecting anemia and elevated BNP. Developed by the Ouyang and Zou labs at Stanford University and Cedars-Sinai.

Deep learning model for automated phenotyping of mitral stenosis (MS) from echocardiography. Uses video-based R(2+1)D convolutional networks on color Doppler and B-mode views to identify and grade mitral stenosis severity, following the multi-view valvular-assessment approach of the EchoNet family. Trained and validated on large clinical echocardiography cohorts from Kaiser Permanente Northern California with external testing at Stanford Healthcare and Cedars-Sinai. Developed by the Ouyang lab.

Vision-language foundation model fine-tuned from CLIP on more than one million private echocardiogram video-report pairs, enabling zero-shot cardiac function assessment, device identification, and image/text retrieval without task-specific training. Combines a ConvNeXt-Base video encoder with a GPT-2-style text encoder under contrastive pretraining. Training data is private, but model weights and code are public. Developed by Cedars-Sinai's Ouyang lab.

General-purpose vision foundation model for echocardiography, pretrained with a masked autoencoder combined with a periodic contrastive loss designed around the cyclical nature of cardiac motion. Validated on chamber segmentation, view classification, and disease detection, with its largest advantage over non-pretrained baselines and natural-image models like SAM appearing in low-label settings. Pretrained on roughly 290,000 echo clips from a mix of internal and public sources. Developed by Massachusetts General Hospital and Harvard Medical School.

Echocardiography foundation model trained with a latent-predictive (V-JEPA2-style) self-supervised objective rather than pixel reconstruction, pretrained on 18 million echocardiograms from 300,000 patients drawn from the public MIMIC-IV-ECHO dataset plus a private multi-site archive - reportedly the largest echo pretraining corpus assembled to date. With a frozen backbone and only lightweight added layers, it outperforms prior echo foundation models by roughly 20% on ejection-fraction estimation and 17% on right-ventricular pressure estimation, reaches strong view-classification accuracy using just 1% of labels, and transfers zero-shot to pediatric echo better than fully fine-tuned baselines. Developed by the University of Toronto's Bo Wang Lab.

Predicts a patient's age from echocardiogram videos across four standard views (PLAX, A2C, A4C, and subcostal), trained on a private multi-site cohort of over 2.6 million videos from more than 166,000 studies across roughly 90,000 patients. The gap between this AI-predicted age and true chronological age is studied as a marker of accelerated or delayed cardiovascular aging and its relationship to all-cause mortality. Uses a 3D CNN (R(2+1)D) with a separate pretrained model per view. Developed by Cedars-Sinai Medical Center and Stanford's Ouyang lab.

End-to-end pipeline for apical-4-chamber echocardiogram videos that segments the left ventricle, estimates ejection fraction on a beat-to-beat basis, and classifies cardiomyopathy with reduced ejection fraction. Combines a DeepLabV3-ResNet50 segmentation model with a 3D CNN (R2+1D/R3D/MC3) initialized on the Kinetics-400 video dataset. Trained on the public EchoNet-Dynamic dataset released alongside it, and one of the most widely reused open echocardiography models since its 2020 Nature publication. Developed by Stanford University.

Measures interventricular septum thickness, LV internal diameter, and posterior wall thickness from PLAX echocardiogram videos, then classifies the underlying cause of left ventricular hypertrophy as either cardiac amyloidosis or hypertrophic cardiomyopathy. Combines an atrous-convolution 2D CNN for wall-thickness segmentation with a 3D residual CNN for etiology classification. Trained on 28,201 videos across Stanford, Cedars-Sinai, and the Unity Imaging Collaborative. Developed by Stanford University.

Fully automated pipeline that scans a complete transthoracic echocardiogram study, identifies the apical-4-chamber color-Doppler clips showing the mitral valve, and grades mitral regurgitation severity at the study level. Combines a view/valve-presence classifier with a spatiotemporal CNN for severity classification. Trained on a private Cedars-Sinai cohort of 58,614 studies and externally validated on 915 studies from Stanford Healthcare.

Automates standard echocardiographic measurements from video, pairing a measurement model with a companion segmentation component. Developed by Stanford and Cedars-Sinai's Ouyang lab; public documentation on the exact measurements covered, training data, and validation performance is limited compared to other EchoNet-family models.

Vision-language foundation model that interprets an entire transthoracic echocardiogram study rather than a single view or video: it classifies the view type of every clip, applies view-informed attention across the full study, and generates or retrieves comprehensive study-level interpretations in English or Italian. Pretrained on a private Cedars-Sinai corpus of 12 million echo video-report pairs. Developed by the Smidt Heart Institute and Stanford's Ouyang lab.

View-agnostic, multi-task model that performs 39 different echocardiographic reporting tasks - covering chamber size and function, valve disease, and more - from any combination of views, aggregating clip-level predictions up to the study level. Combines a ConvNeXt-Tiny frame encoder with a temporal Transformer and separate output heads per task. Trained on private Yale-New Haven Health System echo videos and published in JAMA in 2025 by Yale's CarDS Lab.