Automated deep learning workflow that detects and grades tricuspid regurgitation (TR) severity from full transthoracic echocardiography studies. The pipeline first identifies apical-4-chamber (A4C) video clips with color Doppler across the tricuspid valve from a full echo study, then applies a dedicated R(2+1)D video classifier to grade TR severity. Trained on over 2 million echo videos from 47,312 studies at Cedars-Sinai Medical Center and externally validated at Stanford Healthcare, the model identified color-Doppler A4C views with AUC ≥0.999 and detected clinically significant (moderate-or-severe) TR with AUC 0.951 and severe TR with AUC 0.980. Code and trained model weights are released to support prospective evaluation of AI-assisted TR screening.

Open, transparent deep-learning method for measuring left ventricular global longitudinal strain (GLS) from routine 2D echocardiography, built as an alternative to proprietary vendor strain software. Unity-GLS is a multi-image neural network (based on the HigherHRNet-W32 pose-estimation architecture) that identifies the mitral annulus, LV apex, and endocardial curve from a target frame plus six neighbouring frames, across apical 4-, 3-, and 2-chamber views. Validated against multi-expert (11-reader) consensus tracings from 100 echocardiograms in a UK-wide collaborative, Unity-GLS agreed with expert consensus as strongly as individual human experts and two proprietary vendor packages (correlation with consensus: 0.91 vs. 0.73-0.85 for other methods).

The original U-Net baseline segmentation network introduced alongside the CAMUS (Cardiac Acquisitions for Multi-structure Ultrasound Segmentation) dataset, one of the largest fully open-access, expert-annotated 2D echocardiography benchmarks. The network segments the left ventricle endocardium (LVEndo), left ventricle epicardium/myocardium (LVEpi), and left atrium (LA) from apical 2-chamber and 4-chamber echo views at end-diastole (ED) and end-systole (ES). In the original ten-fold cross-validation benchmark comparing U-Net, U-Net++, Stacked Hourglass, Anatomically Constrained Neural Networks, and classical methods, the U-Net variant (18M parameters) achieved the best overall accuracy, reaching Dice scores of 0.939 (ED) / 0.916 (ES) for LVEndo and 0.954 (ED) / 0.945 (ES) for LVEpi, approaching inter-observer variability. A pretrained checkpoint of this baseline U-Net is distributed via the University of Sherbrooke's vitalab CASTOR project as part of a broader library for building anatomically-constrained cardiac segmentation pipelines.

Video-based deep learning system for automated screening of rheumatic heart disease (RHD) from echocardiography, aimed at low-resource settings where RHD -- the most common acquired heart disease in children and young adults worldwide -- is endemic but echocardiography expertise is scarce. A 3D convolutional neural network (C3D) classifies each echo video clip, explicitly modeling temporal information across frames; a supervised meta-classifier then aggregates the per-video predictions from an exam (which may contain many video clips from different views) into a single exam-level RHD diagnosis. Evaluated on 11,646 echocardiography videos from 912 screening exams collected in underserved areas of Brazil and Uganda, the 3D C3D network significantly outperformed a comparison 2D CNN (VGG16) that ignores temporal information, and the learned aggregation model reached 72.77% exam-level diagnostic accuracy, exceeding simple majority voting across a patient's videos.

Deep learning framework, developed in collaboration with the MONAI community, for automatic segmentation of tricuspid valve leaflets from transthoracic 3D echocardiograms in children with hypoplastic left heart syndrome (HLHS) and other forms of single-ventricle congenital heart disease, integrated into 3D Slicer via MONAILabel for interactive clinical/research use. Addresses a modality (pediatric 3D echocardiography) and population (single-ventricle congenital heart disease) largely absent from adult-focused cardiac AI models.

Multi-instance contrastive self-supervised learning framework for echocardiography video representation learning: two distinct videos from the same patient exam are treated as positive pairs (rather than augmentations of a single clip), and a frame-reordering pretext task on temporally shuffled frames encourages the 3D-CNN backbone to learn temporally coherent representations. After self-supervised pretraining on unlabeled echocardiograms, the backbone is efficiently fine-tuned for cardiac disease classification (severe aortic stenosis, left ventricular hypertrophy) using very few labeled examples, outperforming SimCLR, standard multi-instance SimCLR, and Kinetics-400-initialized baselines across a range of training-data ratios.

Predicts cardiac MRI (CMR) tissue-characterization findings -- wall-motion abnormalities and myocardial scar -- directly from standard transthoracic echocardiography videos (A4C/A2C/PLAX views), using a factorized 3D R2+1D convolutional network. Trained and validated on a single-institution cohort of more than 1,400 patients with paired echo and CMR studies within 30 days of each other. Released weights and inference code cover the two binarized outcomes (wall motion, scar); the continuous CMR tissue markers (native T1, T2, ECV) evaluated in the paper are not part of the public release.

Ensemble of 3D convolutional neural networks that detects severe aortic stenosis directly from single-view 2D parasternal long-axis (PLAX) transthoracic echocardiogram videos, without requiring Doppler imaging. Representations are first pretrained with patient-level contrastive self-supervised learning on PLAX clips, then fine-tuned for binary AS classification; the ensemble is externally validated across a temporally-distinct cohort and geographically-distinct cohorts in California and New England. No pretrained weights are released; only the training/evaluation pipeline is public.

Self- and weakly-supervised pipeline for left-ventricle segmentation across the full cardiac cycle in apical-4-chamber echocardiography videos. A video segmentation network (2D super-image or 3D U-Net encoder) is first pretrained with a self-supervised temporal-masking objective on largely unannotated echo frames, then fine-tuned with weak supervision from the sparse end-diastole/end-systole frame labels that most echo datasets provide. Achieves 93.3% Dice on EchoNet-Dynamic, outperforming nnU-Net and non-SSL baselines, and generalizes to the external CAMUS dataset. Developed by the BioMedIA group at MBZUAI.

Video-based deep learning model that grades aortic regurgitation (AR) severity—none/trace, mild, moderate, or severe—from color Doppler echocardiography. View-specific R(2+1)D 3D-CNNs analyze five standard transthoracic views (PLAX, PLAX-AV, A3C, A3C-AV, A5C) and their outputs are combined by a maximum-severity rule at the study level. Trained on ~47,600 color Doppler videos from Cedars-Sinai and externally validated at Stanford Healthcare, reaching AUCs of 0.95 for at-least-moderate AR and 0.97 for severe AR internally. Developed by the Ouyang lab at Cedars-Sinai Medical Center.

Video-based deep learning model that estimates 14 common blood biomarkers and laboratory values—including hemoglobin (anemia), B-type natriuretic peptide (BNP), troponin I, and blood urea nitrogen (BUN)—directly from apical-4-chamber echocardiogram videos. Built on a spatiotemporal convolutional network (R(2+1)D-style) with residual connections that produces beat-by-beat estimates for both regression and abnormality classification. Trained on over 70,000 echocardiograms from Stanford Healthcare and externally validated at Cedars-Sinai, reaching AUCs around 0.80–0.86 for detecting anemia and elevated BNP. Developed by the Ouyang and Zou labs at Stanford University and Cedars-Sinai.

Deep learning model for automated phenotyping of mitral stenosis (MS) from echocardiography. Uses video-based R(2+1)D convolutional networks on color Doppler and B-mode views to identify and grade mitral stenosis severity, following the multi-view valvular-assessment approach of the EchoNet family. Trained and validated on large clinical echocardiography cohorts from Kaiser Permanente Northern California with external testing at Stanford Healthcare and Cedars-Sinai. Developed by the Ouyang lab.

Predicts a patient's age from echocardiogram videos across four standard views (PLAX, A2C, A4C, and subcostal), trained on a private multi-site cohort of over 2.6 million videos from more than 166,000 studies across roughly 90,000 patients. The gap between this AI-predicted age and true chronological age is studied as a marker of accelerated or delayed cardiovascular aging and its relationship to all-cause mortality. Uses a 3D CNN (R(2+1)D) with a separate pretrained model per view. Developed by Cedars-Sinai Medical Center and Stanford's Ouyang lab.