Cross-modality cardiac image segmentation model that addresses spatial-temporal confounding -- where the anatomy and imaging-modality elements of cardiac images are intertwined across space and time. DCL performs multi-dimensional causal intervention, modeling causal relationships between images and labels as well as causality along the time and space dimensions, integrating historical optimal interventions to transfer knowledge across temporal contexts. A diffusion mechanism further keeps extracted anatomical elements causally invariant across modalities. On cross-modality cardiac images (MR, CT, and ultrasound), DCL achieved a mean Dice of 0.951, outperforming other advanced segmentation methods.

Fully automatic, open-source deep learning pipeline for estimating left atrial fibrosis from late gadolinium enhancement (LGE) cardiac MRI, built to remove the operator-dependent steps that limit reproducibility of conventional atrial LGE analysis. A multilabel convolutional neural network delineates the left atrial blood pool, pulmonary veins, and mitral valve; these structures are then used to automatically calculate fibrosis burden via established image-intensity-ratio thresholds, without manual tracing. Validated on a 3D LGE-CMR dataset of 207 scans, the pipeline's automatic segmentation achieved a 91% Dice score against manual tracing, and its fully automatic fibrosis quantification closely matched semi-automatic reference methods. The CNN and pipeline are distributed as part of the open-source CemrgApp platform.

Prototype-based neural network for interpretable, uncertainty-aware classification of aortic stenosis (AS) severity from B-mode echocardiography videos. Rather than a black-box prediction, ProtoASNet bases its output on similarity scores between the input video and a set of learned spatio-temporal prototypes (typically highlighting valve calcification and restricted leaflet motion), and uses an abstention loss to flag ambiguous/uncertain cases for expert review. Evaluated on a private clinical dataset and the public TMED-2 dataset, it achieved balanced accuracy of 80.0% (private) and 79.7% (TMED-2), improving to 82.4% when uncertain cases are excluded.

Reinforcement-learning-based unsupervised domain adaptation framework for spatio-temporal (2D+time) echocardiography segmentation, extending the authors' earlier RL4Seg work to full-length video sequences. RL4Seg3D uses a sliding-window approach supporting high-resolution, full-sized inputs, and fuses multiple reward mechanisms to improve segmentation reliability without requiring additional expert annotations in the target domain. Trained and evaluated on a large dataset of over 30,000 echocardiography videos, it outperforms baselines and foundation models on overall segmentation accuracy as well as echocardiography-specific metrics including anatomical/temporal validity and mitral-valve-commissure landmark precision, and supports test-time optimization via calibrated uncertainty estimates.

Disentangled representation learning model for cardiac image analysis that factorises 2D medical images (MRI, CT) into a spatial 'anatomy factor' (a semantically meaningful multi-channel map, produced by a U-Net-style anatomy encoder) and a non-spatial 'modality factor' (a latent vector capturing imaging-specific characteristics). This disentangled representation supports semi-supervised segmentation using only a fraction of labeled images (matching fully supervised performance), multi-task learning (e.g. jointly regressing cardiac indices), multimodal pooling of MRI and CT data, and image-to-image synthesis between modalities via latent-space arithmetic (swapping modality factors). SDNet also demonstrates that its modality factor alone can predict the input imaging modality with high accuracy.

Pediatric-specific extension of EchoNet-Dynamic: a video-based deep learning model that segments the left ventricle and estimates ejection fraction (EF) from apical-4-chamber (A4C) and parasternal short-axis (PSAX) pediatric echocardiogram clips. Because adult-trained echo models generalize poorly to children (who vary widely in heart size, rate, and image quality), EchoNet-Peds was trained from scratch on a dedicated pediatric video dataset. It segments the LV with a Dice similarity coefficient of 0.89 in both views, estimates EF with a mean absolute error of 3.66%, and identifies pediatric systolic dysfunction with an AUC of 0.95, significantly outperforming an adult-trained model applied to the same pediatric data.

Automated deep learning workflow that detects and grades tricuspid regurgitation (TR) severity from full transthoracic echocardiography studies. The pipeline first identifies apical-4-chamber (A4C) video clips with color Doppler across the tricuspid valve from a full echo study, then applies a dedicated R(2+1)D video classifier to grade TR severity. Trained on over 2 million echo videos from 47,312 studies at Cedars-Sinai Medical Center and externally validated at Stanford Healthcare, the model identified color-Doppler A4C views with AUC ≥0.999 and detected clinically significant (moderate-or-severe) TR with AUC 0.951 and severe TR with AUC 0.980. Code and trained model weights are released to support prospective evaluation of AI-assisted TR screening.

Explainable machine learning model that detects and localizes left ventricular (LV) scar in hypertrophic cardiomyopathy (HCM) patients directly from 12-lead ECG, as a faster and cheaper alternative to late-gadolinium-enhancement (LGE) cardiac MRI, the clinical gold standard. XplainScar first uses an HCM-specific ECG segmentation algorithm to extract morphological features (duration, amplitude, slope, energy) from the QRS complex, ST segment and T wave of each lead, then combines unsupervised and self-supervised representation learning to predict scar presence and reveal which ECG features are associated with scar location (basal, mid, or apical LV). Trained on 500 HCM patients from the Johns Hopkins HCM Registry and validated on a held-out cohort of 248 HCM patients from UCSF, it reached 88% precision, 90% sensitivity, 78% specificity and an F1-score of 89% for scar detection on the external test set, analyzing a 10-patient batch of ECGs in under one minute.

One of the foundational baseline segmentation networks submitted to the 2017 Automated Cardiac Diagnosis Challenge (ACDC), comparing 2D and 3D convolutional network designs for segmenting the left ventricle cavity, myocardium, and right ventricle cavity from short-axis cine cardiac MRI at end-diastole and end-systole. The accompanying study systematically explored the tradeoffs between 2D and 3D convolutions for this task, finding that, due to the highly anisotropic voxel spacing typical of clinical cine cardiac MRI, 2D networks that treat each slice independently can match or exceed 3D networks while being far cheaper to train. The public code and pretrained weights for the best-performing configuration have served as a widely used, simple baseline for later cardiac MRI segmentation research (including for automatically deriving ventricular volumes and ejection fraction).

The original U-Net baseline segmentation network introduced alongside the CAMUS (Cardiac Acquisitions for Multi-structure Ultrasound Segmentation) dataset, one of the largest fully open-access, expert-annotated 2D echocardiography benchmarks. The network segments the left ventricle endocardium (LVEndo), left ventricle epicardium/myocardium (LVEpi), and left atrium (LA) from apical 2-chamber and 4-chamber echo views at end-diastole (ED) and end-systole (ES). In the original ten-fold cross-validation benchmark comparing U-Net, U-Net++, Stacked Hourglass, Anatomically Constrained Neural Networks, and classical methods, the U-Net variant (18M parameters) achieved the best overall accuracy, reaching Dice scores of 0.939 (ED) / 0.916 (ES) for LVEndo and 0.954 (ED) / 0.945 (ES) for LVEpi, approaching inter-observer variability. A pretrained checkpoint of this baseline U-Net is distributed via the University of Sherbrooke's vitalab CASTOR project as part of a broader library for building anatomically-constrained cardiac segmentation pipelines.

Dual Bayesian ResNet model for heart murmur detection from multi-location phonocardiogram (PCG) recordings, developed for the George B. Moody PhysioNet Challenge 2022. Each patient's PCG recordings are segmented into overlapping log-mel spectrograms, which are passed through two Bayesian ResNet binary classifiers running simultaneously (present vs. unknown-or-absent, and unknown vs. present-or-absent); the two outputs are aggregated into a patient-level present/unknown/absent murmur classification. An optional second-stage XGBoost model integrates the DBRes output with demographic data and hand-crafted signal features. On the Challenge's official hidden test set, DBRes achieved a weighted accuracy of 0.771 for the murmur-detection task, placing 4th among all teams.

Video-based deep learning system for automated screening of rheumatic heart disease (RHD) from echocardiography, aimed at low-resource settings where RHD -- the most common acquired heart disease in children and young adults worldwide -- is endemic but echocardiography expertise is scarce. A 3D convolutional neural network (C3D) classifies each echo video clip, explicitly modeling temporal information across frames; a supervised meta-classifier then aggregates the per-video predictions from an exam (which may contain many video clips from different views) into a single exam-level RHD diagnosis. Evaluated on 11,646 echocardiography videos from 912 screening exams collected in underserved areas of Brazil and Uganda, the 3D C3D network significantly outperformed a comparison 2D CNN (VGG16) that ignores temporal information, and the learned aggregation model reached 72.77% exam-level diagnostic accuracy, exceeding simple majority voting across a patient's videos.

Heart murmur detection model combining spectrogram-derived deep features with hand-crafted peak-interval (PI) features extracted from phonocardiogram recordings, submitted to the George B. Moody PhysioNet Challenge 2022 (team CAU_UMN) and later extended into the 'SpectroHeart' method. Peak-to-peak interval sequences and their summary statistics are combined with spectrogram representations of the PCG signal, optionally alongside patient demographic data, to classify murmur presence across multiple auscultation locations. The team's Challenge submission placed 5th of all teams on the murmur-detection task.

Multimodal machine learning model that flags patients at risk of transthyretin amyloid cardiomyopathy (ATTR-CM) -- a progressive, underdiagnosed disease with expanding disease-modifying treatment options -- from routinely available ECG waveforms, echocardiographic measurements, demographics, and diagnosis codes for orthopedic manifestations of amyloidosis (e.g. carpal tunnel syndrome, spinal stenosis). Developed on 799 patients with 5-fold cross-validation (AUROC 0.85) and externally validated on 422 patients at a separate site (AUROC 0.82), with consistent accuracy across Hispanic, non-Hispanic Black, and non-Hispanic White patients. In a subsequent nonrandomized, single-system, multisite clinical trial (the Cardiac Amyloidosis Discovery Trial), patients flagged by ATTRACTnet and referred for confirmatory amyloid scintigraphy were positive for ATTR-CM 48% of the time, more than 2.8x the positivity rate of historical (15.3%) and contemporary (17.0%) controls referred by usual clinical judgment (P < .001 for both). This is a proprietary clinical AI program; no public code or model weights have been released.

Deep learning framework, developed in collaboration with the MONAI community, for automatic segmentation of tricuspid valve leaflets from transthoracic 3D echocardiograms in children with hypoplastic left heart syndrome (HLHS) and other forms of single-ventricle congenital heart disease, integrated into 3D Slicer via MONAILabel for interactive clinical/research use. Addresses a modality (pediatric 3D echocardiography) and population (single-ventricle congenital heart disease) largely absent from adult-focused cardiac AI models.

Multi-instance contrastive self-supervised learning framework for echocardiography video representation learning: two distinct videos from the same patient exam are treated as positive pairs (rather than augmentations of a single clip), and a frame-reordering pretext task on temporally shuffled frames encourages the 3D-CNN backbone to learn temporally coherent representations. After self-supervised pretraining on unlabeled echocardiograms, the backbone is efficiently fine-tuned for cardiac disease classification (severe aortic stenosis, left ventricular hypertrophy) using very few labeled examples, outperforming SimCLR, standard multi-instance SimCLR, and Kinetics-400-initialized baselines across a range of training-data ratios.

Framework for training an echocardiography left-ventricle segmentation model purely by data-free knowledge distillation: a ConvLSTM-based student network learns to reproduce the masks produced by an EchoNet-Dynamic (DeepLabV3-ResNet50) teacher on entirely synthetic echo videos, with no real labeled data or even real videos required. Achieves state-of-the-art results identifying end-diastolic/end-systolic frames, reaching segmentation quality close to real-data training with substantially fewer weights; also introduces a human-annotation-free evaluation method using a large auxiliary model.

Predicts cardiac MRI (CMR) tissue-characterization findings -- wall-motion abnormalities and myocardial scar -- directly from standard transthoracic echocardiography videos (A4C/A2C/PLAX views), using a factorized 3D R2+1D convolutional network. Trained and validated on a single-institution cohort of more than 1,400 patients with paired echo and CMR studies within 30 days of each other. Released weights and inference code cover the two binarized outcomes (wall motion, scar); the continuous CMR tissue markers (native T1, T2, ECV) evaluated in the paper are not part of the public release.

Adapts the Segment Anything Model (SAM) to echocardiography video segmentation by giving it a space-time memory that carries both spatial and temporal cues, so that only the first frame of a video needs an external point prompt and every subsequent frame is segmented from a propagated memory prompt instead. A memory reinforcement mechanism uses each frame's predicted mask to suppress speckle-noise features before they are written back into memory, addressing a key failure mode of naively adapting video object segmentation (e.g. XMem) to noisy ultrasound. Built on SAMUS (an ultrasound-adapted SAM) with a frozen SAM backbone and only the image-encoder adapter layers trained. On the semi-supervised CAMUS and EchoNet-Dynamic benchmarks (only end-diastole/end-systole frames labeled), MemSAM reaches 93.3% and 92.8% mean Dice respectively, outperforming UNet, SwinUNet, H2Former, and prior medical-SAM adaptations (MedSAM, MSA, SAMed, SonoSAM, SAMUS) with far fewer prompts, and derives LVEF (via Simpson's biplane method of disks) with a Pearson correlation of 78.9% against ground truth on CAMUS. Training/inference code is public (MIT license); only the starting SAM ViT-B checkpoint is linked for download, not a separately released fine-tuned MemSAM checkpoint.

Ensemble of 3D convolutional neural networks that detects severe aortic stenosis directly from single-view 2D parasternal long-axis (PLAX) transthoracic echocardiogram videos, without requiring Doppler imaging. Representations are first pretrained with patient-level contrastive self-supervised learning on PLAX clips, then fine-tuned for binary AS classification; the ensemble is externally validated across a temporally-distinct cohort and geographically-distinct cohorts in California and New England. No pretrained weights are released; only the training/evaluation pipeline is public.

Self- and weakly-supervised pipeline for left-ventricle segmentation across the full cardiac cycle in apical-4-chamber echocardiography videos. A video segmentation network (2D super-image or 3D U-Net encoder) is first pretrained with a self-supervised temporal-masking objective on largely unannotated echo frames, then fine-tuned with weak supervision from the sparse end-diastole/end-systole frame labels that most echo datasets provide. Achieves 93.3% Dice on EchoNet-Dynamic, outperforming nnU-Net and non-SSL baselines, and generalizes to the external CAMUS dataset. Developed by the BioMedIA group at MBZUAI.

Multimodal cardiac MRI foundation model that fuses 3D+T cine CMR (short-axis and long-axis views) with tabular patient health records (demographics, metabolic, and lifestyle factors) from 42,000 UK Biobank participants. Two-stage self-supervised pretraining -- masked-image reconstruction, then imaging-tabular contrastive alignment -- produces representations that transfer to whole-heart segmentation, cardiac phenotype/physiological-feature regression, and cardiac/metabolic disease classification within one unified framework.

Foundation model that encodes single-lead (lead I) ECGs with information from paired transthoracic echocardiography reports, aimed at label-efficient screening for structural heart disease (SHD) on wearable and portable single-lead ECG devices. A 7-layer 1D-CNN ECG encoder and a RoBERTa-based text encoder are contrastively pretrained (CLIP-style) on 194,551 ECG-echo report pairs from 77,378 adults in the Yale New Haven Health System, then the ECG encoder is fine-tuned on a temporally-distinct cohort to detect reduced LVEF, diastolic dysfunction, and a composite SHD label. Matches a randomly-initialized CNN at full training-data volume but substantially outperforms it in label-scarce regimes (e.g. with only 0.5% of labeled data).

Fully automated deep learning workflow for characterizing cardiac mechanics from balanced steady-state free-precession (bSSFP) cine cardiac MRI. It decouples two convolutional networks—a segmentation net (CarSON) and a 3D motion-estimation net (CarMEN)—to derive left- and right-ventricular volumes plus global and regional myocardial strain and strain rate without manual tracing. Trained and validated on healthy and cardiovascular-disease subjects and shown to be robust across MRI vendors, with excellent intra-scanner repeatability for strain. Developed at Massachusetts General Hospital and the Harvard-MIT Division of Health Sciences and Technology.

Video-based deep learning model that grades aortic regurgitation (AR) severity—none/trace, mild, moderate, or severe—from color Doppler echocardiography. View-specific R(2+1)D 3D-CNNs analyze five standard transthoracic views (PLAX, PLAX-AV, A3C, A3C-AV, A5C) and their outputs are combined by a maximum-severity rule at the study level. Trained on ~47,600 color Doppler videos from Cedars-Sinai and externally validated at Stanford Healthcare, reaching AUCs of 0.95 for at-least-moderate AR and 0.97 for severe AR internally. Developed by the Ouyang lab at Cedars-Sinai Medical Center.

Open-source pipeline that classifies aortic stenosis (AS) severity from transthoracic echocardiography by combining structural and functional information. Video-based R(2+1)D convolutional networks read six B-mode and color Doppler views while a segmentation model measures peak aortic-jet velocity, and an ensemble integrates these into a final severity prediction. Trained on 210,193 images from Kaiser Permanente Northern California and validated across held-out, temporally distinct, and external Stanford and Cedars-Sinai cohorts, reaching AUCs up to 0.96–0.99 for severe AS. Developed by the Ouyang lab.

Deep learning model for automated phenotyping of mitral stenosis (MS) from echocardiography. Uses video-based R(2+1)D convolutional networks on color Doppler and B-mode views to identify and grade mitral stenosis severity, following the multi-view valvular-assessment approach of the EchoNet family. Trained and validated on large clinical echocardiography cohorts from Kaiser Permanente Northern California with external testing at Stanford Healthcare and Cedars-Sinai. Developed by the Ouyang lab.

CNN-based image classifier that screens 12-lead ECG images for a signature of transthyretin amyloid cardiomyopathy (ATTR-CM), producing a study-level probability score. Trained on a private Yale New Haven Health System cohort of nuclear-imaging-confirmed ATTR-CM cases and matched controls. Used alongside a companion echocardiography model to track pre-clinical ATTR-CM progression years before it would otherwise be confirmed by nuclear amyloid imaging. Developed by Yale's CarDS Lab and distributed as a packaged research-use executable rather than downloadable weights.

EfficientNet-B3 CNN that detects hypertrophic cardiomyopathy directly from images of printed or scanned 12-lead ECGs, rather than from raw digital waveforms, enabling screening from a photo of a paper tracing. Initialized via self-supervised contrastive pretraining on patient identity, then fine-tuned at Yale New Haven Hospital on over 124,000 ECGs from about 67,000 patients, with HCM status confirmed by cardiac MRI or echocardiography. Externally validated on ECG images from MIMIC-IV, Amsterdam UMC, and UK Biobank. Developed by Yale's CarDS Lab.

Automated pipeline that segments both heart ventricles and tracks their motion throughout the cardiac cycle from short-axis cine cardiac MRI, producing 3D bi-ventricular models with per-vertex wall-thickness and curvature measurements over time. Built on a shape-refined multi-task fully convolutional network, followed by non-rigid registration and mesh-based motion tracking. Trained on roughly 400 manually annotated pulmonary hypertension patients as part of Imperial College London's UK Digital Heart Project, and underlies the related 4Dsurvival cardiac-motion survival-prediction study.

Vision-language model that jointly embeds a cardiac MRI study, treated as video, with the impression section of its clinical report. Combines a video encoder over cine/LGE frame sequences with a Bio+ClinicalBERT text encoder using CLIP-style contrastive training. Supports zero-shot and few-shot classification of cardiomyopathies, amyloidosis, and LV dysfunction, plus image/report retrieval and structured report drafting. Trained on a private, single-institution corpus of roughly 11,000-14,000 CMR study-report pairs from Cleveland Clinic and Case Western.

Foundation model for cine cardiac MRI, self-supervised via masked autoencoding on nearly 75,000 UK Biobank scans. Uses a Vision Transformer with a convolutional stem, unified across long-axis and short-axis views. Fine-tuned checkpoints are released for ventricle and myocardium segmentation, ejection-fraction regression, cardiovascular disease classification, and landmark localization across several public benchmark datasets (ACDC, M&Ms, M&Ms2, EMIDEC, and others).

End-to-end pipeline for apical-4-chamber echocardiogram videos that segments the left ventricle, estimates ejection fraction on a beat-to-beat basis, and classifies cardiomyopathy with reduced ejection fraction. Combines a DeepLabV3-ResNet50 segmentation model with a 3D CNN (R2+1D/R3D/MC3) initialized on the Kinetics-400 video dataset. Trained on the public EchoNet-Dynamic dataset released alongside it, and one of the most widely reused open echocardiography models since its 2020 Nature publication. Developed by Stanford University.

Measures interventricular septum thickness, LV internal diameter, and posterior wall thickness from PLAX echocardiogram videos, then classifies the underlying cause of left ventricular hypertrophy as either cardiac amyloidosis or hypertrophic cardiomyopathy. Combines an atrous-convolution 2D CNN for wall-thickness segmentation with a 3D residual CNN for etiology classification. Trained on 28,201 videos across Stanford, Cedars-Sinai, and the Unity Imaging Collaborative. Developed by Stanford University.

Fully automated pipeline that scans a complete transthoracic echocardiogram study, identifies the apical-4-chamber color-Doppler clips showing the mitral valve, and grades mitral regurgitation severity at the study level. Combines a view/valve-presence classifier with a spatiotemporal CNN for severity classification. Trained on a private Cedars-Sinai cohort of 58,614 studies and externally validated on 915 studies from Stanford Healthcare.

Automates standard echocardiographic measurements from video, pairing a measurement model with a companion segmentation component. Developed by Stanford and Cedars-Sinai's Ouyang lab; public documentation on the exact measurements covered, training data, and validation performance is limited compared to other EchoNet-family models.

Detects 12 categories of echocardiogram-confirmed structural heart disease from 12-lead ECG waveforms combined with demographic and clinical covariates. Uses the same architecture as the original, larger EchoNext model but is trained entirely on the public EchoNext-Mini dataset - 100,000 de-identified ECGs from Columbia University Irving Medical Center released on PhysioNet - making it one of the more fully reproducible models of its kind, with public weights, a Docker image, and inference code.

3D CNN that segments seven cardiac substructures - both ventricles, both atria, the LV myocardium, ascending aorta, and pulmonary artery trunk - from cardiac CT angiography. Trained with a hybrid loss function combining multiple segmentation objectives. Developed at CUHK for the MICCAI 2017 Multi-Modality Whole Heart Segmentation (MM-WHS) challenge.

Ensemble of ten self-configuring nnU-Net models (five 2D, five 3D) that segments the left ventricle, right ventricle, and myocardium from short-axis cardiac cine MRI. Won the 2020 M&Ms challenge, a multi-centre, multi-vendor, multi-disease benchmark spanning scanners from four vendors and three countries, demonstrating strong generalization across acquisition protocols. Developed by DKFZ, the group behind the widely used nnU-Net framework.

CLIP-style model that aligns 12-lead ECG signals with free-text echocardiography reports for zero-shot detection of structural heart disease directly from an ECG. Extends the MERL framework, and was trained on 45,016 paired ECG-echo reports from two Hong Kong hospitals, with external validation on the public EchoNext dataset from Columbia University. Developed by researchers at the University of Hong Kong and Imperial College London; described in a 2025 medRxiv preprint.

Two-stage pipeline that segments the left atrium and quantifies atrial scar tissue from 3D late-gadolinium-enhancement cardiac MRI, supporting atrial-fibrillation ablation planning. A Multi-Scale Weight Sharing network first delineates the atrial cavity, then a boundary-patch method segments scar tissue around the detected wall. Developed at Queen Mary University of London for the LAScarQS 2022 MICCAI/STACOM segmentation challenge.

View-agnostic, multi-task model that performs 39 different echocardiographic reporting tasks - covering chamber size and function, valve disease, and more - from any combination of views, aggregating clip-level predictions up to the study level. Combines a ConvNeXt-Tiny frame encoder with a temporal Transformer and separate output heads per task. Trained on private Yale-New Haven Health System echo videos and published in JAMA in 2025 by Yale's CarDS Lab.

BEiT-base Vision Transformer that embeds images of standard 12-lead ECG printouts into a representation space, enabling zero-shot screening for structural heart disease by comparing a new ECG against reference case/control embedding centroids rather than requiring task-specific training. Trained on private Yale New Haven Health System ECG images and validated against the public EchoNext dataset. Aimed at scanned or legacy ECG images still common in EHR systems. Developed by Yale's CarDS Lab.

Long-standing toolbox for automated segmentation of the ventricles and atria and derivation of cardiac imaging phenotypes from short- and long-axis cine cardiac MRI. Built on a fully convolutional network trained per slice, and widely reused across UK Biobank cardiac imaging studies since its 2018 publication. Developed at Imperial College London.