Cross-modality cardiac image segmentation model that addresses spatial-temporal confounding -- where the anatomy and imaging-modality elements of cardiac images are intertwined across space and time. DCL performs multi-dimensional causal intervention, modeling causal relationships between images and labels as well as causality along the time and space dimensions, integrating historical optimal interventions to transfer knowledge across temporal contexts. A diffusion mechanism further keeps extracted anatomical elements causally invariant across modalities. On cross-modality cardiac images (MR, CT, and ultrasound), DCL achieved a mean Dice of 0.951, outperforming other advanced segmentation methods.

Prototype-based neural network for interpretable, uncertainty-aware classification of aortic stenosis (AS) severity from B-mode echocardiography videos. Rather than a black-box prediction, ProtoASNet bases its output on similarity scores between the input video and a set of learned spatio-temporal prototypes (typically highlighting valve calcification and restricted leaflet motion), and uses an abstention loss to flag ambiguous/uncertain cases for expert review. Evaluated on a private clinical dataset and the public TMED-2 dataset, it achieved balanced accuracy of 80.0% (private) and 79.7% (TMED-2), improving to 82.4% when uncertain cases are excluded.

Reinforcement-learning-based unsupervised domain adaptation framework for spatio-temporal (2D+time) echocardiography segmentation, extending the authors' earlier RL4Seg work to full-length video sequences. RL4Seg3D uses a sliding-window approach supporting high-resolution, full-sized inputs, and fuses multiple reward mechanisms to improve segmentation reliability without requiring additional expert annotations in the target domain. Trained and evaluated on a large dataset of over 30,000 echocardiography videos, it outperforms baselines and foundation models on overall segmentation accuracy as well as echocardiography-specific metrics including anatomical/temporal validity and mitral-valve-commissure landmark precision, and supports test-time optimization via calibrated uncertainty estimates.

Disentangled representation learning model for cardiac image analysis that factorises 2D medical images (MRI, CT) into a spatial 'anatomy factor' (a semantically meaningful multi-channel map, produced by a U-Net-style anatomy encoder) and a non-spatial 'modality factor' (a latent vector capturing imaging-specific characteristics). This disentangled representation supports semi-supervised segmentation using only a fraction of labeled images (matching fully supervised performance), multi-task learning (e.g. jointly regressing cardiac indices), multimodal pooling of MRI and CT data, and image-to-image synthesis between modalities via latent-space arithmetic (swapping modality factors). SDNet also demonstrates that its modality factor alone can predict the input imaging modality with high accuracy.

Pediatric-specific extension of EchoNet-Dynamic: a video-based deep learning model that segments the left ventricle and estimates ejection fraction (EF) from apical-4-chamber (A4C) and parasternal short-axis (PSAX) pediatric echocardiogram clips. Because adult-trained echo models generalize poorly to children (who vary widely in heart size, rate, and image quality), EchoNet-Peds was trained from scratch on a dedicated pediatric video dataset. It segments the LV with a Dice similarity coefficient of 0.89 in both views, estimates EF with a mean absolute error of 3.66%, and identifies pediatric systolic dysfunction with an AUC of 0.95, significantly outperforming an adult-trained model applied to the same pediatric data.

Explainable machine learning model that detects and localizes left ventricular (LV) scar in hypertrophic cardiomyopathy (HCM) patients directly from 12-lead ECG, as a faster and cheaper alternative to late-gadolinium-enhancement (LGE) cardiac MRI, the clinical gold standard. XplainScar first uses an HCM-specific ECG segmentation algorithm to extract morphological features (duration, amplitude, slope, energy) from the QRS complex, ST segment and T wave of each lead, then combines unsupervised and self-supervised representation learning to predict scar presence and reveal which ECG features are associated with scar location (basal, mid, or apical LV). Trained on 500 HCM patients from the Johns Hopkins HCM Registry and validated on a held-out cohort of 248 HCM patients from UCSF, it reached 88% precision, 90% sensitivity, 78% specificity and an F1-score of 89% for scar detection on the external test set, analyzing a 10-patient batch of ECGs in under one minute.

Heart murmur detection model combining spectrogram-derived deep features with hand-crafted peak-interval (PI) features extracted from phonocardiogram recordings, submitted to the George B. Moody PhysioNet Challenge 2022 (team CAU_UMN) and later extended into the 'SpectroHeart' method. Peak-to-peak interval sequences and their summary statistics are combined with spectrogram representations of the PCG signal, optionally alongside patient demographic data, to classify murmur presence across multiple auscultation locations. The team's Challenge submission placed 5th of all teams on the murmur-detection task.

Multimodal machine learning model that flags patients at risk of transthyretin amyloid cardiomyopathy (ATTR-CM) -- a progressive, underdiagnosed disease with expanding disease-modifying treatment options -- from routinely available ECG waveforms, echocardiographic measurements, demographics, and diagnosis codes for orthopedic manifestations of amyloidosis (e.g. carpal tunnel syndrome, spinal stenosis). Developed on 799 patients with 5-fold cross-validation (AUROC 0.85) and externally validated on 422 patients at a separate site (AUROC 0.82), with consistent accuracy across Hispanic, non-Hispanic Black, and non-Hispanic White patients. In a subsequent nonrandomized, single-system, multisite clinical trial (the Cardiac Amyloidosis Discovery Trial), patients flagged by ATTRACTnet and referred for confirmatory amyloid scintigraphy were positive for ATTR-CM 48% of the time, more than 2.8x the positivity rate of historical (15.3%) and contemporary (17.0%) controls referred by usual clinical judgment (P < .001 for both). This is a proprietary clinical AI program; no public code or model weights have been released.

Adapts the Segment Anything Model (SAM) to echocardiography video segmentation by giving it a space-time memory that carries both spatial and temporal cues, so that only the first frame of a video needs an external point prompt and every subsequent frame is segmented from a propagated memory prompt instead. A memory reinforcement mechanism uses each frame's predicted mask to suppress speckle-noise features before they are written back into memory, addressing a key failure mode of naively adapting video object segmentation (e.g. XMem) to noisy ultrasound. Built on SAMUS (an ultrasound-adapted SAM) with a frozen SAM backbone and only the image-encoder adapter layers trained. On the semi-supervised CAMUS and EchoNet-Dynamic benchmarks (only end-diastole/end-systole frames labeled), MemSAM reaches 93.3% and 92.8% mean Dice respectively, outperforming UNet, SwinUNet, H2Former, and prior medical-SAM adaptations (MedSAM, MSA, SAMed, SonoSAM, SAMUS) with far fewer prompts, and derives LVEF (via Simpson's biplane method of disks) with a Pearson correlation of 78.9% against ground truth on CAMUS. Training/inference code is public (MIT license); only the starting SAM ViT-B checkpoint is linked for download, not a separately released fine-tuned MemSAM checkpoint.

Multimodal cardiac MRI foundation model that fuses 3D+T cine CMR (short-axis and long-axis views) with tabular patient health records (demographics, metabolic, and lifestyle factors) from 42,000 UK Biobank participants. Two-stage self-supervised pretraining -- masked-image reconstruction, then imaging-tabular contrastive alignment -- produces representations that transfer to whole-heart segmentation, cardiac phenotype/physiological-feature regression, and cardiac/metabolic disease classification within one unified framework.

Foundation model that encodes single-lead (lead I) ECGs with information from paired transthoracic echocardiography reports, aimed at label-efficient screening for structural heart disease (SHD) on wearable and portable single-lead ECG devices. A 7-layer 1D-CNN ECG encoder and a RoBERTa-based text encoder are contrastively pretrained (CLIP-style) on 194,551 ECG-echo report pairs from 77,378 adults in the Yale New Haven Health System, then the ECG encoder is fine-tuned on a temporally-distinct cohort to detect reduced LVEF, diastolic dysfunction, and a composite SHD label. Matches a randomly-initialized CNN at full training-data volume but substantially outperforms it in label-scarce regimes (e.g. with only 0.5% of labeled data).

Fully automated deep learning workflow for characterizing cardiac mechanics from balanced steady-state free-precession (bSSFP) cine cardiac MRI. It decouples two convolutional networks—a segmentation net (CarSON) and a 3D motion-estimation net (CarMEN)—to derive left- and right-ventricular volumes plus global and regional myocardial strain and strain rate without manual tracing. Trained and validated on healthy and cardiovascular-disease subjects and shown to be robust across MRI vendors, with excellent intra-scanner repeatability for strain. Developed at Massachusetts General Hospital and the Harvard-MIT Division of Health Sciences and Technology.

Open-source pipeline that classifies aortic stenosis (AS) severity from transthoracic echocardiography by combining structural and functional information. Video-based R(2+1)D convolutional networks read six B-mode and color Doppler views while a segmentation model measures peak aortic-jet velocity, and an ensemble integrates these into a final severity prediction. Trained on 210,193 images from Kaiser Permanente Northern California and validated across held-out, temporally distinct, and external Stanford and Cedars-Sinai cohorts, reaching AUCs up to 0.96–0.99 for severe AS. Developed by the Ouyang lab.

Vision-language model that jointly embeds a cardiac MRI study, treated as video, with the impression section of its clinical report. Combines a video encoder over cine/LGE frame sequences with a Bio+ClinicalBERT text encoder using CLIP-style contrastive training. Supports zero-shot and few-shot classification of cardiomyopathies, amyloidosis, and LV dysfunction, plus image/report retrieval and structured report drafting. Trained on a private, single-institution corpus of roughly 11,000-14,000 CMR study-report pairs from Cleveland Clinic and Case Western.

End-to-end pipeline for apical-4-chamber echocardiogram videos that segments the left ventricle, estimates ejection fraction on a beat-to-beat basis, and classifies cardiomyopathy with reduced ejection fraction. Combines a DeepLabV3-ResNet50 segmentation model with a 3D CNN (R2+1D/R3D/MC3) initialized on the Kinetics-400 video dataset. Trained on the public EchoNet-Dynamic dataset released alongside it, and one of the most widely reused open echocardiography models since its 2020 Nature publication. Developed by Stanford University.

Measures interventricular septum thickness, LV internal diameter, and posterior wall thickness from PLAX echocardiogram videos, then classifies the underlying cause of left ventricular hypertrophy as either cardiac amyloidosis or hypertrophic cardiomyopathy. Combines an atrous-convolution 2D CNN for wall-thickness segmentation with a 3D residual CNN for etiology classification. Trained on 28,201 videos across Stanford, Cedars-Sinai, and the Unity Imaging Collaborative. Developed by Stanford University.

Fully automated pipeline that scans a complete transthoracic echocardiogram study, identifies the apical-4-chamber color-Doppler clips showing the mitral valve, and grades mitral regurgitation severity at the study level. Combines a view/valve-presence classifier with a spatiotemporal CNN for severity classification. Trained on a private Cedars-Sinai cohort of 58,614 studies and externally validated on 915 studies from Stanford Healthcare.

Automates standard echocardiographic measurements from video, pairing a measurement model with a companion segmentation component. Developed by Stanford and Cedars-Sinai's Ouyang lab; public documentation on the exact measurements covered, training data, and validation performance is limited compared to other EchoNet-family models.

Detects 12 categories of echocardiogram-confirmed structural heart disease from 12-lead ECG waveforms combined with demographic and clinical covariates. Uses the same architecture as the original, larger EchoNext model but is trained entirely on the public EchoNext-Mini dataset - 100,000 de-identified ECGs from Columbia University Irving Medical Center released on PhysioNet - making it one of the more fully reproducible models of its kind, with public weights, a Docker image, and inference code.

Ensemble of ten self-configuring nnU-Net models (five 2D, five 3D) that segments the left ventricle, right ventricle, and myocardium from short-axis cardiac cine MRI. Won the 2020 M&Ms challenge, a multi-centre, multi-vendor, multi-disease benchmark spanning scanners from four vendors and three countries, demonstrating strong generalization across acquisition protocols. Developed by DKFZ, the group behind the widely used nnU-Net framework.

CLIP-style model that aligns 12-lead ECG signals with free-text echocardiography reports for zero-shot detection of structural heart disease directly from an ECG. Extends the MERL framework, and was trained on 45,016 paired ECG-echo reports from two Hong Kong hospitals, with external validation on the public EchoNext dataset from Columbia University. Developed by researchers at the University of Hong Kong and Imperial College London; described in a 2025 medRxiv preprint.

View-agnostic, multi-task model that performs 39 different echocardiographic reporting tasks - covering chamber size and function, valve disease, and more - from any combination of views, aggregating clip-level predictions up to the study level. Combines a ConvNeXt-Tiny frame encoder with a temporal Transformer and separate output heads per task. Trained on private Yale-New Haven Health System echo videos and published in JAMA in 2025 by Yale's CarDS Lab.