Adversarial deep learning model that predicts treatment effects for cardiology patients from structured electronic health record (EHR) data, aiming to forecast expected clinical outcomes of specific treatment choices given a patient's clinical status. Two autoencoders separately learn representations of patient characteristics and of the treatments given; an adversarial loss then encourages these representations to capture the correlational structure between a patient's status and the treatment received, improving downstream outcome prediction over non-adversarial baselines. Evaluated on two private cardiology EHR cohorts from a Chinese hospital, ADTEP modestly outperformed a non-adversarial ablation (DTEP) and classical baselines (logistic regression, SVM) at predicting major adverse cardiac events (MACE) after acute coronary syndrome (AUC 0.662 vs. 0.653/0.648/0.621) and at heart-failure outcome prediction.

Supervised contrastive learning framework for robust, fine-grained echocardiographic view classification across 47 clinically meaningful view types (rather than collapsing views into a few broad categories, as most prior work does). Introduces TTE47, the first publicly available benchmark with 47 fine-grained views independently annotated by three experts, enabling rigorous quantification of inter-observer agreement. A tailored contrastive loss produces a feature space that aligns more strongly with underlying anatomy than with any single annotator's labeling style, and the model outperforms cross-entropy and standard supervised-contrastive baselines on both TTE47 and the public TMED-2 benchmark (the latter without dataset-specific pretraining).

Self-supervised contrastive learning technique for classifying carotid plaques from ultrasound images under label scarcity. In a pretext task, a triplet network takes three augmented views (strong- and weak-augmentation) of each image and promotes their similarity from both feature- and instance-level perspectives to learn effective plaque representations; the resulting encoder is then fine-tuned on labeled ultrasound images for the downstream classification task. FeaCL achieved 83.4% classification accuracy using only 30% of the training data -- a 16.3% improvement over the same network trained without the self-supervised pretext task.

Optimized Hierarchical Fused Fuzzy Deep Reinforcement Learning model for predicting non-sinus (higher-risk) cardiac rhythms from PQRST-analyzed 12-lead ECG data. The three-stage approach combines data preprocessing, reinforcement learning, and fuzzy deep learning to classify sinus vs. non-sinus rhythms. Evaluated on a 12-lead ECG dataset of 10,646 patients, OHFFDRL achieved 94% accuracy, an AUC of 0.91, and was interpreted using SHAP, LIME, calibration curves, adversarial vulnerability analysis, and integrated gradients; TAxis (ventricular repolarization movement range) was found to be the most important distinguishing feature.

Prototype-based neural network for interpretable, uncertainty-aware classification of aortic stenosis (AS) severity from B-mode echocardiography videos. Rather than a black-box prediction, ProtoASNet bases its output on similarity scores between the input video and a set of learned spatio-temporal prototypes (typically highlighting valve calcification and restricted leaflet motion), and uses an abstention loss to flag ambiguous/uncertain cases for expert review. Evaluated on a private clinical dataset and the public TMED-2 dataset, it achieved balanced accuracy of 80.0% (private) and 79.7% (TMED-2), improving to 82.4% when uncertain cases are excluded.

Self-supervised learning (SSL) model that identifies chronically stressed mother-fetus dyads from raw maternal abdominal ECG (aECG), which contains both maternal and fetal cardiac signals. Built on a self-supervised representation-learning approach originally developed for ECG-based emotion recognition, the model is pretrained on public ECG datasets and evaluated on a cohort of pregnant women with chronic stress exposure validated by psychological inventory, maternal hair cortisol, and the fetal stress index (FSI). Using maternal ECG alone with the publicly pretrained model, it detected the chronic-stress-exposure group with AUROC 0.982 and predicted psychological stress score (R2 0.943), FSI (R2 0.946), and maternal hair cortisol (R2 0.931).

Transformer-based multi-view multiple-instance learning (MIL) framework for patient-level coronary stenosis classification from multi-view invasive coronary angiography. Rather than requiring expensive view-level stenosis annotations, SegmentMIL is trained end-to-end on real-world clinical data using only patient-level labels already present in hospital systems, and jointly predicts stenosis presence while localizing the affected artery (left/right) and segment. It captures temporal dynamics and dependencies across the multiple angiographic views per patient (which prior view-level models ignore), and outperforms both single-view models and classical MIL baselines on internal and external clinical evaluations.

Real-time deep-learning model that fuses serial 12-lead ECG waveforms with sequential vital signs and routinely available clinical data to predict hospital admission early during emergency department (ED) encounters with cardiac presentations (chest pain, dyspnea, syncope, presyncope). Developed and validated on the public MIMIC-IV, MIMIC-IV-ED, and MIMIC-IV-ECG databases (n=30,421 ED stays with >=1 ECG; n=11,273 with >=2 ECGs), the model improves on baseline tabular (random forest) and ECG-only models by leveraging how a patient's risk evolves with successive ECGs during the visit, addressing a key limitation of single-time-point risk scores.

Pediatric-specific extension of EchoNet-Dynamic: a video-based deep learning model that segments the left ventricle and estimates ejection fraction (EF) from apical-4-chamber (A4C) and parasternal short-axis (PSAX) pediatric echocardiogram clips. Because adult-trained echo models generalize poorly to children (who vary widely in heart size, rate, and image quality), EchoNet-Peds was trained from scratch on a dedicated pediatric video dataset. It segments the LV with a Dice similarity coefficient of 0.89 in both views, estimates EF with a mean absolute error of 3.66%, and identifies pediatric systolic dysfunction with an AUC of 0.95, significantly outperforming an adult-trained model applied to the same pediatric data.

Explainable machine learning model that detects and localizes left ventricular (LV) scar in hypertrophic cardiomyopathy (HCM) patients directly from 12-lead ECG, as a faster and cheaper alternative to late-gadolinium-enhancement (LGE) cardiac MRI, the clinical gold standard. XplainScar first uses an HCM-specific ECG segmentation algorithm to extract morphological features (duration, amplitude, slope, energy) from the QRS complex, ST segment and T wave of each lead, then combines unsupervised and self-supervised representation learning to predict scar presence and reveal which ECG features are associated with scar location (basal, mid, or apical LV). Trained on 500 HCM patients from the Johns Hopkins HCM Registry and validated on a held-out cohort of 248 HCM patients from UCSF, it reached 88% precision, 90% sensitivity, 78% specificity and an F1-score of 89% for scar detection on the external test set, analyzing a 10-patient batch of ECGs in under one minute.

Coronary artery calcium (CAC) scoring model that transfers a CNN trained for calcium scoring on non-contrast CT (NCCT) to coronary CT angiography (CCTA), where iodinated contrast otherwise confounds calcium detection and large annotated CCTA training sets are scarce. The CAC-scoring CNN is split into a feature generator and a classifier; the feature generator is trained on the NCCT source domain and adapted to the CCTA target domain via adversarial learning combined with a maximum-mean-discrepancy loss, while the source-domain classifier is reused unchanged for the target domain. Builds directly on the authors' earlier non-contrast CT calcium-scoring network.

End-to-end deep learning framework that predicts the procedural outcome of percutaneous coronary intervention (PCI) for chronic total occlusion (CTO) lesions directly from preprocedural coronary CT angiography, aiming to replace slower manual scoring systems (J-CTO, CT-RECTOR, KCCT). The pipeline first segments the coronary artery tree (Patch-UCTNet), detects candidate CTO lesions along the delineated vessel, extracts pathological lesion features with a Swin Transformer, and classifies two outcomes: successful guidewire crossing within 30 minutes and overall PCI success. In the original study, the model completed reconstruction and analysis 85% faster than manual scores (73.7s vs. 418-467s) and was more accurate than the manual CT-RECTOR, KCCT, and J-CTO_CCTA_ scores, reaching an AUROC of 0.97 on the internal test set and 0.96 on an independent external validation cohort (186 patients, 189 CTO lesions).

Clinically-informed modification of the ResNet-18 architecture for identifying occlusion myocardial infarction (OMI) -- a severe, often ST-elevation-negative heart attack caused by complete blockage of a coronary artery -- from a single 12-lead ECG. The network first learns lead-specific temporal features via 1xk temporal convolutions, then learns cross-lead spatial concordance/discordance (e.g. reciprocal ST changes) via a 12x1 spatial convolution placed after the residual blocks, with saliency maps highlighting the most relevant leads and waveform regions for explainability. Benchmarked against ResNet-18 and other CNN/random-forest baselines on a multisite real-world clinical dataset of 10,893 ECGs (OMI rate 6.5%), reaching a test AUROC of 0.889 and an average precision of 0.587, outperforming the compared models.

Ensemble classifier combining hand-engineered expert features with a deep convolutional neural network for classifying cardiac rhythm from a single-lead ECG recording into normal sinus rhythm, atrial fibrillation, another rhythm, or too noisy to classify. A large set of expert features (from time-, frequency-, and template-based analysis) is fed into a gradient-boosted tree classifier (AdaBoost), and its output is combined with a separate deep CNN operating directly on the raw waveform; combining both feature families measurably outperformed either alone. ENCASE won 1st place in the PhysioNet/Computing in Cardiology Challenge 2017 (single-lead AF classification) with an overall F1 score of 0.83 on the official hidden test set, and remains a widely cited example of combining classical signal-processing features with deep representations for ECG classification.

Heart murmur detection model combining spectrogram-derived deep features with hand-crafted peak-interval (PI) features extracted from phonocardiogram recordings, submitted to the George B. Moody PhysioNet Challenge 2022 (team CAU_UMN) and later extended into the 'SpectroHeart' method. Peak-to-peak interval sequences and their summary statistics are combined with spectrogram representations of the PCG signal, optionally alongside patient demographic data, to classify murmur presence across multiple auscultation locations. The team's Challenge submission placed 5th of all teams on the murmur-detection task.

Multimodal machine learning model that flags patients at risk of transthyretin amyloid cardiomyopathy (ATTR-CM) -- a progressive, underdiagnosed disease with expanding disease-modifying treatment options -- from routinely available ECG waveforms, echocardiographic measurements, demographics, and diagnosis codes for orthopedic manifestations of amyloidosis (e.g. carpal tunnel syndrome, spinal stenosis). Developed on 799 patients with 5-fold cross-validation (AUROC 0.85) and externally validated on 422 patients at a separate site (AUROC 0.82), with consistent accuracy across Hispanic, non-Hispanic Black, and non-Hispanic White patients. In a subsequent nonrandomized, single-system, multisite clinical trial (the Cardiac Amyloidosis Discovery Trial), patients flagged by ATTRACTnet and referred for confirmatory amyloid scintigraphy were positive for ATTR-CM 48% of the time, more than 2.8x the positivity rate of historical (15.3%) and contemporary (17.0%) controls referred by usual clinical judgment (P < .001 for both). This is a proprietary clinical AI program; no public code or model weights have been released.

Foundation vision-language model for cardiac MRI that learns pathophysiological visual representations directly from the natural-language radiology reports accompanying each scan, rather than from hand-labeled targets. A Multi-scale Vision Transformer (MViT, Kinetics-400-initialized) video encoder for cine CMR sequences is contrastively pretrained (InfoNCE) against a PubMed-pretrained BERT text encoder over 19,041 multi-institutional CMR studies. The frozen vision encoder transfers with strong performance to left-ventricular ejection-fraction regression (MAE 3.34% on a UK Biobank hold-out of ~4,259-45,623 participants) and detecting HFrEF (LVEF<40%, AUC 0.880), and the paper reports emergent zero-/few-shot performance across 39 cardiac and non-cardiac conditions including cardiac amyloidosis and hypertrophic cardiomyopathy. Code and pretrained MViT encoder weights are both released (Hugging Face, CC BY-NC 4.0).

Fully automated pipeline for interpreting coronary angiograms that chains four purpose-built neural networks: (1) angiographic projection-angle identification, (2) left/right coronary artery detection, (3) arterial segment localization, and (4) stenosis-severity estimation. Trained on 13,843 angiographic studies (195,195 videos) from 11,972 adult patients at UCSF (2008-2019), with projection-angle and LCA/RCA-detection tasks each reaching precision/sensitivity/F1 at or above 90%. For predicting obstructive coronary artery disease (>=70% stenosis), CathAI reaches an AUC of 0.862 internally, 0.869 on external angiograms from the University of Ottawa Heart Institute, and 0.775 after retraining on quantitative-coronary-angiography labels from the Montreal Heart Institute core lab. No public code or model weights have been released.

Multi-view foundation model for coronary angiography trained with video-text contrastive learning on 203,808 angiography videos from 28,117 patients across 32,473 studies at the Montreal Heart Institute, externally validated on 4,249 studies from UCSF. Integrates multiple angiographic projections with attention-based pooling for study-level assessment spanning diagnostic, prognostic, and disease-progression tasks: significant-stenosis detection (AUROC 0.888 internal / 0.89 external), stenosis-percentage estimation (MAE 13.6% vs. 19.0% for clinical reports), chronic total occlusion, intracoronary thrombus, and coronary calcification detection. Transfer learning further enables one-year MACE prediction (AUROC 0.79) and LVEF estimation (MAE 7.3%) from the same angiography embeddings, with a mean in-hospital inference time of 4.2 seconds.

AI-driven pipeline for quantitative coronary-stenosis assessment from routine DICOM coronary angiography videos, combining vessel tracking with a video Swin3D transformer trained and validated on 182,418 angiography videos spanning 5 years at the Montreal Heart Institute. Achieves a mean absolute error of 20.15% and a classification AUROC of 0.8294 for stenosis-percentage prediction against cardiologist assessment, with lower inter-rater variability than two expert interventional cardiologists, and can be fine-tuned to quantitative coronary angiography (QCA) data for even lower error (MAE 7.75%).

Multimodal large language model for ECG medical-report generation and cardiology conversational question-answering. An ECG-CoCa encoder (contrastive ECG-report pretraining in the style of OpenCLIP) is paired with a LLaVA-style vision-language architecture and an LLM backbone, fine-tuned on a purpose-built 45k-example ECG-instruction dataset (19k diagnosis examples + 25k multi-turn dialogue examples) built from five public 12-lead ECG datasets. Produces free-text diagnostic reports and supports zero-shot ECG-report retrieval classification.

First multimodal LLM to unify ECG time series, 12-lead ECG images, and text for grounded, clinician-aligned ECG interpretation. A dual-encoder framework (ECG-CoCa time-series encoder plus a LLaVA-style vision-language backbone) extracts complementary time-series and image features with cross-modal alignment, trained on knowledge-guided instruction data (ECG-Grounding, linking diagnoses to measurable waveform parameters such as QRS/PR intervals) plus the 1.15-million-conversation ECG-Instruct corpus. Introduces the "Grounded ECG Understanding" benchmark and improves predictive performance, explainability, and grounding over prior ECG-language models such as ECG-Chat and PULSE.

Multi-scale ECG-language pretraining model that aligns 12-lead ECG signals with clinical text reports at three granularities -- token, beat, and rhythm level -- rather than a single global embedding. First fine-tunes a cardiology-specialized text encoder to improve understanding of ECG report language, then trains an ECG-FM-initialized ECG encoder against it with hierarchical contrastive supervision. Outperforms prior ECG-language and self-supervised baselines including MERL, ST-MEM, and HeartLang on zero-shot classification, linear probing, and ECG report generation, with especially large gains at low label fractions. Developed at the University of Hong Kong (HKU-MedAI).

Multi-instance-learning (MIL) model for detecting >=50% coronary stenosis directly from curved multiplanar reformation (CMR) images generated during routine coronary CT angiography (CCTA) reads, without requiring slice-level annotations. A multi-range Hounsfield-unit preprocessing pipeline (Sobel edge detection across five attenuation windows) highlights plaque and vessel-wall structures, which a VGG16-based encoder with positional encoding and multi-head attention aggregates across each patient's 'bag' of up to 36 CMR slices per artery to give an interpretable, attention-weighted patient-level prediction. Trained and five-fold cross-validated on 900 real-world CCTA cases (776 LAD / 694 RCA / 600 LCX) from Sahlgrenska University Hospital, reaching AUCs of 0.91-0.92 across the three major coronary arteries. Code (preprocessing + MIL training pipeline) is public; the clinical CMR dataset and trained weights are not released.

Multimodal cardiac MRI foundation model that fuses 3D+T cine CMR (short-axis and long-axis views) with tabular patient health records (demographics, metabolic, and lifestyle factors) from 42,000 UK Biobank participants. Two-stage self-supervised pretraining -- masked-image reconstruction, then imaging-tabular contrastive alignment -- produces representations that transfer to whole-heart segmentation, cardiac phenotype/physiological-feature regression, and cardiac/metabolic disease classification within one unified framework.

Foundation model that encodes single-lead (lead I) ECGs with information from paired transthoracic echocardiography reports, aimed at label-efficient screening for structural heart disease (SHD) on wearable and portable single-lead ECG devices. A 7-layer 1D-CNN ECG encoder and a RoBERTa-based text encoder are contrastively pretrained (CLIP-style) on 194,551 ECG-echo report pairs from 77,378 adults in the Yale New Haven Health System, then the ECG encoder is fine-tuned on a temporally-distinct cohort to detect reduced LVEF, diastolic dysfunction, and a composite SHD label. Matches a randomly-initialized CNN at full training-data volume but substantially outperforms it in label-scarce regimes (e.g. with only 0.5% of labeled data).

Open-source pipeline that classifies aortic stenosis (AS) severity from transthoracic echocardiography by combining structural and functional information. Video-based R(2+1)D convolutional networks read six B-mode and color Doppler views while a segmentation model measures peak aortic-jet velocity, and an ensemble integrates these into a final severity prediction. Trained on 210,193 images from Kaiser Permanente Northern California and validated across held-out, temporally distinct, and external Stanford and Cedars-Sinai cohorts, reaching AUCs up to 0.96–0.99 for severe AS. Developed by the Ouyang lab.

Vision-language model that jointly embeds a cardiac MRI study, treated as video, with the impression section of its clinical report. Combines a video encoder over cine/LGE frame sequences with a Bio+ClinicalBERT text encoder using CLIP-style contrastive training. Supports zero-shot and few-shot classification of cardiomyopathies, amyloidosis, and LV dysfunction, plus image/report retrieval and structured report drafting. Trained on a private, single-institution corpus of roughly 11,000-14,000 CMR study-report pairs from Cleveland Clinic and Case Western.

Dual-encoder single-lead ECG classifier for atrial fibrillation detection that fuses a raw-signal branch with a spectrogram branch via axial attention and a Transformer. Originally developed as a graduate-course project at TU Darmstadt for the 2017 PhysioNet/CinC Challenge, and later extended in a 2023 follow-up study. Released in four sizes up to 130M parameters (S/M/L/XL), alongside a simpler CNN+LSTM variant.

Multimodal ECG model that pairs a 1D ConvNeXtV2 signal encoder with a BioLinkBERT text encoder, trained with a joint contrastive-and-captioning objective using LLM-generated descriptions of ECG demographics and waveform patterns in place of raw clinical reports. Validated on arrhythmia diagnosis and ECG-based subject identification, reaching an AUROC of 0.938 fine-tuned and 0.812 zero-shot on PTB-XL diagnostic classification. Developed at Rice University.

End-to-end pipeline for apical-4-chamber echocardiogram videos that segments the left ventricle, estimates ejection fraction on a beat-to-beat basis, and classifies cardiomyopathy with reduced ejection fraction. Combines a DeepLabV3-ResNet50 segmentation model with a 3D CNN (R2+1D/R3D/MC3) initialized on the Kinetics-400 video dataset. Trained on the public EchoNet-Dynamic dataset released alongside it, and one of the most widely reused open echocardiography models since its 2020 Nature publication. Developed by Stanford University.

Measures interventricular septum thickness, LV internal diameter, and posterior wall thickness from PLAX echocardiogram videos, then classifies the underlying cause of left ventricular hypertrophy as either cardiac amyloidosis or hypertrophic cardiomyopathy. Combines an atrous-convolution 2D CNN for wall-thickness segmentation with a 3D residual CNN for etiology classification. Trained on 28,201 videos across Stanford, Cedars-Sinai, and the Unity Imaging Collaborative. Developed by Stanford University.

Fully automated pipeline that scans a complete transthoracic echocardiogram study, identifies the apical-4-chamber color-Doppler clips showing the mitral valve, and grades mitral regurgitation severity at the study level. Combines a view/valve-presence classifier with a spatiotemporal CNN for severity classification. Trained on a private Cedars-Sinai cohort of 58,614 studies and externally validated on 915 studies from Stanford Healthcare.

Detects 12 categories of echocardiogram-confirmed structural heart disease from 12-lead ECG waveforms combined with demographic and clinical covariates. Uses the same architecture as the original, larger EchoNext model but is trained entirely on the public EchoNext-Mini dataset - 100,000 de-identified ECGs from Columbia University Irving Medical Center released on PhysioNet - making it one of the more fully reproducible models of its kind, with public weights, a Docker image, and inference code.

Multimodal model that learns a shared representation space for ECG signals and their clinical text reports, pretrained on paired MIMIC-IV-ECG recordings and reports. Supports zero-shot ECG classification via text prompts, tested across six public benchmark datasets including PTB-XL and CPSC2018 without any downstream training data. Developed at Imperial College London and published at ICML 2024.

CLIP-style model that aligns 12-lead ECG signals with free-text echocardiography reports for zero-shot detection of structural heart disease directly from an ECG. Extends the MERL framework, and was trained on 45,016 paired ECG-echo reports from two Hong Kong hospitals, with external validation on the public EchoNext dataset from Columbia University. Developed by researchers at the University of Hong Kong and Imperial College London; described in a 2025 medRxiv preprint.

View-agnostic, multi-task model that performs 39 different echocardiographic reporting tasks - covering chamber size and function, valve disease, and more - from any combination of views, aggregating clip-level predictions up to the study level. Combines a ConvNeXt-Tiny frame encoder with a temporal Transformer and separate output heads per task. Trained on private Yale-New Haven Health System echo videos and published in JAMA in 2025 by Yale's CarDS Lab.