CVAI Catalog

·

View Catalog

MemSAM

Shenzhen University / Hong Kong Polytechnic University (Deng, Wu, Zeng, Qin)

Echocardiography video

Filter catalog by Modality:
Echocardiography

Cardiac chamber segmentation

Filter catalog by Disease / Trait:
Structural Heart & Cardiomyopathy

LVEF estimation

Filter catalog by Disease / Trait:
Cardiac Function & Hemodynamics

Segmentation

Filter catalog by Task Type:
Segmentation & Detection

Regression

Filter catalog by Task Type:
Regression

Hybrid

Filter catalog by Architecture:
Hybrid / Multi-branch

PyTorch

Filter catalog by Framework:
PyTorch

code View code

Model weights not public. Contact creators for more information.

Adapts the Segment Anything Model (SAM) to echocardiography video segmentation by giving it a space-time memory that carries both spatial and temporal cues, so that only the first frame of a video needs an external point prompt and every subsequent frame is segmented from a propagated memory prompt instead. A memory reinforcement mechanism uses each frame's predicted mask to suppress speckle-noise features before they are written back into memory, addressing a key failure mode of naively adapting video object segmentation (e.g. XMem) to noisy ultrasound. Built on SAMUS (an ultrasound-adapted SAM) with a frozen SAM backbone and only the image-encoder adapter layers trained. On the semi-supervised CAMUS and EchoNet-Dynamic benchmarks (only end-diastole/end-systole frames labeled), MemSAM reaches 93.3% and 92.8% mean Dice respectively, outperforming UNet, SwinUNet, H2Former, and prior medical-SAM adaptations (MedSAM, MSA, SAMed, SonoSAM, SAMUS) with far fewer prompts, and derives LVEF (via Simpson's biplane method of disks) with a Pearson correlation of 78.9% against ground truth on CAMUS. Training/inference code is public (MIT license); only the starting SAM ViT-B checkpoint is linked for download, not a separately released fine-tuned MemSAM checkpoint.

memory Specifications

category

Architecture

Hybrid

SAM-based architecture (image encoder, prompt encoder, mask decoder, built on SAMUS) augmented with a space-time memory module (sensory, working, and long-term memory) for temporal prompting, plus a convolutional memory-reinforcement module that re-weights features using the predicted mask before they are stored

code

Framework

PyTorch

calendar_month

Added to catalog

2026-08-10

description Publication

MemSAM: Taming Segment Anything Model for Echocardiography Video Segmentation open_in_new

Deng, Xiaolong; Wu, Huisi; Zeng, Runhao; Qin, Jing

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · 2024 · original paper

database Training & evaluation data

public 500 subjects · France

500 patients imaged with 2D transthoracic echocardiography (A2C/A4C views) at University Hospital of St Etienne; roughly half with LVEF < 45%.

public 10,030 subjects · USA · 2016-2018

10,030 deidentified apical-4-chamber echo videos from Stanford Health Care. Source reports age and sex breakdowns.

science Capabilities & performance

Semi-supervised left-ventricle segmentation across the full echocardiogram video cycle from a single point prompt on the first frame, propagated via space-time memory

Segmentation Cardiac chamber segmentation
0.9331 Dice CAMUS-Semi test set · internal
0.9278 Dice EchoNet-Dynamic test set · internal

LVEF derived from MemSAM's LV segmentation masks via Simpson's biplane method of disks

Regression LVEF estimation
0.7892 Pearson r CAMUS-Semi test set · internal