Shenzhen University / Hong Kong Polytechnic University (Deng, Wu, Zeng, Qin)
Model weights not public. Contact creators for more information.
Adapts the Segment Anything Model (SAM) to echocardiography video segmentation by giving it a space-time memory that carries both spatial and temporal cues, so that only the first frame of a video needs an external point prompt and every subsequent frame is segmented from a propagated memory prompt instead. A memory reinforcement mechanism uses each frame's predicted mask to suppress speckle-noise features before they are written back into memory, addressing a key failure mode of naively adapting video object segmentation (e.g. XMem) to noisy ultrasound. Built on SAMUS (an ultrasound-adapted SAM) with a frozen SAM backbone and only the image-encoder adapter layers trained. On the semi-supervised CAMUS and EchoNet-Dynamic benchmarks (only end-diastole/end-systole frames labeled), MemSAM reaches 93.3% and 92.8% mean Dice respectively, outperforming UNet, SwinUNet, H2Former, and prior medical-SAM adaptations (MedSAM, MSA, SAMed, SonoSAM, SAMUS) with far fewer prompts, and derives LVEF (via Simpson's biplane method of disks) with a Pearson correlation of 78.9% against ground truth on CAMUS. Training/inference code is public (MIT license); only the starting SAM ViT-B checkpoint is linked for download, not a separately released fine-tuned MemSAM checkpoint.
Architecture
Hybrid
SAM-based architecture (image encoder, prompt encoder, mask decoder, built on SAMUS) augmented with a space-time memory module (sensory, working, and long-term memory) for temporal prompting, plus a convolutional memory-reinforcement module that re-weights features using the predicted mask before they are stored
Framework
PyTorch
Added to catalog
2026-08-10
500 patients imaged with 2D transthoracic echocardiography (A2C/A4C views) at University Hospital of St Etienne; roughly half with LVEF < 45%.
10,030 deidentified apical-4-chamber echo videos from Stanford Health Care. Source reports age and sex breakdowns.
Semi-supervised left-ventricle segmentation across the full echocardiogram video cycle from a single point prompt on the first frame, propagated via space-time memory
LVEF derived from MemSAM's LV segmentation masks via Simpson's biplane method of disks