CVAI Catalog

·

View Catalog

CardioEmbed

Qwen3-Embedding-8B + LoRA

University of Nevada Las Vegas / Concorde Career Colleges (Young & Matthews)

Clinical text

Filter catalog by Modality:
Text & EHR

General Purpose / Multi-task

Filter catalog by Disease / Trait:
General / Foundation

Retrieval

Filter catalog by Task Type:
Representation Learning

Embedding

Filter catalog by Task Type:
Representation Learning

LLM

Filter catalog by Architecture:
Transformer

PyTorch

Filter catalog by Framework:
PyTorch

Apache 2.0

Filter catalog by License:
Permissive

Domain-specialized text embedding model for clinical cardiology, built by fine-tuning the Qwen3-Embedding-8B language model with LoRA adapters via contrastive learning on cardiology textbook sentences. Reaches 99.60% top-1 accuracy on cardiology-specific semantic retrieval, nearly 16 points above the prior MedTE baseline. The training corpus draws on roughly 150,000 sentences from seven copyrighted textbooks and is not public, though the resulting model weights are freely downloadable.

memory Specifications

category

Architecture

LLM

Qwen3-Embedding-8B decoder-only LLM backbone, LoRA fine-tuned with InfoNCE contrastive loss and in-batch negatives

code

Framework

PyTorch

calendar_month

Added to catalog

2026-07-10

gavel License

Apache 2.0

check_small Open source check_small Commercial use OK check_small Modifications allowed Attribution required No share-alike requirement

License for model weights only. Associated code may be licensed seperately, check code source for specific terms.

description Publication

database Training & evaluation data

Cardiology Textbook Sentence-Pair Corpus (CardioEmbed family)

train

~150,000 anchor-positive sentence pairs derived from 7 cardiology textbooks; text corpus, not human-subject data

science Capabilities & performance

Cardiology semantic retrieval (Acc@1)

Retrieval General Purpose / Multi-task
0.996 Accuracy Cardiology textbook retrieval benchmark · internal

Embedding

General Purpose / Multi-task