MedSAM3-v1

English简体中文

A text/concept-guided medical adaptation of SAM 3 released as LoRA weights. It uses medical language prompts rather than requiring the traditional box/point interaction for its primary workflow.

Official code Paper Weights

← Model atlas

At a glance

Field Details
Model type Text-guided medical SAM adapter
Research team / organization Hong Kong University of Science and Technology (Guangzhou), University of Illinois Urbana-Champaign and collaborators
Input / modality The authors describe radiology, optical/microscopy, pathology and procedure imagery; the first release’s exact supported category list is still being documented.
Prompt / interaction Text prompt; LoRA medical adapter on top of the SAM 3 model.
Code license The MedSAM3 README does not state a separate license for the LoRA weights. SAM 3 base materials use Meta’s SAM License; confirm the adapter/model-card terms before redistribution.

📚 Paper and publication

MedSAM3: Delving into Segment Anything with Medical Concepts — arXiv:2511.19046 (2025 preprint).

📦 Checkpoints and access

The v1 LoRA is hosted at lal-Joey/MedSAM3_v1. It is an adapter: the gated SAM 3 base checkpoint and access approval are also required.

The code, model checkpoint and any required foundation-model checkpoint can have different terms. Review each linked source before use or redistribution.

⚙️ Official setup and inference

1
2
3
4
5
6
7
8
git clone https://github.com/Joey-S-Liu/MedSAM3.git
cd MedSAM3
pip install -e .
hf auth login # required for gated SAM 3 base weights
python3 infer_sam.py \
--config configs/full_lora_config.yaml \
--image path/to/image.jpg --prompt "skin lesion" \
--threshold 0.5 --nms-iou 0.5 --output prediction.png

Set the LoRA checkpoint path in configs/full_lora_config.yaml as directed by the upstream README.

⚠️ Version and practical notes

Keep this LoRA release distinct from Meta’s SAM 3 and the separate Medical-SAM3 project. The authors note that the exact v1 supported-task list is still being documented.

📜 License

The MedSAM3 README does not state a separate license for the LoRA weights. SAM 3 base materials use Meta’s SAM License; confirm the adapter/model-card terms before redistribution.

Citation: Cite the paper above and the upstream project as directed by its authors. This repository links to the original paper; it does not redistribute the code or weights.

Source pages checked: 27 October 2026. Upstream environments, weights and access policies may change; use the linked project as the source of truth.