A universal promptable volumetric segmentation model trained primarily on CT data, combining a 3D image encoder with text and spatial prompts.
At a glance
| Field | Details |
|---|---|
| Model type | Text and spatial prompt 3D segmentation |
| Research team / organization | Beijing Academy of Artificial Intelligence (BAAI), DCAI |
| Input / modality | 3D CT; the upstream paper/release emphasizes more than 200 anatomical categories. |
| Prompt / interaction | Text, point and box prompts; optional zoom-in/zoom-out refinement. |
| Code license | Code: MIT. Verify the checkpoint-specific terms on the model-hosting page. |
📚 Paper and publication
SegVol: Universal and Interactive Volumetric Medical Image Segmentation — NeurIPS 2024 Spotlight; arXiv:2311.13385.
📦 Checkpoints and access
Official checkpoints and demo data are linked from the BAAI Hugging Face repository and Google Drive; the demo script also expects a local CLIP text-encoder folder.
The code, model checkpoint and any required foundation-model checkpoint can have different terms. Review each linked source before use or redistribution.
⚙️ Official setup and inference
1 | # Follow the repository's legacy-compatible environment (PyTorch >=1.11, |
Important: the upstream demo/evaluation script reads ground-truth masks to synthesize point/box prompts. Those are GT-derived/oracle prompts; they are not a human-input inference recipe. See the official inference guide.
⚠️ Version and practical notes
The official evaluation demo synthesizes point/box prompts from ground-truth masks. Such runs are GT-derived/oracle; for deployment or human-in-the-loop evaluation, provide prompts independently of the ground truth.
📜 License
Code: MIT. Verify the checkpoint-specific terms on the model-hosting page.
Citation: Cite the paper above and the upstream project as directed by its authors. This repository links to the original paper; it does not redistribute the code or weights.
Source pages checked: 27 October 2026. Upstream environments, weights and access policies may change; use the linked project as the source of truth.