SAM 3
Meta segmentation model that detects and tracks every instance of a concept from text or visual prompts.
About
Meta's third Segment Anything Model moves from clicking on single objects to promptable concept segmentation: given a short text phrase or an exemplar box, SAM 3 detects, segments, and tracks every instance of that concept across an image or video. Under the hood, an 848 million parameter model pairs a DETR based detector with a transformer tracker over a shared vision encoder, and the interactive point and mask refinement of earlier SAM versions still works. Meta released the code, checkpoints on Hugging Face behind an access request, and the SA-Co benchmark covering 270,000 unique concepts; a SAM 3.1 update in March 2026 added shared-memory multi-object tracking. Running it locally requires Python 3.12, PyTorch 2.7 or newer, and an NVIDIA GPU with CUDA 12.6 support. The custom SAM License permits commercial use, modification, and redistribution, with restrictions on military and weapons applications. Since the November 2025 release the repository has drawn over 11,000 GitHub stars, and the model quickly became the default open vocabulary segmentation baseline.
Should you use SAM 3?
Pick it when
Pick SAM 3 when you want every instance of a concept, such as all cars or all hard hats, found, masked, and tracked through images or video from a short text phrase or one example box, and you have a recent NVIDIA GPU.
Look elsewhere when
Skip it if you need an OSI license, ungated downloads, or older CUDA hardware, or only mask objects you click: SAM 2 is Apache 2.0 and far smaller, and Grounded SAM 2 gives text prompts from Apache-licensed parts.
Alternatives to SAM 3
- Grounded SAM 2
Text-prompted detection, segmentation, and tracking from Apache 2.0 parts, but it chains two models and needs 8 GB where SAM 3 does it in one.
- Segment Anything 2 (SAM 2)
Apache 2.0 with checkpoints from 38.9M parameters, ideal for click-based masks and video tracking, but it cannot find objects from a text phrase.
- YOLO-World
Real-time text-prompted boxes on a 4 GB GPU, a better fit for live streams, but GPL-3.0 and no promptable mask refinement or concept tracking.
- Florence-2
Compact MIT model that adds captioning and OCR to text grounding with no access request, but it works on single images and has no video tracking.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Intermediate (3/5)
- License
- SAM License
- Added
- Jul 29, 2026
Tags
Related Tools
Browse all Computer Vision & Object Detection toolsMentioned in
Real-Time Object Detection in 2026: RF-DETR, YOLO26, SAM 3
A working guide to real-time detection and segmentation in 2026: RF-DETR, YOLO26, SAM 3, open-vocabulary...
Billy C
Single Image to 3D Model: The 2026 Open Source Pipeline
How the leading open-weight image-to-3D models compare on mesh quality, PBR textures, VRAM, speed, and the...
Max P