HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

SAM 2: Segment Anything in Images and Videos

SAM 2: Segment Anything in Images and Videos

Abstract

We present Segment Anything Model 2 (SAM 2), a foundation model towardssolving promptable visual segmentation in images and videos. We build a dataengine, which improves model and data via user interaction, to collect thelargest video segmentation dataset to date. Our model is a simple transformerarchitecture with streaming memory for real-time video processing. SAM 2trained on our data provides strong performance across a wide range of tasks.In video segmentation, we observe better accuracy, using 3x fewer interactionsthan prior approaches. In image segmentation, our model is more accurate and 6xfaster than the Segment Anything Model (SAM). We believe that our data, model,and insights will serve as a significant milestone for video segmentation andrelated perception tasks. We are releasing a version of our model, the datasetand an interactive demo.

Code Repositories

bowang-lab/medsam2
pytorch
Mentioned in GitHub
yangchris11/samurai
pytorch
Mentioned in GitHub
TripleJoy/SAM2MOT
pytorch
Mentioned in GitHub
louisfinner/him2sam
pytorch
Mentioned in GitHub
facebookresearch/segment-anything
pytorch
Mentioned in GitHub
facebookresearch/sam2
Official
pytorch
Mentioned in GitHub
idea-research/grounded-sam-2
pytorch
Mentioned in GitHub
dcnieho/segment-anything-2
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
semi-supervised-video-object-segmentation-on-21SAM2
Ju0026F: 77.9
visual-object-tracking-on-davis-2017SAM2
Ju0026F: 90.7
Params(M): 224.4
visual-object-tracking-on-didiSAM2.1
Tracking quality: 0.649
visual-object-tracking-on-vot2022SAM2.1
EAO: 0.692

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
SAM 2: Segment Anything in Images and Videos | Papers | HyperAI