HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

An Alternative to WSSS? An Empirical Study of the Segment Anything Model (SAM) on Weakly-Supervised Semantic Segmentation Problems

Weixuan Sun Zheyuan Liu Yanhao Zhang Yiran Zhong Nick Barnes

An Alternative to WSSS? An Empirical Study of the Segment Anything Model (SAM) on Weakly-Supervised Semantic Segmentation Problems

Abstract

The Segment Anything Model (SAM) has demonstrated exceptional performance and versatility, making it a promising tool for various related tasks. In this report, we explore the application of SAM in Weakly-Supervised Semantic Segmentation (WSSS). Particularly, we adapt SAM as the pseudo-label generation pipeline given only the image-level class labels. While we observed impressive results in most cases, we also identify certain limitations. Our study includes performance evaluations on PASCAL VOC and MS-COCO, where we achieved remarkable improvements over the latest state-of-the-art methods on both datasets. We anticipate that this report encourages further explorations of adopting SAM in WSSS, as well as wider real-world applications.

Code Repositories

weixuansun/wsss_sam
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
weakly-supervised-semantic-segmentation-onWSSS-SAM(ResNet-101, multi-stage)
Mean IoU: 77.2
weakly-supervised-semantic-segmentation-on-1WSSS-SAM(DeepLabV2-ResNet101)
Mean IoU: 77.1
weakly-supervised-semantic-segmentation-on-4WSSS-SAM(DeepLabV2-ResNet101)
mIoU: 55.6

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
An Alternative to WSSS? An Empirical Study of the Segment Anything Model (SAM) on Weakly-Supervised Semantic Segmentation Problems | Papers | HyperAI