HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Semi-Supervised Semantic Segmentation with Cross Pseudo Supervision

Xiaokang Chen Yuhui Yuan Gang Zeng Jingdong Wang

Semi-Supervised Semantic Segmentation with Cross Pseudo Supervision

Abstract

In this paper, we study the semi-supervised semantic segmentation problem via exploring both labeled data and extra unlabeled data. We propose a novel consistency regularization approach, called cross pseudo supervision (CPS). Our approach imposes the consistency on two segmentation networks perturbed with different initialization for the same input image. The pseudo one-hot label map, output from one perturbed segmentation network, is used to supervise the other segmentation network with the standard cross-entropy loss, and vice versa. The CPS consistency has two roles: encourage high similarity between the predictions of two perturbed networks for the same input image, and expand training data by using the unlabeled data with pseudo labels. Experiment results show that our approach achieves the state-of-the-art semi-supervised segmentation performance on Cityscapes and PASCAL VOC 2012. Code is available at https://git.io/CPS.

Code Repositories

yhuang1997/3D-CPS
pytorch
Mentioned in GitHub
charlesCXK/TorchSemiSeg
Official
pytorch
Mentioned in GitHub
harshm121/m3l
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
semi-supervised-semantic-segmentation-on-1CPS (DeepLab v3+ with ImageNet-pretrained ResNet-101, single scale inference)
Validation mIoU: 79.21%
semi-supervised-semantic-segmentation-on-2CPS (DeepLab v3+ with ImageNet-pretrained ResNet-101, single scale inference)
Validation mIoU: 77.62%
semi-supervised-semantic-segmentation-on-22CPS (DeepLab v3+ with ResNet-101)
Validation mIoU: 69.8
semi-supervised-semantic-segmentation-on-23CPS (Range View)
mIoU (1% Labels): 33.7
mIoU (10% Labels): 50.0
mIoU (20% Labels): 52.8
mIoU (50% Labels): 54.6
semi-supervised-semantic-segmentation-on-24CPS (Range View)
mIoU (1% Labels): 36.5
mIoU (10% Labels): 52.3
mIoU (20% Labels): 56.3
mIoU (50% Labels): 57.4
semi-supervised-semantic-segmentation-on-25CPS (Range View)
mIoU (1% Labels): 40.7
mIoU (10% Labels): 60.8
mIoU (20% Labels): 64.9
mIoU (50% Labels): 68.0
semi-supervised-semantic-segmentation-on-27CPS (DeepLab v3+ with ResNet-101)
Validation mIoU: 64.1
semi-supervised-semantic-segmentation-on-28CPS (DeepLab v3+ with ResNet-101)
Validation mIoU: 67.4
semi-supervised-semantic-segmentation-on-29CPS (DeepLab v3+ with ResNet-101)
Validation mIoU: 71.7
semi-supervised-semantic-segmentation-on-30CPS (DeepLab v3+ with ResNet-101)
Validation mIoU: 75.9
semi-supervised-semantic-segmentation-on-4CPS
Validation mIoU: 76.44%
semi-supervised-semantic-segmentation-on-45CPS
Mean IoU: 62.87
semi-supervised-semantic-segmentation-on-8CPS (DeepLab v3+ with ImageNet-pretrained ResNet-101, single scale inference)
Validation mIoU: 80.21%
semi-supervised-semantic-segmentation-on-9CPS (DeepLab v3+ with ImageNet-pretrained ResNet-101, single scale inference)
Validation mIoU: 77.68%

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp