HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Self-supervised Augmentation Consistency for Adapting Semantic Segmentation

Nikita Araslanov Stefan Roth

Self-supervised Augmentation Consistency for Adapting Semantic Segmentation

Abstract

We propose an approach to domain adaptation for semantic segmentation that is both practical and highly accurate. In contrast to previous work, we abandon the use of computationally involved adversarial objectives, network ensembles and style transfer. Instead, we employ standard data augmentation techniques $-$ photometric noise, flipping and scaling $-$ and ensure consistency of the semantic predictions across these image transformations. We develop this principle in a lightweight self-supervised framework trained on co-evolving pseudo labels without the need for cumbersome extra training rounds. Simple in training from a practitioner's standpoint, our approach is remarkably effective. We achieve significant improvements of the state-of-the-art segmentation accuracy after adaptation, consistent both across different choices of the backbone architecture and adaptation scenarios.

Code Repositories

visinf/da-sac
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
domain-adaptation-on-synthia-to-cityscapesSAC (ResNet-101)
mIoU: 52.6
domain-adaptation-on-synthia-to-cityscapesSAC (VGG-16)
mIoU: 49.1
synthetic-to-real-translation-on-gtav-toSAC
mIoU: 53.8
synthetic-to-real-translation-on-synthia-to-1SAC(ResNet-101)
MIoU (13 classes): 59.3
MIoU (16 classes): 52.6

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Self-supervised Augmentation Consistency for Adapting Semantic Segmentation | Papers | HyperAI