Command Palette
Search for a command to run...
Self-supervised Augmentation Consistency for Adapting Semantic Segmentation
Nikita Araslanov Stefan Roth

Abstract
We propose an approach to domain adaptation for semantic segmentation that is both practical and highly accurate. In contrast to previous work, we abandon the use of computationally involved adversarial objectives, network ensembles and style transfer. Instead, we employ standard data augmentation techniques $-$ photometric noise, flipping and scaling $-$ and ensure consistency of the semantic predictions across these image transformations. We develop this principle in a lightweight self-supervised framework trained on co-evolving pseudo labels without the need for cumbersome extra training rounds. Simple in training from a practitioner's standpoint, our approach is remarkably effective. We achieve significant improvements of the state-of-the-art segmentation accuracy after adaptation, consistent both across different choices of the backbone architecture and adaptation scenarios.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| domain-adaptation-on-synthia-to-cityscapes | SAC (ResNet-101) | mIoU: 52.6 |
| domain-adaptation-on-synthia-to-cityscapes | SAC (VGG-16) | mIoU: 49.1 |
| synthetic-to-real-translation-on-gtav-to | SAC | mIoU: 53.8 |
| synthetic-to-real-translation-on-synthia-to-1 | SAC(ResNet-101) | MIoU (13 classes): 59.3 MIoU (16 classes): 52.6 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.