HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Reducing Domain Gap by Reducing Style Bias

Nam Hyeonseob ; Lee HyunJae ; Park Jongchan ; Yoon Wonjun ; Yoo Donggeun

Reducing Domain Gap by Reducing Style Bias

Abstract

Convolutional Neural Networks (CNNs) often fail to maintain their performancewhen they confront new test domains, which is known as the problem of domainshift. Recent studies suggest that one of the main causes of this problem isCNNs' strong inductive bias towards image styles (i.e. textures) which aresensitive to domain changes, rather than contents (i.e. shapes). Inspired bythis, we propose to reduce the intrinsic style bias of CNNs to close the gapbetween domains. Our Style-Agnostic Networks (SagNets) disentangle styleencodings from class categories to prevent style biased predictions and focusmore on the contents. Extensive experiments show that our method effectivelyreduces the style bias and makes the model more robust under domain shift. Itachieves remarkable performance improvements in a wide range of cross-domaintasks including domain generalization, unsupervised domain adaptation, andsemi-supervised domain adaptation on multiple datasets.

Code Repositories

facebookresearch/DomainBed
pytorch
Mentioned in GitHub
hyeonseobnam/style-agnostic-networks
pytorch
Mentioned in GitHub
hyeonseobnam/sagnet
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
domain-generalization-on-office-homeSagNet (ResNet-18)
Average Accuracy: 62.34
domain-generalization-on-pacs-2SagNet (Resnet-18)
Average Accuracy: 83.25
domain-generalization-on-pacs-2SagNet (Resnet-50)
Average Accuracy: 82.3
domain-generalization-on-pacs-2SagNet (Alexnet)
Average Accuracy: 75.52
image-to-sketch-recognition-on-pacsSagNet (ResNet18)
Accuracy: 40.7
single-source-domain-generalization-on-pacsSagNet (ResNet18)
Accuracy: 61.9

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Reducing Domain Gap by Reducing Style Bias | Papers | HyperAI