HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Discriminative Feature Alignment: Improving Transferability of Unsupervised Domain Adaptation by Gaussian-guided Latent Alignment

Jing Wang Jiahong Chen Jianzhe Lin Leonid Sigal Clarence W. de Silva

Discriminative Feature Alignment: Improving Transferability of Unsupervised Domain Adaptation by Gaussian-guided Latent Alignment

Abstract

In this study, we focus on the unsupervised domain adaptation problem where an approximate inference model is to be learned from a labeled data domain and expected to generalize well to an unlabeled data domain. The success of unsupervised domain adaptation largely relies on the cross-domain feature alignment. Previous work has attempted to directly align latent features by the classifier-induced discrepancies. Nevertheless, a common feature space cannot always be learned via this direct feature alignment especially when a large domain gap exists. To solve this problem, we introduce a Gaussian-guided latent alignment approach to align the latent feature distributions of the two domains under the guidance of the prior distribution. In such an indirect way, the distributions over the samples from the two domains will be constructed on a common feature space, i.e., the space of the prior, which promotes better feature alignment. To effectively align the target latent distribution with this prior distribution, we also propose a novel unpaired L1-distance by taking advantage of the formulation of the encoder-decoder. The extensive evaluations on nine benchmark datasets validate the superior knowledge transferability through outperforming state-of-the-art methods and the versatility of the proposed method by improving the existing work significantly.

Code Repositories

JingWang18/Discriminative-Feature-Alignment
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
domain-adaptation-on-imageclef-daDFA-SAFN
Accuracy: 90.2
domain-adaptation-on-imageclef-daDFA-ENT
Accuracy: 89.1
domain-adaptation-on-mnist-to-uspsDFA-ENT
Accuracy: 97.9
domain-adaptation-on-mnist-to-uspsDFA-MCD
Accuracy: 98.6
domain-adaptation-on-svhn-to-mnistDFA-MCD
Accuracy: 98.9
domain-adaptation-on-svhn-to-mnistDFA-ENT
Accuracy: 98.2
domain-adaptation-on-synsig-to-gtsrbDFA-MCD
Accuracy: 97.5
domain-adaptation-on-synsig-to-gtsrbDFA-ENT
Accuracy: 96.8
domain-adaptation-on-usps-to-mnistDFA-MCD
Accuracy: 96.6
domain-adaptation-on-usps-to-mnistDFA-ENT
Accuracy: 96.2
transfer-learning-on-office-homeDFA-SAFN
Accuracy: 69.1
transfer-learning-on-office-homeDFA-ENT
Accuracy: 69.2

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Discriminative Feature Alignment: Improving Transferability of Unsupervised Domain Adaptation by Gaussian-guided Latent Alignment | Papers | HyperAI