Command Palette
Search for a command to run...
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
Alec Radford; Luke Metz; Soumith Chintala

Abstract
In recent years, supervised learning with convolutional networks (CNNs) has seen huge adoption in computer vision applications. Comparatively, unsupervised learning with CNNs has received less attention. In this work we hope to help bridge the gap between the success of CNNs for supervised learning and unsupervised learning. We introduce a class of CNNs called deep convolutional generative adversarial networks (DCGANs), that have certain architectural constraints, and demonstrate that they are a strong candidate for unsupervised learning. Training on various image datasets, we show convincing evidence that our deep convolutional adversarial pair learns a hierarchy of representations from object parts to scenes in both the generator and discriminator. Additionally, we use the learned features for novel tasks - demonstrating their applicability as general image representations.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| conditional-image-generation-on-cifar-10 | DCGAN | Inception score: 6.58 |
| image-classification-on-cifar-10 | DCGAN | Percentage correct: 82.8 |
| image-classification-on-cifar-10 | 1 Layer K-means | Percentage correct: 80.6 |
| image-classification-on-svhn | DCGAN | Percentage error: 22.48 |
| image-classification-on-svhn | TSVM | Percentage error: 66.55 |
| image-classification-on-svhn | Supervised CNN | Percentage error: 28.87 |
| image-classification-on-svhn | KNN | Percentage error: 77.93 |
| image-clustering-on-cifar-10 | GAN | ARI: 0.176 Accuracy: 0.315 Backbone: GAN NMI: 0.265 Train set: Train+Test |
| image-clustering-on-cifar-100 | GAN | Accuracy: 0.151 NMI: 0.120 Train Set: Train+Test |
| image-clustering-on-imagenet-10 | GAN | Accuracy: 0.346 NMI: 0.225 |
| image-clustering-on-imagenet-dog-15 | GAN | Accuracy: 0.174 NMI: 0.121 |
| image-clustering-on-stl-10 | GAN | Accuracy: 0.298 NMI: 0.210 Train Split: Train+Test |
| image-clustering-on-tiny-imagenet | GAN | Accuracy: 0.041 NMI: 0.135 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.