HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Diffusion Models Beat GANs on Image Synthesis

Prafulla Dhariwal Alex Nichol

Diffusion Models Beat GANs on Image Synthesis

Abstract

We show that diffusion models can achieve image sample quality superior to the current state-of-the-art generative models. We achieve this on unconditional image synthesis by finding a better architecture through a series of ablations. For conditional image synthesis, we further improve sample quality with classifier guidance: a simple, compute-efficient method for trading off diversity for fidelity using gradients from a classifier. We achieve an FID of 2.97 on ImageNet 128$\times$128, 4.59 on ImageNet 256$\times$256, and 7.72 on ImageNet 512$\times$512, and we match BigGAN-deep even with as few as 25 forward passes per sample, all while maintaining better coverage of the distribution. Finally, we find that classifier guidance combines well with upsampling diffusion models, further improving FID to 3.94 on ImageNet 256$\times$256 and 3.85 on ImageNet 512$\times$512. We release our code at https://github.com/openai/guided-diffusion

Code Repositories

lucidrains/ddpm-proteins
pytorch
Mentioned in GitHub
forever208/adm-es
pytorch
Mentioned in GitHub
crosszamirski/guided-i2i
pytorch
Mentioned in GitHub
clu0/unet.cu
pytorch
Mentioned in GitHub
crowsonkb/guided-diffusion
pytorch
Mentioned in GitHub
facebookresearch/rcdm
pytorch
Mentioned in GitHub
alexmaols/elucd
pytorch
Mentioned in GitHub
jerryyann/dpi
pytorch
Mentioned in GitHub
openai/guided-diffusion
Official
pytorch
Mentioned in GitHub
filipbasara0/simple-diffusion
pytorch
Mentioned in GitHub
sangyun884/fast-ode
pytorch
Mentioned in GitHub
ML-GSAI/EGSDE
pytorch
Mentioned in GitHub
afiaka87/clip-guided-diffusion
pytorch
Mentioned in GitHub
forever208/ddpm-ip
pytorch
Mentioned in GitHub
soobin-um/minority-guidance
pytorch
Mentioned in GitHub
deepfake-study/guided-diffusion
pytorch
Mentioned in GitHub
royg27/BIGRoC
pytorch
Mentioned in GitHub
jogo175/treediffusion
pytorch
Mentioned in GitHub
jychoi118/p2-weighting
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
conditional-image-generation-on-imagenetADM-G (classifier_scale=0.5)
FID: 2.97
conditional-image-generation-on-imagenet-2ADM-G
FID: 4.59
Inception score: 186.7
image-generation-on-imagenet-128x128ADM-G
FID: 2.97
image-generation-on-imagenet-256x256ADM-G
FID: 4.59
image-generation-on-imagenet-256x256ADM-G, ADM-U
FID: 3.94
image-generation-on-imagenet-512x512ADM-G
FID: 7.72
Inception score: 172.71
image-generation-on-imagenet-512x512ADM-G, ADM-U
FID: 3.85
Inception score: 221.72
image-generation-on-imagenet-64x64ADM (dropout)
FID: 2.07
image-generation-on-lsun-bedroom-256-x-256ADM (dropout)
FID: 1.90
image-generation-on-lsun-bedroom-256-x-256ADM (dropout, DINOv2)
FD: 59.64
Precision: 0.85
Recall: 0.75
image-generation-on-lsun-cat-256-x-256ADM (dropout)
FID: 5.57
image-generation-on-lsun-horse-256-x-256ADM (dropout)
FID: 2.57

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Diffusion Models Beat GANs on Image Synthesis | Papers | HyperAI