HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Analyzing and Improving the Image Quality of StyleGAN

Tero Karras Samuli Laine Miika Aittala Janne Hellsten Jaakko Lehtinen Timo Aila

Analyzing and Improving the Image Quality of StyleGAN

Abstract

The style-based GAN architecture (StyleGAN) yields state-of-the-art results in data-driven unconditional generative image modeling. We expose and analyze several of its characteristic artifacts, and propose changes in both model architecture and training methods to address them. In particular, we redesign the generator normalization, revisit progressive growing, and regularize the generator to encourage good conditioning in the mapping from latent codes to images. In addition to improving image quality, this path length regularizer yields the additional benefit that the generator becomes significantly easier to invert. This makes it possible to reliably attribute a generated image to a particular network. We furthermore visualize how well the generator utilizes its output resolution, and identify a capacity problem, motivating us to train larger models for additional quality improvements. Overall, our improved model redefines the state of the art in unconditional image modeling, both in terms of existing distribution quality metrics as well as perceived image quality.

Code Repositories

dkn16/stylegan2-pytorch
pytorch
Mentioned in GitHub
EmptySamurai/pytorch-reconet
pytorch
Mentioned in GitHub
tr1pzz/stylegan2-pytorch
pytorch
Mentioned in GitHub
phymhan/stylegan2-pytorch
pytorch
Mentioned in GitHub
RyanWu2233/Style_GAN2_FFHQ
tf
Mentioned in GitHub
NariMo91/GANs-generative-art
pytorch
Mentioned in GitHub
autonomousvision/frequency_bias
pytorch
Mentioned in GitHub
chenqiguo/gan_replication
pytorch
Mentioned in GitHub
christophmeyer/stylegan2-tf2
tf
Mentioned in GitHub
HighCWu/stylegan2-paddle
pytorch
Mentioned in GitHub
Uemuet/imet
tf
Mentioned in GitHub
DaVran369/face
tf
Mentioned in GitHub
Uemuet/-gan
tf
Mentioned in GitHub
rosinality/stylegan2-pytorch
pytorch
Mentioned in GitHub
minyoungg/GAN-Transform-and-Project
pytorch
Mentioned in GitHub
amirhb29/StyleGAN2_Style-Mixing
tf
Mentioned in GitHub
philcryer/randota
Mentioned in GitHub
srinivas1857-ton/toonify-poc
tf
Mentioned in GitHub
NVlabs/stylegan2
Official
tf
Mentioned in GitHub
cbhower/style-gan-music-video
tf
Mentioned in GitHub
aydao/stylegan2-surgery
tf
Mentioned in GitHub
lucidrains/stylegan2-pytorch
pytorch
Mentioned in GitHub
Ajasra/tattoo
tf
Mentioned in GitHub
cto300/stylegan2
tf
Mentioned in GitHub
erikakaeri/asdf
tf
Mentioned in GitHub
Bakikii/stylegan2-pytorch23
pytorch
Mentioned in GitHub
Ajasra/TattooStyleGAN2
tf
Mentioned in GitHub
cwvisuals/StyleGAN2
pytorch
Mentioned in GitHub
a-mcego/stylegannish
tf
Mentioned in GitHub
luckyfarnon/StyleGAN22
tf
Mentioned in GitHub
mmetaa/stylegan2
tf
Mentioned in GitHub
dzld00/pytorch-manifold-matching
pytorch
Mentioned in GitHub
jdbugs/stylegan2
tf
Mentioned in GitHub
bgtripp/stylegan2glacier
tf
Mentioned in GitHub
Uemuet/stylegan22
tf
Mentioned in GitHub
SiavashCS/sgan_simple
pytorch
Mentioned in GitHub
sahidrahmanxx12/TEMPEK
tf
Mentioned in GitHub
jimzers/stylegan2-colabs
Mentioned in GitHub
Ajasra/stylegan2
tf
Mentioned in GitHub
erikakaeri/StyleGAN2
tf
Mentioned in GitHub
RuiLiFeng/noise
tf
Mentioned in GitHub
Bakikii/stylegan2
tf
Mentioned in GitHub
RuiLiFeng/LAE
tf
Mentioned in GitHub
Kate589/gan
tf
Mentioned in GitHub
yangyucheng000/StyleGAN-V2
mindspore
Mentioned in GitHub
armaank/archlectures
pytorch
Mentioned in GitHub
hanehein921/StyleGAN2
tf
Mentioned in GitHub
thomaspool97/StyleGAN2
tf
Mentioned in GitHub
yyusuf3d/StyleGAN2
tf
Mentioned in GitHub
spacegoing/stylegan2
tf
Mentioned in GitHub
jdbugs/stylegan2encoder
tf
Mentioned in GitHub
mbbrodie/stylegan2
pytorch
Mentioned in GitHub
safi842/Microstructure-GAN
pytorch
Mentioned in GitHub
nekitmm/StyleGan2
tf
Mentioned in GitHub
tjwei/stylegan2_workshop
tf
Mentioned in GitHub
XieBaoshi/stylegan2
pytorch
Mentioned in GitHub
e4s2022/e4s
pytorch
Mentioned in GitHub
alekseynp/stylegan2-pytorch
pytorch
Mentioned in GitHub
RuiLiFeng/invGAN
tf
Mentioned in GitHub
Uemuet/stylegan2
tf
Mentioned in GitHub
amberkboulton/StyleGAN3
tf
Mentioned in GitHub
xunings/styleganime2
tf
Mentioned in GitHub
sidward14/gan-lab
pytorch
Mentioned in GitHub
Nirav-Agarwal/GANs
pytorch
Mentioned in GitHub
kh12lee/kh_lee
pytorch
Mentioned in GitHub
ohomburg/stylegan
tf
Mentioned in GitHub
LightNormal/StyleGAN2withGUI
tf
Mentioned in GitHub
cwvisuals/FleshDigressions
tf
Mentioned in GitHub
NawafAlsuwailem/artathon_code
tf
Mentioned in GitHub
JCBrouwer/maua-stylegan2
pytorch
Mentioned in GitHub
benguk46/StyleGAN2
tf
Mentioned in GitHub
jazzup6176/StyleGAN1
tf
Mentioned in GitHub
babyboy201/StyleGAN2
tf
Mentioned in GitHub
thwin0923/kjhij
tf
Mentioned in GitHub
Error-code404/Random-Unreal-Face
pytorch
Mentioned in GitHub
minyoungg/pix2latent
pytorch
Mentioned in GitHub
lucasgb98/StyleGAN2
tf
Mentioned in GitHub
tomguluson92/StyleGAN2_PyTorch
pytorch
Mentioned in GitHub
Uemuet/gan2
tf
Mentioned in GitHub
akashgit/stylegan2_wt
pytorch
Mentioned in GitHub
rolux/stylegan2tpu
tf
Mentioned in GitHub
mahbouldom/StyleGAN2
tf
Mentioned in GitHub
kunheek/style-aware-discriminator
pytorch
Mentioned in GitHub
RyanWu2233/Style_GAN2_TWDNE
tf
Mentioned in GitHub
cyrilzakka/stylegan2-tpu
tf
Mentioned in GitHub
eps696/stylegan2
tf
Mentioned in GitHub
grunnery/StyleGAN2
tf
Mentioned in GitHub
adelliax/StyleGAN2
tf
Mentioned in GitHub
b4nn3d/stylegan2
tf
Mentioned in GitHub
santoshchaurasiyacs/StyleGANv2
tf
Mentioned in GitHub
Di-Is/stylegan2-ada-pytorch
pytorch
Mentioned in GitHub
cffo/stylegan2-encoder
tf
Mentioned in GitHub
rolux/stylegan2encoder
tf
Mentioned in GitHub
b4nn3d/stylegan2encoder
tf
Mentioned in GitHub
simplerick/stylegan2_pytorch
pytorch
Mentioned in GitHub
hussain18804/toonify-poc
tf
Mentioned in GitHub
Heliang-Zheng/Style2
tf
Mentioned in GitHub
huangzh13/StyleGAN2.pytorch
pytorch
Mentioned in GitHub
hiroyasuakada/StyleGAN2-PyTorch
pytorch
Mentioned in GitHub
yuzq97/starter_project
tf
Mentioned in GitHub
cbritom/GAN
tf
Mentioned in GitHub
Herge/GAN2
tf
Mentioned in GitHub
woctezuma/steam-stylegan2-ada
pytorch
Mentioned in GitHub
Uemuet/imet2
tf
Mentioned in GitHub
xx88xx/stylegan2ky
tf
Mentioned in GitHub
gori1x62/StyleGAN2
tf
Mentioned in GitHub
tompaperspaceio/stylegan3
tf
Mentioned in GitHub
SpikeKing/stylegan2encoder-my
tf
Mentioned in GitHub
Xiaomao136/stylegan2-faceswap
tf
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
conditional-image-generation-on-artbench-10StyleGAN2
FID: 4.491
image-generation-on-ffhqStyleGAN2
Clean-FID (70k): 2.98
FID: 2.84
image-generation-on-ffhq-1024-x-1024StyleGAN2
FID: 2.84
image-generation-on-lsun-car-256-x-256StyleGAN2
FID: 2.32
image-generation-on-lsun-car-512-x-384StyleGAN2
FID: 2.32
image-generation-on-lsun-cat-256-x-256StyleGAN2
Clean-FID (trainfull): 6.97 ± 0.16
FID: 6.93
image-generation-on-lsun-churches-256-x-256StyleGAN2
Clean-FID (trainfull): 4.28 ± 0.03
FID: 3.86
image-generation-on-lsun-horse-256-x-256StyleGAN2
Clean-FID (trainfull): 4.06 ± 0.03
FID: 3.43

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Analyzing and Improving the Image Quality of StyleGAN | Papers | HyperAI