HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks

Xintao Wang; Ke Yu; Shixiang Wu; Jinjin Gu; Yihao Liu; Chao Dong; Chen Change Loy; Yu Qiao; Xiaoou Tang

ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks

Abstract

The Super-Resolution Generative Adversarial Network (SRGAN) is a seminal work that is capable of generating realistic textures during single image super-resolution. However, the hallucinated details are often accompanied with unpleasant artifacts. To further enhance the visual quality, we thoroughly study three key components of SRGAN - network architecture, adversarial loss and perceptual loss, and improve each of them to derive an Enhanced SRGAN (ESRGAN). In particular, we introduce the Residual-in-Residual Dense Block (RRDB) without batch normalization as the basic network building unit. Moreover, we borrow the idea from relativistic GAN to let the discriminator predict relative realness instead of the absolute value. Finally, we improve the perceptual loss by using the features before activation, which could provide stronger supervision for brightness consistency and texture recovery. Benefiting from these improvements, the proposed ESRGAN achieves consistently better visual quality with more realistic and natural textures than SRGAN and won the first place in the PIRM2018-SR Challenge. The code is available at https://github.com/xinntao/ESRGAN .

Code Repositories

xinntao/ESRGAN
Official
pytorch
Mentioned in GitHub
HyeongJu916/Boaz-SR-ESRGAN-PyTorch
pytorch
Mentioned in GitHub
RezisEwig/esrgan
tf
Mentioned in GitHub
aba450/Super-Resolution
pytorch
Mentioned in GitHub
kingcong/gpu_ESRGAN
mindspore
Mentioned in GitHub
sberbank-ai/real-esrgan
pytorch
Mentioned in GitHub
YanyingZH/srgan-esrgan-pytorch
pytorch
Mentioned in GitHub
yangyucheng000/ESRGAN
mindspore
Mentioned in GitHub
YvanG/VQGAN-CLIP
pytorch
Mentioned in GitHub
cviaai/PSF-GAN-ESTIMATION
pytorch
Mentioned in GitHub
amogh7joshi/media-vision
pytorch
Mentioned in GitHub
doantienthongbku/ESRGAN
pytorch
Mentioned in GitHub
sberbank-ai/DigiTeller
tf
Mentioned in GitHub
peteryuX/esrgan-tf2
tf
Mentioned in GitHub
luciennnnnnn/dualformer
pytorch
Mentioned in GitHub
nabarunbaruaAIML/ATCC_Yolov5
pytorch
Mentioned in GitHub
eriklindernoren/PyTorch-GAN
pytorch
Mentioned in GitHub
sberbank-ai/DigiTales
tf
Mentioned in GitHub
CorentinMAG/SRGAN
Mentioned in GitHub
itsuki8914/ESRGAN-TensorFlow
tf
Mentioned in GitHub
idealo/image-super-resolution
tf
Mentioned in GitHub
Lornatang/ESRGAN-PyTorch
pytorch
Mentioned in GitHub
alililia/ascend_ESRGAN
mindspore
Mentioned in GitHub
fenghansen/ESRGAN-Keras
tf
Mentioned in GitHub
allenai/satlas-super-resolution
pytorch
Mentioned in GitHub
nannau/DoWnGAN
pytorch
Mentioned in GitHub
sdauzcm/sr-basicsr
pytorch
Mentioned in GitHub
u7javed/Image-Enhancer-via-ESRGAN
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
face-hallucination-on-ffhq-512-x-512-16xESRGAN
FID: 50.901
LPIPS: 0.3928
NIQE: 15.383
image-super-resolution-on-bsd100-4x-upscalingSRGAN + Residual-in-Residual Dense Block
PSNR: 27.85
SSIM: 0.7455
image-super-resolution-on-ffhq-1024-x-1024-4xESRGAN
FID: 72.73
MS-SSIM: 0.782
PSNR: 19.84
SSIM: 0.353
image-super-resolution-on-ffhq-256-x-256-4xESRGAN
FID: 166.36
MS-SSIM: 0.747
PSNR: 15.43
SSIM: 0.267
image-super-resolution-on-ffhq-512-x-512-4xESRGAN
FED: 0.1107
FID: 3.503
LLE: 2.261
LPIPS: 0.1221
MS-SSIM: 0.935
NIQE: 6.984
PSNR: 27.134
SSIM: 0.741
image-super-resolution-on-manga109-4xbicubic
PSNR: 24.89
SSIM: 0.7866
image-super-resolution-on-manga109-4xSRGAN + Residual-in-Residual Dense Block
PSNR: 31.66
SSIM: 0.9196
image-super-resolution-on-pirm-testESRGAN
NIQE: 2.55
image-super-resolution-on-set14-4x-upscalingSRGAN + Residual-in-Residual Dense Block
PSNR: 28.99
SSIM: 0.7917
image-super-resolution-on-urban100-4xSRGAN + Residual-in-Residual Dense Block
PSNR: 27.03
SSIM: 0.8153
image-super-resolution-on-urban100-4xbicubic
PSNR: 23.14
SSIM: 0.6577
video-super-resolution-on-msu-video-upscalersESRGAN
PSNR: 27.29
SSIM: 0.936
VMAF: 56.69
video-super-resolution-on-msu-vsr-benchmarkESRGAN
1 - LPIPS: 0.948
ERQAv1.0: 0.735
FPS: 1.004
PSNR: 27.33
QRCRv1.0: 0
SSIM: 0.808
Subjective score: 5.353

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks | Papers | HyperAI