HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data

Xintao Wang Liangbin Xie Chao Dong Ying Shan

Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data

Abstract

Though many attempts have been made in blind super-resolution to restore low-resolution images with unknown and complex degradations, they are still far from addressing general real-world degraded images. In this work, we extend the powerful ESRGAN to a practical restoration application (namely, Real-ESRGAN), which is trained with pure synthetic data. Specifically, a high-order degradation modeling process is introduced to better simulate complex real-world degradations. We also consider the common ringing and overshoot artifacts in the synthesis process. In addition, we employ a U-Net discriminator with spectral normalization to increase discriminator capability and stabilize the training dynamics. Extensive comparisons have shown its superior visual performance than prior works on various real datasets. We also provide efficient implementations to synthesize training pairs on the fly.

Code Repositories

sberbank-ai/real-esrgan
pytorch
Mentioned in GitHub
bayuudachi/Real-esr-gan
pytorch
Mentioned in GitHub
final-0/Real-ESRGAN
pytorch
Mentioned in GitHub
final-0/Real-ESRGAN-bicubic
pytorch
Mentioned in GitHub
xinntao/Real-ESRGAN
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
video-super-resolution-on-msu-super-1Real-ESRGAN + uavs3e
BSQ-rate over ERQA: 7.225
BSQ-rate over LPIPS: 2.633
BSQ-rate over MS-SSIM: 4.612
BSQ-rate over PSNR: 15.144
BSQ-rate over Subjective Score: 1.417
BSQ-rate over VMAF: 2.122
video-super-resolution-on-msu-super-1Real-ESRGAN + x264
BSQ-rate over ERQA: 5.58
BSQ-rate over LPIPS: 0.733
BSQ-rate over MS-SSIM: 0.881
BSQ-rate over PSNR: 7.874
BSQ-rate over Subjective Score: 0.335
BSQ-rate over VMAF: 0.698
video-super-resolution-on-msu-super-1Real-ESRGAN + x265
BSQ-rate over ERQA: 6.328
BSQ-rate over LPIPS: 12.689
BSQ-rate over MS-SSIM: 5.393
BSQ-rate over PSNR: 8.113
BSQ-rate over Subjective Score: 0.64
BSQ-rate over VMAF: 1.464
video-super-resolution-on-msu-super-1Real-ESRGAN + aomenc
BSQ-rate over ERQA: 11.584
BSQ-rate over LPIPS: 11.957
BSQ-rate over MS-SSIM: 6.857
BSQ-rate over PSNR: 15.144
BSQ-rate over Subjective Score: 1.398
BSQ-rate over VMAF: 2.712
video-super-resolution-on-msu-super-1Real-ESRGAN + vvenc
BSQ-rate over ERQA: 6.712
BSQ-rate over LPIPS: 12.744
BSQ-rate over MS-SSIM: 5.95
BSQ-rate over PSNR: 14.561
BSQ-rate over VMAF: 3.8
video-super-resolution-on-msu-video-upscalersRealEsrgan-F
LPIPS: 0.185
PSNR: 28.82
SSIM: 0.850
video-super-resolution-on-msu-video-upscalersRealEsrgan
LPIPS: 0.181
PSNR: 29.14
SSIM: 0.855
video-super-resolution-on-msu-video-upscalersRealEsrgan-A
LPIPS: 0.244
PSNR: 28.71
SSIM: 0.830
video-super-resolution-on-msu-video-upscalersRealEsrgan-V
LPIPS: 0.333
PSNR: 25.52
SSIM: 0.795
video-super-resolution-on-msu-video-upscalersRealEsrnet
LPIPS: 0.296
PSNR: 30.52
SSIM: 0.878
video-super-resolution-on-msu-video-upscalersRealEsrnet-F
LPIPS: 0.280
PSNR: 30.01
SSIM: 0.868
video-super-resolution-on-msu-vsr-benchmarkReal-ESRnet
1 - LPIPS: 0.871
ERQAv1.0: 0.598
FPS: 1.019
PSNR: 27.195
QRCRv1.0: 0
SSIM: 0.824
Subjective score: 3.697
video-super-resolution-on-msu-vsr-benchmarkReal-ESRGAN
1 - LPIPS: 0.895
ERQAv1.0: 0.663
FPS: 1.01
PSNR: 24.441
QRCRv1.0: 0
SSIM: 0.774
Subjective score: 5.392

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data | Papers | HyperAI