HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Towards Flexible Blind JPEG Artifacts Removal

Jiang Jiaxi ; Zhang Kai ; Timofte Radu

Towards Flexible Blind JPEG Artifacts Removal

Abstract

Training a single deep blind model to handle different quality factors forJPEG image artifacts removal has been attracting considerable attention due toits convenience for practical usage. However, existing deep blind methodsusually directly reconstruct the image without predicting the quality factor,thus lacking the flexibility to control the output as the non-blind methods. Toremedy this problem, in this paper, we propose a flexible blind convolutionalneural network, namely FBCNN, that can predict the adjustable quality factor tocontrol the trade-off between artifacts removal and details preservation.Specifically, FBCNN decouples the quality factor from the JPEG image via adecoupler module and then embeds the predicted quality factor into thesubsequent reconstructor module through a quality factor attention block forflexible control. Besides, we find existing methods are prone to fail onnon-aligned double JPEG images even with only a one-pixel shift, and we thuspropose a double JPEG degradation model to augment the training data. Extensiveexperiments on single JPEG images, more general double JPEG images, andreal-world JPEG images demonstrate that our proposed FBCNN achieves favorableperformance against state-of-the-art methods in terms of both quantitativemetrics and visual quality.

Code Repositories

jiaxi-jiang/fbcnn
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
jpeg-artifact-correction-on-bsds500-qualityFBCNN
PSNR: 27.85
PSNR-B: 27.52
SSIM: 0.799
jpeg-artifact-correction-on-bsds500-quality-1FBCNN
PSNR: 30.14
PSNR-B: 29.56
SSIM: 0.867
jpeg-artifact-correction-on-bsds500-quality-2FBCNN
PSNR: 31.45
PSNR-B: 30.72
SSIM: 0.897
jpeg-artifact-correction-on-bsds500-quality-3FBCNN
PSNR: 29.67
PSNR-B: 29.22
SSIM: 0.821
jpeg-artifact-correction-on-bsds500-quality-4FBCNN
PSNR: 32.00
PSNR-B: 31.19
SSIM: 0.885
jpeg-artifact-correction-on-bsds500-quality-5FBCNN
PSNR: 33.37
PSNR-B: 32.32
SSIM: 0.913
jpeg-artifact-correction-on-classic5-qualityFBCNN
PSNR: 30.12
PSNR-B: 29.80
SSIM: 0.822
jpeg-artifact-correction-on-classic5-quality-1FBCNN
PSNR: 32.31
PSNR-B: 31.74
SSIM: 0.872
jpeg-artifact-correction-on-classic5-quality-2FBCNN
PSNR: 33.54
PSNR-B: 32.78
SSIM: 0.894
jpeg-artifact-correction-on-classic5-quality-3FBCNN
PSNR: 34.35
SSIM: 0.907
jpeg-artifact-correction-on-icb-quality-10FBCNN
PSNR: 32.18
PSNR-B: 32.15
SSIM: 0.815
jpeg-artifact-correction-on-icb-quality-20FBCNN
PSNR: 34.38
PSNR-B: 34.34
SSIM: 0.844
jpeg-artifact-correction-on-icb-quality-30FBCNN
PSNR: 35.41
PSNR-B: 35.35
SSIM: 0.857
jpeg-artifact-correction-on-live1-quality-10FBCNN
PSNR: 27.77
PSNR-B: 27.51
SSIM: 0.803
jpeg-artifact-correction-on-live1-quality-10-1FBCNN
PSNR: 29.75
PSNR-B: 29.40
SSIM: 0.827
jpeg-artifact-correction-on-live1-quality-20FBCNN
PSNR: 30.11
PSNR-B: 29.70
SSIM: 0.868
jpeg-artifact-correction-on-live1-quality-20-1FBCNN
PSNR: 32.13
PSNR-B: 31.57
SSIM: 0.889
jpeg-artifact-correction-on-live1-quality-30FBCNN
PSNR: 31.43
PSNR-B: 30.92
SSIM: 0.897
jpeg-artifact-correction-on-live1-quality-30-1FBCNN
PSNR: 33.54
PSNR-B: 32.83
SSIM: 0.916
jpeg-artifact-correction-on-live1-quality-40FBCNN
PSNR: 34.53
SSIM: 0.931

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Towards Flexible Blind JPEG Artifacts Removal | Papers | HyperAI