HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Multi-Field De-interlacing using Deformable Convolution Residual Blocks and Self-Attention

Ronglei Ji; A. Murat Tekalp

Multi-Field De-interlacing using Deformable Convolution Residual Blocks and Self-Attention

Abstract

Although deep learning has made significant impact on image/video restoration and super-resolution, learned deinterlacing has so far received less attention in academia or industry. This is despite deinterlacing is well-suited for supervised learning from synthetic data since the degradation model is known and fixed. In this paper, we propose a novel multi-field full frame-rate deinterlacing network, which adapts the state-of-the-art superresolution approaches to the deinterlacing task. Our model aligns features from adjacent fields to a reference field (to be deinterlaced) using both deformable convolution residual blocks and self attention. Our extensive experimental results demonstrate that the proposed method provides state-of-the-art deinterlacing results in terms of both numerical and perceptual performance. At the time of writing, our model ranks first in the Full FrameRate LeaderBoard at https://videoprocessing.ai/benchmarks/deinterlacer.html

Benchmarks

BenchmarkMethodologyMetrics
video-deinterlacing-on-msu-deinterlacerDfRes (122000 G2e 3)
PSNR: 43.200
SSIM: 0.972
Subjective: 0.862
VMAF: 95.68
video-deinterlacing-on-msu-deinterlacerDfRes (SA)
FPS on CPU: 0.1
PSNR: 43.486
SSIM: 0.972
Subjective: 0.925
VMAF: 95.96
video-deinterlacing-on-msu-deinterlacerDfRes
FPS on CPU: 0.4
PSNR: 40.590
SSIM: 0.971
Subjective: 0.912
VMAF: 95.20

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Multi-Field De-interlacing using Deformable Convolution Residual Blocks and Self-Attention | Papers | HyperAI