HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

EXTRACTER: Efficient Texture Matching with Attention and Gradient Enhancing for Large Scale Image Super Resolution

Esteban Reyes-Saldana Mariano Rivera

EXTRACTER: Efficient Texture Matching with Attention and Gradient Enhancing for Large Scale Image Super Resolution

Abstract

Recent Reference-Based image super-resolution (RefSR) has improved SOTA deep methods introducing attention mechanisms to enhance low-resolution images by transferring high-resolution textures from a reference high-resolution image. The main idea is to search for matches between patches using LR and Reference image pair in a feature space and merge them using deep architectures. However, existing methods lack the accurate search of textures. They divide images into as many patches as possible, resulting in inefficient memory usage, and cannot manage large images. Herein, we propose a deep search with a more efficient memory usage that reduces significantly the number of image patches and finds the $k$ most relevant texture match for each low-resolution patch over the high-resolution reference patches, resulting in an accurate texture match. We enhance the Super Resolution result adding gradient density information using a simple residual architecture showing competitive metrics results: PSNR and SSMI.

Code Repositories

esteban-rs/extracter
Official
pytorch

Benchmarks

BenchmarkMethodologyMetrics
image-super-resolution-on-cufed5-4x-upscalingExtracter-rec
PSNR: 27.29
SSIM: 0.811
image-super-resolution-on-set14-4x-upscalingExtracter-rec
PSNR: 28.09
SSIM: 0.782
image-super-resolution-on-sun80-4x-upscalingExtracter-rec
PSNR: 30.02
SSIM: 0.816
image-super-resolution-on-urban100-4xExtracter-rec
PSNR: 26.04
SSIM: 0.785

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
EXTRACTER: Efficient Texture Matching with Attention and Gradient Enhancing for Large Scale Image Super Resolution | Papers | HyperAI