HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Trash or Treasure? An Interactive Dual-Stream Strategy for Single Image Reflection Separation

Qiming Hu Xiaojie Guo

Trash or Treasure? An Interactive Dual-Stream Strategy for Single Image Reflection Separation

Abstract

Single image reflection separation (SIRS), as a representative blind source separation task, aims to recover two layers, $\textit{i.e.}$, transmission and reflection, from one mixed observation, which is challenging due to the highly ill-posed nature. Existing deep learning based solutions typically restore the target layers individually, or with some concerns at the end of the output, barely taking into account the interaction across the two streams/branches. In order to utilize information more efficiently, this work presents a general yet simple interactive strategy, namely $\textit{your trash is my treasure}$ (YTMT), for constructing dual-stream decomposition networks. To be specific, we explicitly enforce the two streams to communicate with each other block-wisely. Inspired by the additive property between the two components, the interactive path can be easily built via transferring, instead of discarding, deactivated information by the ReLU rectifier from one stream to the other. Both ablation studies and experimental results on widely-used SIRS datasets are conducted to demonstrate the efficacy of YTMT, and reveal its superiority over other state-of-the-art alternatives. The implementation is quite simple and our code is publicly available at $\href{https://github.com/mingcv/YTMT-Strategy}{\textit{https://github.com/mingcv/YTMT-Strategy}}$.

Code Repositories

mingcv/ytmt-strategy
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
reflection-removal-on-natureYTMT-UCS
PSNR: 23.85
SSIM: 0.810
reflection-removal-on-real20YTMT-UCT
PSNR: 23.26
SSIM: 0.806
reflection-removal-on-sir-2-objectsYTMT-UCT
PSNR: 24.87
SSIM: 0.896
reflection-removal-on-sir-2-postcardYTMT-UCT
PSNR: 22.91
SSIM: 0.884
reflection-removal-on-sir-2-wildYTMT-UCT
PSNR: 25.48
SSIM: 0.89

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Trash or Treasure? An Interactive Dual-Stream Strategy for Single Image Reflection Separation | Papers | HyperAI